2024-05-08T10:44:37.017 INFO:root:teuthology version: 0.0.1.dev271+g1ae7ad8 2024-05-08T10:44:37.017 DEBUG:teuthology.run:Teuthology command: teuthology --description fs:functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/mds-flush} --owner scheduled_jcollin@teuthology --archive /home/teuthworker/archive/jcollin-2024-05-08_10:38:33-fs:functional-main-distro-default-smithi/7697403 --name jcollin-2024-05-08_10:38:33-fs:functional-main-distro-default-smithi --verbose -- /home/teuthworker/archive/jcollin-2024-05-08_10:38:33-fs:functional-main-distro-default-smithi/7697403/orig.config.yaml 2024-05-08T10:44:37.064 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-08T10:44:37.152 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/jcollin-2024-05-08_10:38:33-fs:functional-main-distro-default-smithi/7697403 branch: main description: fs:functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/mds-flush} email: jcollin@redhat.com first_in_suite: false job_id: '7697403' kernel: client: sha1: distro kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: jcollin-2024-05-08_10:38:33-fs:functional-main-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: main ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability sha1: 1fb5d10608dccee73edd6ef8a2c7b804a097c324 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 1fb5d10608dccee73edd6ef8a2c7b804a097c324 kclient: syntax: v2 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 subvolume_version: 1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: origin-jcollin-testing sha1: 01ce85a26cb3f8a34af686c5296fc2b3660a1e86 owner: scheduled_jcollin@teuthology priority: 2 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 101 sha1: 1fb5d10608dccee73edd6ef8a2c7b804a097c324 sleep_before_teardown: 0 suite: fs:functional suite_branch: origin-jcollin-testing suite_path: /home/teuthworker/src/github.com_joscollin_ceph_01ce85a26cb3f8a34af686c5296fc2b3660a1e86/qa suite_relpath: qa suite_repo: https://github.com/joscollin/ceph.git suite_sha1: 01ce85a26cb3f8a34af686c5296fc2b3660a1e86 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi033.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHtIKUPltaV098aB4kFmMbFU4MnfhpK0NSBvhwGeNcp0uXmll4KCC4rQ/tvyHc73u5IhTi8/1rSHFWL4GUCGhtQ= smithi174.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBtS3nTonDg82DT9OrdTj7uPHVZGLJjEg9BZYBXwzbrOLZxslRmjL75laxVECb3JYmUv+SQ8gSZxpA2AznMEWOI= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_flush teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 1ae7ad82388e92a475afff437d49054826c019a1 timestamp: 2024-05-08_10:38:33 tube: smithi user: jcollin verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-05-08T10:44:37.153 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_joscollin_ceph_01ce85a26cb3f8a34af686c5296fc2b3660a1e86/qa; will attempt to use it 2024-05-08T10:44:37.153 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_joscollin_ceph_01ce85a26cb3f8a34af686c5296fc2b3660a1e86/qa/tasks 2024-05-08T10:44:37.154 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-05-08T10:44:37.155 INFO:teuthology.task.internal:Checking packages... 2024-05-08T10:44:37.182 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '1fb5d10608dccee73edd6ef8a2c7b804a097c324' 2024-05-08T10:44:37.182 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-08T10:44:37.182 INFO:teuthology.packaging:ref: None 2024-05-08T10:44:37.182 INFO:teuthology.packaging:tag: None 2024-05-08T10:44:37.182 INFO:teuthology.packaging:branch: main 2024-05-08T10:44:37.183 INFO:teuthology.packaging:sha1: 1fb5d10608dccee73edd6ef8a2c7b804a097c324 2024-05-08T10:44:37.183 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=main 2024-05-08T10:44:37.438 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3562.g9c89fb19 2024-05-08T10:44:37.440 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-05-08T10:44:37.446 INFO:teuthology.task.internal:no buildpackages task found 2024-05-08T10:44:37.446 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-05-08T10:44:37.564 INFO:teuthology.task.internal:Saving configuration 2024-05-08T10:44:37.583 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-05-08T10:44:37.730 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-08T10:44:37.765 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi033.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/jcollin-2024-05-08_10:38:33-fs:functional-main-distro-default-smithi/7697403', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-08 10:39:45.268574', 'locked_by': 'scheduled_jcollin@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHtIKUPltaV098aB4kFmMbFU4MnfhpK0NSBvhwGeNcp0uXmll4KCC4rQ/tvyHc73u5IhTi8/1rSHFWL4GUCGhtQ='} 2024-05-08T10:44:37.795 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi174.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/jcollin-2024-05-08_10:38:33-fs:functional-main-distro-default-smithi/7697403', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-08 10:39:45.266940', 'locked_by': 'scheduled_jcollin@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBtS3nTonDg82DT9OrdTj7uPHVZGLJjEg9BZYBXwzbrOLZxslRmjL75laxVECb3JYmUv+SQ8gSZxpA2AznMEWOI='} 2024-05-08T10:44:37.795 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-05-08T10:44:37.877 INFO:teuthology.task.internal:roles: ubuntu@smithi033.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-05-08T10:44:37.877 INFO:teuthology.task.internal:roles: ubuntu@smithi174.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-05-08T10:44:37.877 INFO:teuthology.run_tasks:Running task console_log... 2024-05-08T10:44:37.967 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f767f80d0d0>, signals=[15]) 2024-05-08T10:44:37.967 INFO:teuthology.run_tasks:Running task internal.connect... 2024-05-08T10:44:37.974 INFO:teuthology.task.internal:Opening connections... 2024-05-08T10:44:37.974 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi033.front.sepia.ceph.com 2024-05-08T10:44:37.976 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T10:44:38.078 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi174.front.sepia.ceph.com 2024-05-08T10:44:38.079 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T10:44:38.162 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-05-08T10:44:38.169 DEBUG:teuthology.orchestra.run.smithi033:> uname -m 2024-05-08T10:44:38.187 INFO:teuthology.orchestra.run.smithi033.stdout:x86_64 2024-05-08T10:44:38.188 DEBUG:teuthology.orchestra.run.smithi033:> cat /etc/os-release 2024-05-08T10:44:38.246 INFO:teuthology.orchestra.run.smithi033.stdout:NAME="CentOS Stream" 2024-05-08T10:44:38.246 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION="9" 2024-05-08T10:44:38.247 INFO:teuthology.orchestra.run.smithi033.stdout:ID="centos" 2024-05-08T10:44:38.247 INFO:teuthology.orchestra.run.smithi033.stdout:ID_LIKE="rhel fedora" 2024-05-08T10:44:38.247 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION_ID="9" 2024-05-08T10:44:38.247 INFO:teuthology.orchestra.run.smithi033.stdout:PLATFORM_ID="platform:el9" 2024-05-08T10:44:38.247 INFO:teuthology.orchestra.run.smithi033.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-08T10:44:38.247 INFO:teuthology.orchestra.run.smithi033.stdout:ANSI_COLOR="0;31" 2024-05-08T10:44:38.247 INFO:teuthology.orchestra.run.smithi033.stdout:LOGO="fedora-logo-icon" 2024-05-08T10:44:38.247 INFO:teuthology.orchestra.run.smithi033.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-08T10:44:38.247 INFO:teuthology.orchestra.run.smithi033.stdout:HOME_URL="https://centos.org/" 2024-05-08T10:44:38.247 INFO:teuthology.orchestra.run.smithi033.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-08T10:44:38.247 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-08T10:44:38.247 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-08T10:44:38.248 INFO:teuthology.lock.ops:Updating smithi033.front.sepia.ceph.com on lock server 2024-05-08T10:44:38.283 DEBUG:teuthology.orchestra.run.smithi174:> uname -m 2024-05-08T10:44:38.301 INFO:teuthology.orchestra.run.smithi174.stdout:x86_64 2024-05-08T10:44:38.301 DEBUG:teuthology.orchestra.run.smithi174:> cat /etc/os-release 2024-05-08T10:44:38.358 INFO:teuthology.orchestra.run.smithi174.stdout:NAME="CentOS Stream" 2024-05-08T10:44:38.359 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION="9" 2024-05-08T10:44:38.359 INFO:teuthology.orchestra.run.smithi174.stdout:ID="centos" 2024-05-08T10:44:38.359 INFO:teuthology.orchestra.run.smithi174.stdout:ID_LIKE="rhel fedora" 2024-05-08T10:44:38.359 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION_ID="9" 2024-05-08T10:44:38.359 INFO:teuthology.orchestra.run.smithi174.stdout:PLATFORM_ID="platform:el9" 2024-05-08T10:44:38.359 INFO:teuthology.orchestra.run.smithi174.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-08T10:44:38.359 INFO:teuthology.orchestra.run.smithi174.stdout:ANSI_COLOR="0;31" 2024-05-08T10:44:38.359 INFO:teuthology.orchestra.run.smithi174.stdout:LOGO="fedora-logo-icon" 2024-05-08T10:44:38.359 INFO:teuthology.orchestra.run.smithi174.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-08T10:44:38.359 INFO:teuthology.orchestra.run.smithi174.stdout:HOME_URL="https://centos.org/" 2024-05-08T10:44:38.359 INFO:teuthology.orchestra.run.smithi174.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-08T10:44:38.359 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-08T10:44:38.360 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-08T10:44:38.360 INFO:teuthology.lock.ops:Updating smithi174.front.sepia.ceph.com on lock server 2024-05-08T10:44:38.395 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-05-08T10:44:38.406 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-05-08T10:44:38.537 INFO:teuthology.task.internal:Checking for old test directory... 2024-05-08T10:44:38.537 DEBUG:teuthology.orchestra.run.smithi033:> test '!' -e /home/ubuntu/cephtest 2024-05-08T10:44:38.541 DEBUG:teuthology.orchestra.run.smithi174:> test '!' -e /home/ubuntu/cephtest 2024-05-08T10:44:38.558 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-05-08T10:44:38.659 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-05-08T10:44:38.659 DEBUG:teuthology.orchestra.run.smithi033:> test -z $(ls -A /var/lib/ceph) 2024-05-08T10:44:38.662 DEBUG:teuthology.orchestra.run.smithi174:> test -z $(ls -A /var/lib/ceph) 2024-05-08T10:44:38.688 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-05-08T10:44:38.757 INFO:teuthology.run_tasks:Running task kernel... 2024-05-08T10:44:38.825 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'} 2024-05-08T10:44:38.825 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2024-05-08T10:44:38.826 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2024-05-08T10:44:38.826 DEBUG:teuthology.orchestra.run.smithi033:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-08T10:44:38.826 DEBUG:teuthology.orchestra.run.smithi174:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-08T10:44:38.843 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T10:44:38.843 DEBUG:teuthology.orchestra.run.smithi174:> uname -r 2024-05-08T10:44:38.844 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T10:44:38.844 DEBUG:teuthology.orchestra.run.smithi033:> uname -r 2024-05-08T10:44:38.900 INFO:teuthology.orchestra.run.smithi174.stdout:5.14.0-437.el9.x86_64 2024-05-08T10:44:38.900 INFO:teuthology.task.kernel:Running kernel on smithi174: 5.14.0-437.el9.x86_64 2024-05-08T10:44:38.900 DEBUG:teuthology.orchestra.run.smithi174:> sudo yum install -y kernel 2024-05-08T10:44:38.902 INFO:teuthology.orchestra.run.smithi033.stdout:5.14.0-437.el9.x86_64 2024-05-08T10:44:38.902 INFO:teuthology.task.kernel:Running kernel on smithi033: 5.14.0-437.el9.x86_64 2024-05-08T10:44:38.902 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum install -y kernel 2024-05-08T10:44:42.487 INFO:teuthology.orchestra.run.smithi033.stdout:CentOS Stream 9 - BaseOS 4.1 MB/s | 8.1 MB 00:01 2024-05-08T10:44:42.511 INFO:teuthology.orchestra.run.smithi174.stdout:CentOS Stream 9 - BaseOS 4.2 MB/s | 8.1 MB 00:01 2024-05-08T10:44:44.445 INFO:teuthology.orchestra.run.smithi174.stdout:CentOS Stream 9 - AppStream 23 MB/s | 19 MB 00:00 2024-05-08T10:44:49.929 INFO:teuthology.orchestra.run.smithi174.stdout:CentOS Stream 9 - CRB 3.3 MB/s | 6.2 MB 00:01 2024-05-08T10:44:51.563 INFO:teuthology.orchestra.run.smithi174.stdout:CentOS Stream 9 - Extras packages 60 kB/s | 16 kB 00:00 2024-05-08T10:44:53.083 INFO:teuthology.orchestra.run.smithi174.stdout:Extra Packages for Enterprise Linux 15 MB/s | 21 MB 00:01 2024-05-08T10:44:58.264 INFO:teuthology.orchestra.run.smithi174.stdout:lab-extras 15 kB/s | 1.7 kB 00:00 2024-05-08T10:45:00.262 INFO:teuthology.orchestra.run.smithi174.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-05-08T10:45:00.262 INFO:teuthology.orchestra.run.smithi174.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-05-08T10:45:00.360 INFO:teuthology.orchestra.run.smithi174.stdout:Dependencies resolved. 2024-05-08T10:45:00.367 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2024-05-08T10:45:00.367 INFO:teuthology.orchestra.run.smithi174.stdout: Package Architecture Version Repository Size 2024-05-08T10:45:00.367 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2024-05-08T10:45:00.367 INFO:teuthology.orchestra.run.smithi174.stdout:Installing: 2024-05-08T10:45:00.367 INFO:teuthology.orchestra.run.smithi174.stdout: kernel x86_64 5.14.0-444.el9 baseos 484 k 2024-05-08T10:45:00.367 INFO:teuthology.orchestra.run.smithi174.stdout:Installing dependencies: 2024-05-08T10:45:00.367 INFO:teuthology.orchestra.run.smithi174.stdout: kernel-core x86_64 5.14.0-444.el9 baseos 15 M 2024-05-08T10:45:00.368 INFO:teuthology.orchestra.run.smithi174.stdout: kernel-modules x86_64 5.14.0-444.el9 baseos 34 M 2024-05-08T10:45:00.368 INFO:teuthology.orchestra.run.smithi174.stdout: kernel-modules-core x86_64 5.14.0-444.el9 baseos 28 M 2024-05-08T10:45:00.368 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-08T10:45:00.368 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction Summary 2024-05-08T10:45:00.368 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2024-05-08T10:45:00.368 INFO:teuthology.orchestra.run.smithi174.stdout:Install 4 Packages 2024-05-08T10:45:00.368 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-08T10:45:00.368 INFO:teuthology.orchestra.run.smithi174.stdout:Total download size: 78 M 2024-05-08T10:45:00.369 INFO:teuthology.orchestra.run.smithi174.stdout:Installed size: 123 M 2024-05-08T10:45:00.369 INFO:teuthology.orchestra.run.smithi174.stdout:Downloading Packages: 2024-05-08T10:45:00.541 INFO:teuthology.orchestra.run.smithi174.stdout:(1/4): kernel-5.14.0-444.el9.x86_64.rpm 4.1 MB/s | 484 kB 00:00 2024-05-08T10:45:01.101 INFO:teuthology.orchestra.run.smithi033.stdout:CentOS Stream 9 - AppStream 1.1 MB/s | 19 MB 00:17 2024-05-08T10:45:01.224 INFO:teuthology.orchestra.run.smithi174.stdout:(2/4): kernel-core-5.14.0-444.el9.x86_64.rpm 19 MB/s | 15 MB 00:00 2024-05-08T10:45:01.774 INFO:teuthology.orchestra.run.smithi174.stdout:(3/4): kernel-modules-5.14.0-444.el9.x86_64.rpm 25 MB/s | 34 MB 00:01 2024-05-08T10:45:02.058 INFO:teuthology.orchestra.run.smithi174.stdout:(4/4): kernel-modules-core-5.14.0-444.el9.x86_6 18 MB/s | 28 MB 00:01 2024-05-08T10:45:02.058 INFO:teuthology.orchestra.run.smithi174.stdout:-------------------------------------------------------------------------------- 2024-05-08T10:45:02.058 INFO:teuthology.orchestra.run.smithi174.stdout:Total 46 MB/s | 78 MB 00:01 2024-05-08T10:45:02.734 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction check 2024-05-08T10:45:03.083 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction check succeeded. 2024-05-08T10:45:03.084 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction test 2024-05-08T10:45:03.992 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction test succeeded. 2024-05-08T10:45:03.992 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction 2024-05-08T10:45:05.968 INFO:teuthology.orchestra.run.smithi033.stdout:CentOS Stream 9 - CRB 5.4 MB/s | 6.2 MB 00:01 2024-05-08T10:45:06.400 INFO:teuthology.orchestra.run.smithi174.stdout: Preparing : 1/1 2024-05-08T10:45:07.107 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : kernel-modules-core-5.14.0-444.el9.x86_64 1/4 2024-05-08T10:45:07.182 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-08T10:45:08.393 INFO:teuthology.orchestra.run.smithi033.stdout:CentOS Stream 9 - Extras packages 13 kB/s | 16 kB 00:01 2024-05-08T10:45:09.846 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-08T10:45:09.982 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-08T10:45:10.870 INFO:teuthology.orchestra.run.smithi033.stdout:Extra Packages for Enterprise Linux 9.1 MB/s | 21 MB 00:02 2024-05-08T10:45:14.709 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-08T10:45:14.922 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : kernel-5.14.0-444.el9.x86_64 4/4 2024-05-08T10:45:16.270 INFO:teuthology.orchestra.run.smithi033.stdout:lab-extras 37 kB/s | 1.7 kB 00:00 2024-05-08T10:45:18.359 INFO:teuthology.orchestra.run.smithi033.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-05-08T10:45:18.359 INFO:teuthology.orchestra.run.smithi033.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-05-08T10:45:18.457 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. 2024-05-08T10:45:18.471 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-05-08T10:45:18.471 INFO:teuthology.orchestra.run.smithi033.stdout: Package Architecture Version Repository Size 2024-05-08T10:45:18.471 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-05-08T10:45:18.471 INFO:teuthology.orchestra.run.smithi033.stdout:Installing: 2024-05-08T10:45:18.471 INFO:teuthology.orchestra.run.smithi033.stdout: kernel x86_64 5.14.0-444.el9 baseos 484 k 2024-05-08T10:45:18.471 INFO:teuthology.orchestra.run.smithi033.stdout:Installing dependencies: 2024-05-08T10:45:18.471 INFO:teuthology.orchestra.run.smithi033.stdout: kernel-core x86_64 5.14.0-444.el9 baseos 15 M 2024-05-08T10:45:18.471 INFO:teuthology.orchestra.run.smithi033.stdout: kernel-modules x86_64 5.14.0-444.el9 baseos 34 M 2024-05-08T10:45:18.472 INFO:teuthology.orchestra.run.smithi033.stdout: kernel-modules-core x86_64 5.14.0-444.el9 baseos 28 M 2024-05-08T10:45:18.472 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:45:18.472 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction Summary 2024-05-08T10:45:18.472 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-05-08T10:45:18.472 INFO:teuthology.orchestra.run.smithi033.stdout:Install 4 Packages 2024-05-08T10:45:18.472 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:45:18.472 INFO:teuthology.orchestra.run.smithi033.stdout:Total download size: 78 M 2024-05-08T10:45:18.472 INFO:teuthology.orchestra.run.smithi033.stdout:Installed size: 123 M 2024-05-08T10:45:18.473 INFO:teuthology.orchestra.run.smithi033.stdout:Downloading Packages: 2024-05-08T10:45:18.688 INFO:teuthology.orchestra.run.smithi033.stdout:(1/4): kernel-5.14.0-444.el9.x86_64.rpm 2.7 MB/s | 484 kB 00:00 2024-05-08T10:45:18.997 INFO:teuthology.orchestra.run.smithi033.stdout:(2/4): kernel-core-5.14.0-444.el9.x86_64.rpm 32 MB/s | 15 MB 00:00 2024-05-08T10:45:19.422 INFO:teuthology.orchestra.run.smithi033.stdout:(3/4): kernel-modules-5.14.0-444.el9.x86_64.rpm 37 MB/s | 34 MB 00:00 2024-05-08T10:45:19.668 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: kernel-modules-core-5.14.0-444.el9.x86_64 4/4 2024-05-08T10:45:19.755 INFO:teuthology.orchestra.run.smithi033.stdout:(4/4): kernel-modules-core-5.14.0-444.el9.x86_6 26 MB/s | 28 MB 00:01 2024-05-08T10:45:19.756 INFO:teuthology.orchestra.run.smithi033.stdout:-------------------------------------------------------------------------------- 2024-05-08T10:45:19.756 INFO:teuthology.orchestra.run.smithi033.stdout:Total 61 MB/s | 78 MB 00:01 2024-05-08T10:45:20.465 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction check 2024-05-08T10:45:20.880 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction check succeeded. 2024-05-08T10:45:20.880 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction test 2024-05-08T10:45:21.841 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction test succeeded. 2024-05-08T10:45:21.841 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction 2024-05-08T10:45:24.391 INFO:teuthology.orchestra.run.smithi033.stdout: Preparing : 1/1 2024-05-08T10:45:25.055 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : kernel-modules-core-5.14.0-444.el9.x86_64 1/4 2024-05-08T10:45:25.147 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-08T10:45:27.985 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-08T10:45:28.123 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-08T10:45:33.226 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-08T10:45:33.267 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : kernel-5.14.0-444.el9.x86_64 4/4 2024-05-08T10:45:38.353 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: kernel-modules-core-5.14.0-444.el9.x86_64 4/4 2024-05-08T10:45:49.059 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: kernel-core-5.14.0-444.el9.x86_64 4/4 2024-05-08T10:45:49.097 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: kernel-modules-5.14.0-444.el9.x86_64 4/4 2024-05-08T10:45:49.374 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: kernel-5.14.0-444.el9.x86_64 4/4 2024-05-08T10:45:49.374 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : kernel-5.14.0-444.el9.x86_64 1/4 2024-05-08T10:45:49.374 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-08T10:45:49.374 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-08T10:45:50.209 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : kernel-modules-core-5.14.0-444.el9.x86_64 4/4 2024-05-08T10:45:50.209 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-08T10:45:50.209 INFO:teuthology.orchestra.run.smithi174.stdout:Installed: 2024-05-08T10:45:50.209 INFO:teuthology.orchestra.run.smithi174.stdout: kernel-5.14.0-444.el9.x86_64 2024-05-08T10:45:50.209 INFO:teuthology.orchestra.run.smithi174.stdout: kernel-core-5.14.0-444.el9.x86_64 2024-05-08T10:45:50.209 INFO:teuthology.orchestra.run.smithi174.stdout: kernel-modules-5.14.0-444.el9.x86_64 2024-05-08T10:45:50.209 INFO:teuthology.orchestra.run.smithi174.stdout: kernel-modules-core-5.14.0-444.el9.x86_64 2024-05-08T10:45:50.210 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-08T10:45:50.210 INFO:teuthology.orchestra.run.smithi174.stdout:Complete! 2024-05-08T10:45:50.528 DEBUG:teuthology.orchestra.run.smithi174:> rpm -q kernel | sort -rV | head -n 1 2024-05-08T10:45:50.613 INFO:teuthology.orchestra.run.smithi174.stdout:kernel-5.14.0-444.el9.x86_64 2024-05-08T10:45:50.614 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-444.el9.x86_64 2024-05-08T10:45:50.614 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-437.el9.x86_64 Expected: 5.14.0-444.el9.x86_64 2024-05-08T10:45:50.614 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-05-08T10:45:50.614 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-05-08T10:45:50.615 INFO:teuthology.task.kernel:Installing distro kernel on client.1... 2024-05-08T10:45:50.615 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi174.front.sepia.ceph.com, path=None, version=distro) 2024-05-08T10:45:50.615 DEBUG:teuthology.orchestra.run.smithi174:> rpm -q kernel | sort -rV | head -n 1 2024-05-08T10:45:50.665 INFO:teuthology.orchestra.run.smithi174.stdout:kernel-5.14.0-444.el9.x86_64 2024-05-08T10:45:50.665 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-444.el9.x86_64 2024-05-08T10:45:50.666 DEBUG:teuthology.orchestra.run.smithi174:> sudo rpm -qi grub2-tools 2024-05-08T10:45:50.699 INFO:teuthology.orchestra.run.smithi174.stdout:Name : grub2-tools 2024-05-08T10:45:50.699 INFO:teuthology.orchestra.run.smithi174.stdout:Epoch : 1 2024-05-08T10:45:50.699 INFO:teuthology.orchestra.run.smithi174.stdout:Version : 2.06 2024-05-08T10:45:50.699 INFO:teuthology.orchestra.run.smithi174.stdout:Release : 68.el9 2024-05-08T10:45:50.699 INFO:teuthology.orchestra.run.smithi174.stdout:Architecture: x86_64 2024-05-08T10:45:50.699 INFO:teuthology.orchestra.run.smithi174.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-05-08T10:45:50.699 INFO:teuthology.orchestra.run.smithi174.stdout:Group : Unspecified 2024-05-08T10:45:50.699 INFO:teuthology.orchestra.run.smithi174.stdout:Size : 8264254 2024-05-08T10:45:50.699 INFO:teuthology.orchestra.run.smithi174.stdout:License : GPLv3+ 2024-05-08T10:45:50.699 INFO:teuthology.orchestra.run.smithi174.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-05-08T10:45:50.699 INFO:teuthology.orchestra.run.smithi174.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-05-08T10:45:50.699 INFO:teuthology.orchestra.run.smithi174.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-05-08T10:45:50.700 INFO:teuthology.orchestra.run.smithi174.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-05-08T10:45:50.700 INFO:teuthology.orchestra.run.smithi174.stdout:Packager : builder@centos.org 2024-05-08T10:45:50.700 INFO:teuthology.orchestra.run.smithi174.stdout:Vendor : CentOS 2024-05-08T10:45:50.700 INFO:teuthology.orchestra.run.smithi174.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-08T10:45:50.700 INFO:teuthology.orchestra.run.smithi174.stdout:Summary : Support tools for GRUB. 2024-05-08T10:45:50.700 INFO:teuthology.orchestra.run.smithi174.stdout:Description : 2024-05-08T10:45:50.700 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-08T10:45:50.700 INFO:teuthology.orchestra.run.smithi174.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-08T10:45:50.700 INFO:teuthology.orchestra.run.smithi174.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-08T10:45:50.700 INFO:teuthology.orchestra.run.smithi174.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-08T10:45:50.700 INFO:teuthology.orchestra.run.smithi174.stdout:hardware devices. 2024-05-08T10:45:50.700 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-08T10:45:50.700 INFO:teuthology.orchestra.run.smithi174.stdout:This subpackage provides tools for support of all platforms. 2024-05-08T10:45:50.701 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-08T10:45:50.701 INFO:teuthology.task.kernel:Updating grub on smithi174 to boot 5.14.0-444.el9.x86_64 2024-05-08T10:45:50.702 DEBUG:teuthology.orchestra.run.smithi174:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-08T10:45:51.303 INFO:teuthology.orchestra.run.smithi174.stderr:Generating grub configuration file ... 2024-05-08T10:45:52.687 INFO:teuthology.orchestra.run.smithi174.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-05-08T10:45:52.719 INFO:teuthology.orchestra.run.smithi174.stderr:done 2024-05-08T10:45:52.722 DEBUG:teuthology.orchestra.run.smithi174:> mktemp 2024-05-08T10:45:52.736 INFO:teuthology.orchestra.run.smithi174.stdout:/tmp/tmp.NO1OkRVtCX 2024-05-08T10:45:52.736 DEBUG:teuthology.orchestra.run.smithi174:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.NO1OkRVtCX 2024-05-08T10:45:52.801 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod 0666 /tmp/tmp.NO1OkRVtCX 2024-05-08T10:45:52.932 DEBUG:teuthology.orchestra.remote:smithi174:/tmp/tmp.NO1OkRVtCX is 6KB 2024-05-08T10:45:52.980 DEBUG:teuthology.orchestra.run.smithi174:> rm -fr /tmp/tmp.NO1OkRVtCX 2024-05-08T10:45:52.994 DEBUG:teuthology.orchestra.run.smithi174:> sudo /bin/ls /boot/loader/entries || true 2024-05-08T10:45:53.056 INFO:teuthology.orchestra.run.smithi174.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-05-08T10:45:53.056 INFO:teuthology.orchestra.run.smithi174.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-05-08T10:45:53.056 INFO:teuthology.orchestra.run.smithi174.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-05-08T10:45:53.056 INFO:teuthology.orchestra.run.smithi174.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-444.el9.x86_64.conf 2024-05-08T10:45:53.058 DEBUG:teuthology.orchestra.run.smithi174:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-5.14.0-444.el9.x86_64 2024-05-08T10:45:53.221 DEBUG:teuthology.orchestra.run.smithi174:> sudo shutdown -r now 2024-05-08T10:46:09.274 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: kernel-core-5.14.0-444.el9.x86_64 4/4 2024-05-08T10:46:09.313 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: kernel-modules-5.14.0-444.el9.x86_64 4/4 2024-05-08T10:46:09.613 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: kernel-5.14.0-444.el9.x86_64 4/4 2024-05-08T10:46:09.613 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : kernel-5.14.0-444.el9.x86_64 1/4 2024-05-08T10:46:09.614 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-08T10:46:09.614 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-08T10:46:10.430 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : kernel-modules-core-5.14.0-444.el9.x86_64 4/4 2024-05-08T10:46:10.430 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:46:10.430 INFO:teuthology.orchestra.run.smithi033.stdout:Installed: 2024-05-08T10:46:10.430 INFO:teuthology.orchestra.run.smithi033.stdout: kernel-5.14.0-444.el9.x86_64 2024-05-08T10:46:10.431 INFO:teuthology.orchestra.run.smithi033.stdout: kernel-core-5.14.0-444.el9.x86_64 2024-05-08T10:46:10.431 INFO:teuthology.orchestra.run.smithi033.stdout: kernel-modules-5.14.0-444.el9.x86_64 2024-05-08T10:46:10.431 INFO:teuthology.orchestra.run.smithi033.stdout: kernel-modules-core-5.14.0-444.el9.x86_64 2024-05-08T10:46:10.431 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:46:10.431 INFO:teuthology.orchestra.run.smithi033.stdout:Complete! 2024-05-08T10:46:10.767 DEBUG:teuthology.orchestra.run.smithi033:> rpm -q kernel | sort -rV | head -n 1 2024-05-08T10:46:10.850 INFO:teuthology.orchestra.run.smithi033.stdout:kernel-5.14.0-444.el9.x86_64 2024-05-08T10:46:10.851 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-444.el9.x86_64 2024-05-08T10:46:10.851 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-437.el9.x86_64 Expected: 5.14.0-444.el9.x86_64 2024-05-08T10:46:10.851 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-05-08T10:46:10.851 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-05-08T10:46:10.851 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-05-08T10:46:10.851 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi033.front.sepia.ceph.com, path=None, version=distro) 2024-05-08T10:46:10.851 DEBUG:teuthology.orchestra.run.smithi033:> rpm -q kernel | sort -rV | head -n 1 2024-05-08T10:46:10.902 INFO:teuthology.orchestra.run.smithi033.stdout:kernel-5.14.0-444.el9.x86_64 2024-05-08T10:46:10.902 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-444.el9.x86_64 2024-05-08T10:46:10.902 DEBUG:teuthology.orchestra.run.smithi033:> sudo rpm -qi grub2-tools 2024-05-08T10:46:10.946 INFO:teuthology.orchestra.run.smithi033.stdout:Name : grub2-tools 2024-05-08T10:46:10.946 INFO:teuthology.orchestra.run.smithi033.stdout:Epoch : 1 2024-05-08T10:46:10.946 INFO:teuthology.orchestra.run.smithi033.stdout:Version : 2.06 2024-05-08T10:46:10.946 INFO:teuthology.orchestra.run.smithi033.stdout:Release : 68.el9 2024-05-08T10:46:10.946 INFO:teuthology.orchestra.run.smithi033.stdout:Architecture: x86_64 2024-05-08T10:46:10.946 INFO:teuthology.orchestra.run.smithi033.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-05-08T10:46:10.946 INFO:teuthology.orchestra.run.smithi033.stdout:Group : Unspecified 2024-05-08T10:46:10.946 INFO:teuthology.orchestra.run.smithi033.stdout:Size : 8264254 2024-05-08T10:46:10.947 INFO:teuthology.orchestra.run.smithi033.stdout:License : GPLv3+ 2024-05-08T10:46:10.947 INFO:teuthology.orchestra.run.smithi033.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-05-08T10:46:10.947 INFO:teuthology.orchestra.run.smithi033.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-05-08T10:46:10.947 INFO:teuthology.orchestra.run.smithi033.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-05-08T10:46:10.947 INFO:teuthology.orchestra.run.smithi033.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-05-08T10:46:10.947 INFO:teuthology.orchestra.run.smithi033.stdout:Packager : builder@centos.org 2024-05-08T10:46:10.947 INFO:teuthology.orchestra.run.smithi033.stdout:Vendor : CentOS 2024-05-08T10:46:10.947 INFO:teuthology.orchestra.run.smithi033.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-08T10:46:10.947 INFO:teuthology.orchestra.run.smithi033.stdout:Summary : Support tools for GRUB. 2024-05-08T10:46:10.947 INFO:teuthology.orchestra.run.smithi033.stdout:Description : 2024-05-08T10:46:10.947 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:46:10.947 INFO:teuthology.orchestra.run.smithi033.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-08T10:46:10.947 INFO:teuthology.orchestra.run.smithi033.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-08T10:46:10.947 INFO:teuthology.orchestra.run.smithi033.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-08T10:46:10.947 INFO:teuthology.orchestra.run.smithi033.stdout:hardware devices. 2024-05-08T10:46:10.948 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:46:10.948 INFO:teuthology.orchestra.run.smithi033.stdout:This subpackage provides tools for support of all platforms. 2024-05-08T10:46:10.948 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-08T10:46:10.948 INFO:teuthology.task.kernel:Updating grub on smithi033 to boot 5.14.0-444.el9.x86_64 2024-05-08T10:46:10.948 DEBUG:teuthology.orchestra.run.smithi033:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-08T10:46:11.520 INFO:teuthology.orchestra.run.smithi033.stderr:Generating grub configuration file ... 2024-05-08T10:46:12.875 INFO:teuthology.orchestra.run.smithi033.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-05-08T10:46:12.901 INFO:teuthology.orchestra.run.smithi033.stderr:done 2024-05-08T10:46:12.903 DEBUG:teuthology.orchestra.run.smithi033:> mktemp 2024-05-08T10:46:12.919 INFO:teuthology.orchestra.run.smithi033.stdout:/tmp/tmp.ntH7bJBNa2 2024-05-08T10:46:12.919 DEBUG:teuthology.orchestra.run.smithi033:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.ntH7bJBNa2 2024-05-08T10:46:12.993 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod 0666 /tmp/tmp.ntH7bJBNa2 2024-05-08T10:46:13.137 DEBUG:teuthology.orchestra.remote:smithi033:/tmp/tmp.ntH7bJBNa2 is 6KB 2024-05-08T10:46:13.186 DEBUG:teuthology.orchestra.run.smithi033:> rm -fr /tmp/tmp.ntH7bJBNa2 2024-05-08T10:46:13.200 DEBUG:teuthology.orchestra.run.smithi033:> sudo /bin/ls /boot/loader/entries || true 2024-05-08T10:46:13.263 INFO:teuthology.orchestra.run.smithi033.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-05-08T10:46:13.263 INFO:teuthology.orchestra.run.smithi033.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-05-08T10:46:13.263 INFO:teuthology.orchestra.run.smithi033.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-05-08T10:46:13.263 INFO:teuthology.orchestra.run.smithi033.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-444.el9.x86_64.conf 2024-05-08T10:46:13.265 DEBUG:teuthology.orchestra.run.smithi033:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-5.14.0-444.el9.x86_64 2024-05-08T10:46:13.404 DEBUG:teuthology.orchestra.run.smithi033:> sudo shutdown -r now 2024-05-08T10:46:23.231 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-05-08T10:46:23.232 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi174.front.sepia.ceph.com' 2024-05-08T10:46:23.233 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T10:46:41.699 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.174 2024-05-08T10:46:43.408 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-05-08T10:46:43.409 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi033.front.sepia.ceph.com' 2024-05-08T10:46:43.410 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T10:46:50.706 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi174.front.sepia.ceph.com' 2024-05-08T10:46:50.707 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T10:46:53.758 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.174 2024-05-08T10:47:01.918 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.33 2024-05-08T10:47:05.762 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi174.front.sepia.ceph.com' 2024-05-08T10:47:05.763 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T10:47:10.922 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi033.front.sepia.ceph.com' 2024-05-08T10:47:10.923 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T10:47:29.311 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.33 2024-05-08T10:47:37.680 DEBUG:teuthology.orchestra.run.smithi174:> true 2024-05-08T10:47:38.181 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi174.front.sepia.ceph.com' 2024-05-08T10:47:38.181 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "5.14.0-444.el9.x86_64"... 2024-05-08T10:47:38.182 DEBUG:teuthology.orchestra.run.smithi174:> uname -r 2024-05-08T10:47:38.196 INFO:teuthology.orchestra.run.smithi174.stdout:5.14.0-444.el9.x86_64 2024-05-08T10:47:38.197 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-444.el9.x86_64 vs 5.14.0-444.el9.x86_64 2024-05-08T10:47:38.197 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-08T10:47:38.197 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-08T10:47:39.198 DEBUG:teuthology.parallel:result is None 2024-05-08T10:47:41.312 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi033.front.sepia.ceph.com' 2024-05-08T10:47:41.313 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T10:47:41.526 DEBUG:teuthology.orchestra.run.smithi033:> true 2024-05-08T10:47:41.931 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi033.front.sepia.ceph.com' 2024-05-08T10:47:41.932 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-444.el9.x86_64"... 2024-05-08T10:47:41.932 DEBUG:teuthology.orchestra.run.smithi033:> uname -r 2024-05-08T10:47:41.950 INFO:teuthology.orchestra.run.smithi033.stdout:5.14.0-444.el9.x86_64 2024-05-08T10:47:41.950 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-444.el9.x86_64 vs 5.14.0-444.el9.x86_64 2024-05-08T10:47:41.950 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-08T10:47:41.950 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-08T10:47:42.951 DEBUG:teuthology.parallel:result is None 2024-05-08T10:47:42.952 INFO:teuthology.run_tasks:Running task internal.base... 2024-05-08T10:47:42.962 INFO:teuthology.task.internal:Creating test directory... 2024-05-08T10:47:42.962 DEBUG:teuthology.orchestra.run.smithi033:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-08T10:47:42.966 DEBUG:teuthology.orchestra.run.smithi174:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-08T10:47:42.985 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-05-08T10:47:43.080 INFO:teuthology.run_tasks:Running task internal.archive... 2024-05-08T10:47:43.237 INFO:teuthology.task.internal:Creating archive directory... 2024-05-08T10:47:43.237 DEBUG:teuthology.orchestra.run.smithi033:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-08T10:47:43.239 DEBUG:teuthology.orchestra.run.smithi174:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-08T10:47:43.283 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-05-08T10:47:43.290 INFO:teuthology.task.internal:Enabling coredump saving... 2024-05-08T10:47:43.290 DEBUG:teuthology.orchestra.run.smithi033:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-08T10:47:43.320 DEBUG:teuthology.orchestra.run.smithi174:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-08T10:47:43.392 INFO:teuthology.orchestra.run.smithi174.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T10:47:43.433 INFO:teuthology.orchestra.run.smithi033.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T10:47:43.443 INFO:teuthology.orchestra.run.smithi174.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T10:47:43.463 INFO:teuthology.orchestra.run.smithi033.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T10:47:43.465 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-05-08T10:47:43.473 INFO:teuthology.task.internal:Configuring sudo... 2024-05-08T10:47:43.473 DEBUG:teuthology.orchestra.run.smithi033:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-08T10:47:43.475 DEBUG:teuthology.orchestra.run.smithi174:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-08T10:47:43.504 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-05-08T10:47:43.515 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-05-08T10:47:43.515 DEBUG:teuthology.orchestra.run.smithi033:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-08T10:47:43.541 DEBUG:teuthology.orchestra.run.smithi174:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-08T10:47:43.562 DEBUG:teuthology.orchestra.run.smithi033:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-08T10:47:43.636 DEBUG:teuthology.orchestra.run.smithi033:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-08T10:47:43.680 DEBUG:teuthology.orchestra.run.smithi033:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-08T10:47:43.761 DEBUG:teuthology.orchestra.run.smithi033:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-08T10:47:43.805 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-05-08T10:47:43.805 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-08T10:47:43.872 DEBUG:teuthology.orchestra.run.smithi174:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-08T10:47:43.914 DEBUG:teuthology.orchestra.run.smithi174:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-08T10:47:43.966 DEBUG:teuthology.orchestra.run.smithi174:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-08T10:47:44.050 DEBUG:teuthology.orchestra.run.smithi174:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-08T10:47:44.093 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-05-08T10:47:44.094 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-08T10:47:44.161 DEBUG:teuthology.orchestra.run.smithi033:> sudo service rsyslog restart 2024-05-08T10:47:44.163 DEBUG:teuthology.orchestra.run.smithi174:> sudo service rsyslog restart 2024-05-08T10:47:44.209 INFO:teuthology.orchestra.run.smithi033.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-08T10:47:44.245 INFO:teuthology.orchestra.run.smithi174.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-08T10:47:44.647 INFO:teuthology.run_tasks:Running task internal.timer... 2024-05-08T10:47:44.656 INFO:teuthology.task.internal:Starting timer... 2024-05-08T10:47:44.656 INFO:teuthology.run_tasks:Running task pcp... 2024-05-08T10:47:44.677 INFO:teuthology.run_tasks:Running task selinux... 2024-05-08T10:47:44.687 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-05-08T10:47:44.688 DEBUG:teuthology.orchestra.run.smithi033:> sudo service auditd rotate 2024-05-08T10:47:44.744 INFO:teuthology.orchestra.run.smithi033.stdout:Rotating logs: 2024-05-08T10:47:44.746 DEBUG:teuthology.orchestra.run.smithi174:> sudo service auditd rotate 2024-05-08T10:47:44.806 INFO:teuthology.orchestra.run.smithi174.stdout:Rotating logs: 2024-05-08T10:47:44.808 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-05-08T10:47:44.808 DEBUG:teuthology.orchestra.run.smithi033:> /usr/sbin/getenforce 2024-05-08T10:47:44.832 INFO:teuthology.orchestra.run.smithi033.stdout:Permissive 2024-05-08T10:47:44.832 DEBUG:teuthology.orchestra.run.smithi174:> /usr/sbin/getenforce 2024-05-08T10:47:44.853 INFO:teuthology.orchestra.run.smithi174.stdout:Permissive 2024-05-08T10:47:44.853 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi033.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi174.front.sepia.ceph.com': 'permissive'} 2024-05-08T10:47:44.853 DEBUG:teuthology.orchestra.run.smithi033:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-08T10:47:44.900 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T10:47:44.900 DEBUG:teuthology.orchestra.run.smithi174:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-08T10:47:44.927 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T10:47:44.928 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-05-08T10:47:44.928 DEBUG:teuthology.orchestra.run.smithi033:> sudo /usr/sbin/setenforce permissive 2024-05-08T10:47:44.993 DEBUG:teuthology.orchestra.run.smithi174:> sudo /usr/sbin/setenforce permissive 2024-05-08T10:47:45.021 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-05-08T10:47:45.031 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-05-08T10:47:45.037 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-05-08T10:47:45.166 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-05-08T10:47:45.183 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-05-08T10:47:45.185 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi033.front.sepia.ceph.com,smithi174.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-05-08T10:51:54.046 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi033.front.sepia.ceph.com'), Remote(name='ubuntu@smithi174.front.sepia.ceph.com')] 2024-05-08T10:51:54.047 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi033.front.sepia.ceph.com' 2024-05-08T10:51:54.049 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T10:51:54.129 DEBUG:teuthology.orchestra.run.smithi033:> true 2024-05-08T10:51:54.210 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi033.front.sepia.ceph.com' 2024-05-08T10:51:54.211 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi174.front.sepia.ceph.com' 2024-05-08T10:51:54.211 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T10:51:54.290 DEBUG:teuthology.orchestra.run.smithi174:> true 2024-05-08T10:51:54.376 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi174.front.sepia.ceph.com' 2024-05-08T10:51:54.376 INFO:teuthology.run_tasks:Running task clock... 2024-05-08T10:51:54.387 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-05-08T10:51:54.388 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-08T10:51:54.388 DEBUG:teuthology.orchestra.run.smithi033:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-08T10:51:54.391 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-08T10:51:54.391 DEBUG:teuthology.orchestra.run.smithi174:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-08T10:51:54.420 INFO:teuthology.orchestra.run.smithi033.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-08T10:51:54.436 INFO:teuthology.orchestra.run.smithi033.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-08T10:51:54.450 INFO:teuthology.orchestra.run.smithi174.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-08T10:51:54.461 INFO:teuthology.orchestra.run.smithi033.stderr:sudo: ntpd: command not found 2024-05-08T10:51:54.466 INFO:teuthology.orchestra.run.smithi174.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-08T10:51:54.473 INFO:teuthology.orchestra.run.smithi033.stdout:506 Cannot talk to daemon 2024-05-08T10:51:54.487 INFO:teuthology.orchestra.run.smithi033.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-08T10:51:54.491 INFO:teuthology.orchestra.run.smithi174.stderr:sudo: ntpd: command not found 2024-05-08T10:51:54.502 INFO:teuthology.orchestra.run.smithi033.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-08T10:51:54.503 INFO:teuthology.orchestra.run.smithi174.stdout:506 Cannot talk to daemon 2024-05-08T10:51:54.518 INFO:teuthology.orchestra.run.smithi174.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-08T10:51:54.532 INFO:teuthology.orchestra.run.smithi174.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-08T10:51:54.562 INFO:teuthology.orchestra.run.smithi033.stderr:bash: line 1: ntpq: command not found 2024-05-08T10:51:54.567 INFO:teuthology.orchestra.run.smithi033.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-08T10:51:54.567 INFO:teuthology.orchestra.run.smithi033.stdout:=============================================================================== 2024-05-08T10:51:54.567 INFO:teuthology.orchestra.run.smithi033.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T10:51:54.567 INFO:teuthology.orchestra.run.smithi033.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T10:51:54.567 INFO:teuthology.orchestra.run.smithi033.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T10:51:54.567 INFO:teuthology.orchestra.run.smithi033.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T10:51:54.587 INFO:teuthology.orchestra.run.smithi174.stderr:bash: line 1: ntpq: command not found 2024-05-08T10:51:54.592 INFO:teuthology.orchestra.run.smithi174.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-08T10:51:54.592 INFO:teuthology.orchestra.run.smithi174.stdout:=============================================================================== 2024-05-08T10:51:54.592 INFO:teuthology.orchestra.run.smithi174.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T10:51:54.593 INFO:teuthology.orchestra.run.smithi174.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T10:51:54.593 INFO:teuthology.orchestra.run.smithi174.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T10:51:54.593 INFO:teuthology.orchestra.run.smithi174.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T10:51:54.593 INFO:teuthology.run_tasks:Running task install... 2024-05-08T10:51:54.606 DEBUG:teuthology.task.install:project ceph 2024-05-08T10:51:54.606 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '1fb5d10608dccee73edd6ef8a2c7b804a097c324'}} 2024-05-08T10:51:54.606 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '1fb5d10608dccee73edd6ef8a2c7b804a097c324'} 2024-05-08T10:51:54.607 INFO:teuthology.task.install:Using flavor: default 2024-05-08T10:51:54.619 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-05-08T10:51:54.619 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-05-08T10:51:54.620 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1fb5d10608dccee73edd6ef8a2c7b804a097c324', 'tag': None, 'wait_for_package': False} 2024-05-08T10:51:54.621 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1fb5d10608dccee73edd6ef8a2c7b804a097c324 2024-05-08T10:51:54.624 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1fb5d10608dccee73edd6ef8a2c7b804a097c324', 'tag': None, 'wait_for_package': False} 2024-05-08T10:51:54.625 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1fb5d10608dccee73edd6ef8a2c7b804a097c324 2024-05-08T10:51:54.772 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/main/1fb5d10608dccee73edd6ef8a2c7b804a097c324/centos/9/flavors/default/ 2024-05-08T10:51:54.773 INFO:teuthology.task.install.rpm:Package version is 19.0.0-1670.g1fb5d106 2024-05-08T10:51:54.847 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/main/1fb5d10608dccee73edd6ef8a2c7b804a097c324/centos/9/flavors/default/ 2024-05-08T10:51:54.848 INFO:teuthology.task.install.rpm:Package version is 19.0.0-1670.g1fb5d106 2024-05-08T10:51:54.953 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/main/1fb5d10608dccee73edd6ef8a2c7b804a097c324/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/main/1fb5d10608dccee73edd6ef8a2c7b804a097c324/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/main/1fb5d10608dccee73edd6ef8a2c7b804a097c324/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-08T10:51:54.953 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-05-08T10:51:54.953 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-08T10:51:54.980 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-08T10:51:54.980 DEBUG:teuthology.orchestra.run.smithi174:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1fb5d10608dccee73edd6ef8a2c7b804a097c324/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-08T10:51:55.025 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/main/1fb5d10608dccee73edd6ef8a2c7b804a097c324/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/main/1fb5d10608dccee73edd6ef8a2c7b804a097c324/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/main/1fb5d10608dccee73edd6ef8a2c7b804a097c324/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-08T10:51:55.025 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-05-08T10:51:55.025 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-08T10:51:55.047 DEBUG:teuthology.orchestra.run.smithi174:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-08T10:51:55.054 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-08T10:51:55.054 DEBUG:teuthology.orchestra.run.smithi033:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1fb5d10608dccee73edd6ef8a2c7b804a097c324/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-08T10:51:55.123 DEBUG:teuthology.orchestra.run.smithi174:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-08T10:51:55.124 DEBUG:teuthology.orchestra.run.smithi033:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-08T10:51:55.186 INFO:teuthology.orchestra.run.smithi174.stdout:check_obsoletes = 1 2024-05-08T10:51:55.188 DEBUG:teuthology.orchestra.run.smithi174:> sudo yum clean all 2024-05-08T10:51:55.202 DEBUG:teuthology.orchestra.run.smithi033:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-08T10:51:55.268 INFO:teuthology.orchestra.run.smithi033.stdout:check_obsoletes = 1 2024-05-08T10:51:55.270 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum clean all 2024-05-08T10:51:55.434 INFO:teuthology.orchestra.run.smithi174.stdout:54 files removed 2024-05-08T10:51:55.462 DEBUG:teuthology.orchestra.run.smithi174:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-08T10:51:55.511 INFO:teuthology.orchestra.run.smithi033.stdout:54 files removed 2024-05-08T10:51:55.538 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-08T10:51:56.074 INFO:teuthology.orchestra.run.smithi174.stdout:ceph packages for x86_64 242 kB/s | 82 kB 00:00 2024-05-08T10:51:56.393 INFO:teuthology.orchestra.run.smithi033.stdout:ceph packages for x86_64 145 kB/s | 82 kB 00:00 2024-05-08T10:51:56.615 INFO:teuthology.orchestra.run.smithi174.stdout:ceph noarch packages 20 kB/s | 10 kB 00:00 2024-05-08T10:51:56.927 INFO:teuthology.orchestra.run.smithi033.stdout:ceph noarch packages 21 kB/s | 10 kB 00:00 2024-05-08T10:51:57.441 INFO:teuthology.orchestra.run.smithi174.stdout:ceph source packages 2.4 kB/s | 1.9 kB 00:00 2024-05-08T10:51:57.635 INFO:teuthology.orchestra.run.smithi033.stdout:ceph source packages 2.9 kB/s | 1.9 kB 00:00 2024-05-08T10:51:57.899 INFO:teuthology.orchestra.run.smithi174.stdout:CentOS Stream 9 - BaseOS 19 MB/s | 8.1 MB 00:00 2024-05-08T10:51:59.527 INFO:teuthology.orchestra.run.smithi033.stdout:CentOS Stream 9 - BaseOS 4.4 MB/s | 8.1 MB 00:01 2024-05-08T10:52:01.093 INFO:teuthology.orchestra.run.smithi174.stdout:CentOS Stream 9 - AppStream 9.0 MB/s | 19 MB 00:02 2024-05-08T10:52:01.370 INFO:teuthology.orchestra.run.smithi033.stdout:CentOS Stream 9 - AppStream 28 MB/s | 19 MB 00:00 2024-05-08T10:52:05.621 INFO:teuthology.orchestra.run.smithi033.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.2 MB 00:00 2024-05-08T10:52:06.868 INFO:teuthology.orchestra.run.smithi174.stdout:CentOS Stream 9 - CRB 2.8 MB/s | 6.2 MB 00:02 2024-05-08T10:52:07.022 INFO:teuthology.orchestra.run.smithi033.stdout:CentOS Stream 9 - Extras packages 89 kB/s | 16 kB 00:00 2024-05-08T10:52:08.324 INFO:teuthology.orchestra.run.smithi033.stdout:Extra Packages for Enterprise Linux 18 MB/s | 21 MB 00:01 2024-05-08T10:52:08.419 INFO:teuthology.orchestra.run.smithi174.stdout:CentOS Stream 9 - Extras packages 82 kB/s | 16 kB 00:00 2024-05-08T10:52:10.254 INFO:teuthology.orchestra.run.smithi174.stdout:Extra Packages for Enterprise Linux 12 MB/s | 21 MB 00:01 2024-05-08T10:52:13.665 INFO:teuthology.orchestra.run.smithi033.stdout:lab-extras 36 kB/s | 1.7 kB 00:00 2024-05-08T10:52:15.387 INFO:teuthology.orchestra.run.smithi174.stdout:lab-extras 37 kB/s | 1.7 kB 00:00 2024-05-08T10:52:16.076 INFO:teuthology.orchestra.run.smithi033.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-08T10:52:16.077 INFO:teuthology.orchestra.run.smithi033.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-08T10:52:16.088 INFO:teuthology.orchestra.run.smithi033.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-05-08T10:52:16.089 INFO:teuthology.orchestra.run.smithi033.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-05-08T10:52:16.090 INFO:teuthology.orchestra.run.smithi033.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-05-08T10:52:16.091 INFO:teuthology.orchestra.run.smithi033.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-05-08T10:52:16.092 INFO:teuthology.orchestra.run.smithi033.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-05-08T10:52:16.095 INFO:teuthology.orchestra.run.smithi033.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-05-08T10:52:16.096 INFO:teuthology.orchestra.run.smithi033.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-05-08T10:52:16.163 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. 2024-05-08T10:52:16.181 INFO:teuthology.orchestra.run.smithi033.stdout:======================================================================================= 2024-05-08T10:52:16.181 INFO:teuthology.orchestra.run.smithi033.stdout: Package Arch Version Repository Size 2024-05-08T10:52:16.181 INFO:teuthology.orchestra.run.smithi033.stdout:======================================================================================= 2024-05-08T10:52:16.181 INFO:teuthology.orchestra.run.smithi033.stdout:Installing: 2024-05-08T10:52:16.181 INFO:teuthology.orchestra.run.smithi033.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-05-08T10:52:16.182 INFO:teuthology.orchestra.run.smithi033.stdout: ceph x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 6.6 k 2024-05-08T10:52:16.182 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-base x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 5.3 M 2024-05-08T10:52:16.182 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-fuse x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 887 k 2024-05-08T10:52:16.182 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 145 k 2024-05-08T10:52:16.182 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 1.5 M 2024-05-08T10:52:16.182 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-cephadm noarch 2:19.0.0-1670.g1fb5d106.el9 ceph-noarch 138 k 2024-05-08T10:52:16.182 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-dashboard noarch 2:19.0.0-1670.g1fb5d106.el9 ceph-noarch 1.8 M 2024-05-08T10:52:16.182 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-1670.g1fb5d106.el9 ceph-noarch 7.4 M 2024-05-08T10:52:16.182 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-rook noarch 2:19.0.0-1670.g1fb5d106.el9 ceph-noarch 49 k 2024-05-08T10:52:16.183 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-radosgw x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 9.8 M 2024-05-08T10:52:16.183 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-test x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 47 M 2024-05-08T10:52:16.183 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-volume noarch 2:19.0.0-1670.g1fb5d106.el9 ceph-noarch 264 k 2024-05-08T10:52:16.183 INFO:teuthology.orchestra.run.smithi033.stdout: cephadm noarch 2:19.0.0-1670.g1fb5d106.el9 ceph-noarch 748 k 2024-05-08T10:52:16.183 INFO:teuthology.orchestra.run.smithi033.stdout: cephfs-mirror x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 220 k 2024-05-08T10:52:16.183 INFO:teuthology.orchestra.run.smithi033.stdout: cephfs-shell x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 27 k 2024-05-08T10:52:16.183 INFO:teuthology.orchestra.run.smithi033.stdout: cephfs-top noarch 2:19.0.0-1670.g1fb5d106.el9 ceph-noarch 18 k 2024-05-08T10:52:16.183 INFO:teuthology.orchestra.run.smithi033.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-05-08T10:52:16.183 INFO:teuthology.orchestra.run.smithi033.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-05-08T10:52:16.183 INFO:teuthology.orchestra.run.smithi033.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-05-08T10:52:16.183 INFO:teuthology.orchestra.run.smithi033.stdout: libcephfs-devel x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 31 k 2024-05-08T10:52:16.183 INFO:teuthology.orchestra.run.smithi033.stdout: libcephfs2 x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 743 k 2024-05-08T10:52:16.183 INFO:teuthology.orchestra.run.smithi033.stdout: librados-devel x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 126 k 2024-05-08T10:52:16.184 INFO:teuthology.orchestra.run.smithi033.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-05-08T10:52:16.184 INFO:teuthology.orchestra.run.smithi033.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-05-08T10:52:16.184 INFO:teuthology.orchestra.run.smithi033.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-05-08T10:52:16.184 INFO:teuthology.orchestra.run.smithi033.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-05-08T10:52:16.184 INFO:teuthology.orchestra.run.smithi033.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-05-08T10:52:16.184 INFO:teuthology.orchestra.run.smithi033.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-05-08T10:52:16.184 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cephfs x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 162 k 2024-05-08T10:52:16.184 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rados x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 321 k 2024-05-08T10:52:16.184 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rbd x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 299 k 2024-05-08T10:52:16.184 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rgw x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 99 k 2024-05-08T10:52:16.184 INFO:teuthology.orchestra.run.smithi033.stdout: rbd-fuse x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 85 k 2024-05-08T10:52:16.184 INFO:teuthology.orchestra.run.smithi033.stdout: rbd-mirror x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 3.1 M 2024-05-08T10:52:16.184 INFO:teuthology.orchestra.run.smithi033.stdout: rbd-nbd x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 171 k 2024-05-08T10:52:16.185 INFO:teuthology.orchestra.run.smithi033.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-05-08T10:52:16.185 INFO:teuthology.orchestra.run.smithi033.stdout:Upgrading: 2024-05-08T10:52:16.185 INFO:teuthology.orchestra.run.smithi033.stdout: NetworkManager x86_64 1:1.47.5-1.el9 baseos 2.3 M 2024-05-08T10:52:16.185 INFO:teuthology.orchestra.run.smithi033.stdout: NetworkManager-libnm x86_64 1:1.47.5-1.el9 baseos 1.8 M 2024-05-08T10:52:16.185 INFO:teuthology.orchestra.run.smithi033.stdout: NetworkManager-team x86_64 1:1.47.5-1.el9 baseos 42 k 2024-05-08T10:52:16.185 INFO:teuthology.orchestra.run.smithi033.stdout: NetworkManager-tui x86_64 1:1.47.5-1.el9 baseos 248 k 2024-05-08T10:52:16.185 INFO:teuthology.orchestra.run.smithi033.stdout: librados2 x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 3.4 M 2024-05-08T10:52:16.185 INFO:teuthology.orchestra.run.smithi033.stdout: librbd1 x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 3.1 M 2024-05-08T10:52:16.185 INFO:teuthology.orchestra.run.smithi033.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-05-08T10:52:16.185 INFO:teuthology.orchestra.run.smithi033.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-05-08T10:52:16.185 INFO:teuthology.orchestra.run.smithi033.stdout:Installing dependencies: 2024-05-08T10:52:16.185 INFO:teuthology.orchestra.run.smithi033.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-08T10:52:16.185 INFO:teuthology.orchestra.run.smithi033.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-05-08T10:52:16.185 INFO:teuthology.orchestra.run.smithi033.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-08T10:52:16.186 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-common x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 20 M 2024-05-08T10:52:16.186 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-grafana-dashboards noarch 2:19.0.0-1670.g1fb5d106.el9 ceph-noarch 31 k 2024-05-08T10:52:16.186 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mds x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 2.1 M 2024-05-08T10:52:16.186 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-modules-core noarch 2:19.0.0-1670.g1fb5d106.el9 ceph-noarch 248 k 2024-05-08T10:52:16.186 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mon x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 4.7 M 2024-05-08T10:52:16.186 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-osd x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 17 M 2024-05-08T10:52:16.186 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-prometheus-alerts noarch 2:19.0.0-1670.g1fb5d106.el9 ceph-noarch 15 k 2024-05-08T10:52:16.186 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-selinux x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 25 k 2024-05-08T10:52:16.186 INFO:teuthology.orchestra.run.smithi033.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-08T10:52:16.186 INFO:teuthology.orchestra.run.smithi033.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-08T10:52:16.186 INFO:teuthology.orchestra.run.smithi033.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-08T10:52:16.186 INFO:teuthology.orchestra.run.smithi033.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-08T10:52:16.187 INFO:teuthology.orchestra.run.smithi033.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-08T10:52:16.187 INFO:teuthology.orchestra.run.smithi033.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-08T10:52:16.187 INFO:teuthology.orchestra.run.smithi033.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-08T10:52:16.187 INFO:teuthology.orchestra.run.smithi033.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-08T10:52:16.187 INFO:teuthology.orchestra.run.smithi033.stdout: libcephsqlite x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 163 k 2024-05-08T10:52:16.187 INFO:teuthology.orchestra.run.smithi033.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-08T10:52:16.187 INFO:teuthology.orchestra.run.smithi033.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-08T10:52:16.187 INFO:teuthology.orchestra.run.smithi033.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-08T10:52:16.187 INFO:teuthology.orchestra.run.smithi033.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-08T10:52:16.187 INFO:teuthology.orchestra.run.smithi033.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-08T10:52:16.188 INFO:teuthology.orchestra.run.smithi033.stdout: libradosstriper1 x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 501 k 2024-05-08T10:52:16.188 INFO:teuthology.orchestra.run.smithi033.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-08T10:52:16.188 INFO:teuthology.orchestra.run.smithi033.stdout: librgw2 x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 5.1 M 2024-05-08T10:52:16.188 INFO:teuthology.orchestra.run.smithi033.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-08T10:52:16.188 INFO:teuthology.orchestra.run.smithi033.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-05-08T10:52:16.188 INFO:teuthology.orchestra.run.smithi033.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-08T10:52:16.188 INFO:teuthology.orchestra.run.smithi033.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-08T10:52:16.188 INFO:teuthology.orchestra.run.smithi033.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-08T10:52:16.188 INFO:teuthology.orchestra.run.smithi033.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-05-08T10:52:16.188 INFO:teuthology.orchestra.run.smithi033.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-08T10:52:16.188 INFO:teuthology.orchestra.run.smithi033.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-08T10:52:16.188 INFO:teuthology.orchestra.run.smithi033.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-08T10:52:16.188 INFO:teuthology.orchestra.run.smithi033.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-05-08T10:52:16.188 INFO:teuthology.orchestra.run.smithi033.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-08T10:52:16.189 INFO:teuthology.orchestra.run.smithi033.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-08T10:52:16.189 INFO:teuthology.orchestra.run.smithi033.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-08T10:52:16.189 INFO:teuthology.orchestra.run.smithi033.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-05-08T10:52:16.189 INFO:teuthology.orchestra.run.smithi033.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-08T10:52:16.189 INFO:teuthology.orchestra.run.smithi033.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-08T10:52:16.189 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-08T10:52:16.189 INFO:teuthology.orchestra.run.smithi033.stdout: python3-ceph-argparse x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 45 k 2024-05-08T10:52:16.189 INFO:teuthology.orchestra.run.smithi033.stdout: python3-ceph-common x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 131 k 2024-05-08T10:52:16.189 INFO:teuthology.orchestra.run.smithi033.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-08T10:52:16.189 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-08T10:52:16.189 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-08T10:52:16.189 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-08T10:52:16.189 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-05-08T10:52:16.189 INFO:teuthology.orchestra.run.smithi033.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-05-08T10:52:16.190 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-08T10:52:16.190 INFO:teuthology.orchestra.run.smithi033.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-08T10:52:16.190 INFO:teuthology.orchestra.run.smithi033.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-08T10:52:16.190 INFO:teuthology.orchestra.run.smithi033.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-08T10:52:16.190 INFO:teuthology.orchestra.run.smithi033.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-08T10:52:16.190 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-08T10:52:16.190 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-08T10:52:16.190 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-08T10:52:16.190 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-08T10:52:16.191 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-08T10:52:16.191 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-08T10:52:16.191 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-08T10:52:16.191 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-08T10:52:16.191 INFO:teuthology.orchestra.run.smithi033.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-08T10:52:16.191 INFO:teuthology.orchestra.run.smithi033.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-08T10:52:16.191 INFO:teuthology.orchestra.run.smithi033.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-08T10:52:16.191 INFO:teuthology.orchestra.run.smithi033.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-08T10:52:16.191 INFO:teuthology.orchestra.run.smithi033.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-08T10:52:16.191 INFO:teuthology.orchestra.run.smithi033.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-08T10:52:16.191 INFO:teuthology.orchestra.run.smithi033.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-08T10:52:16.191 INFO:teuthology.orchestra.run.smithi033.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-08T10:52:16.191 INFO:teuthology.orchestra.run.smithi033.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-08T10:52:16.191 INFO:teuthology.orchestra.run.smithi033.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-08T10:52:16.192 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-08T10:52:16.192 INFO:teuthology.orchestra.run.smithi033.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-08T10:52:16.192 INFO:teuthology.orchestra.run.smithi033.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-08T10:52:16.192 INFO:teuthology.orchestra.run.smithi033.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-08T10:52:16.192 INFO:teuthology.orchestra.run.smithi033.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-08T10:52:16.192 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-08T10:52:16.192 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-08T10:52:16.192 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-08T10:52:16.192 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-08T10:52:16.192 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-05-08T10:52:16.192 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-08T10:52:16.193 INFO:teuthology.orchestra.run.smithi033.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-08T10:52:16.193 INFO:teuthology.orchestra.run.smithi033.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-08T10:52:16.193 INFO:teuthology.orchestra.run.smithi033.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-08T10:52:16.193 INFO:teuthology.orchestra.run.smithi033.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-08T10:52:16.193 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-08T10:52:16.193 INFO:teuthology.orchestra.run.smithi033.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-08T10:52:16.193 INFO:teuthology.orchestra.run.smithi033.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-08T10:52:16.193 INFO:teuthology.orchestra.run.smithi033.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-08T10:52:16.193 INFO:teuthology.orchestra.run.smithi033.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-08T10:52:16.193 INFO:teuthology.orchestra.run.smithi033.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-08T10:52:16.193 INFO:teuthology.orchestra.run.smithi033.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-05-08T10:52:16.193 INFO:teuthology.orchestra.run.smithi033.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-08T10:52:16.193 INFO:teuthology.orchestra.run.smithi033.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-08T10:52:16.193 INFO:teuthology.orchestra.run.smithi033.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-08T10:52:16.194 INFO:teuthology.orchestra.run.smithi033.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-08T10:52:16.194 INFO:teuthology.orchestra.run.smithi033.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-08T10:52:16.194 INFO:teuthology.orchestra.run.smithi033.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-08T10:52:16.194 INFO:teuthology.orchestra.run.smithi033.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-08T10:52:16.195 INFO:teuthology.orchestra.run.smithi033.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-08T10:52:16.195 INFO:teuthology.orchestra.run.smithi033.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-08T10:52:16.195 INFO:teuthology.orchestra.run.smithi033.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-05-08T10:52:16.195 INFO:teuthology.orchestra.run.smithi033.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-08T10:52:16.195 INFO:teuthology.orchestra.run.smithi033.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-05-08T10:52:16.195 INFO:teuthology.orchestra.run.smithi033.stdout:Installing weak dependencies: 2024-05-08T10:52:16.195 INFO:teuthology.orchestra.run.smithi033.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-08T10:52:16.195 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:52:16.195 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction Summary 2024-05-08T10:52:16.195 INFO:teuthology.orchestra.run.smithi033.stdout:======================================================================================= 2024-05-08T10:52:16.195 INFO:teuthology.orchestra.run.smithi033.stdout:Install 148 Packages 2024-05-08T10:52:16.195 INFO:teuthology.orchestra.run.smithi033.stdout:Upgrade 8 Packages 2024-05-08T10:52:16.195 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:52:16.196 INFO:teuthology.orchestra.run.smithi033.stdout:Total download size: 220 M 2024-05-08T10:52:16.196 INFO:teuthology.orchestra.run.smithi033.stdout:Downloading Packages: 2024-05-08T10:52:16.941 INFO:teuthology.orchestra.run.smithi033.stdout:(1/156): ceph-19.0.0-1670.g1fb5d106.el9.x86_64. 32 kB/s | 6.6 kB 00:00 2024-05-08T10:52:17.333 INFO:teuthology.orchestra.run.smithi033.stdout:(2/156): ceph-fuse-19.0.0-1670.g1fb5d106.el9.x8 2.2 MB/s | 887 kB 00:00 2024-05-08T10:52:17.484 INFO:teuthology.orchestra.run.smithi033.stdout:(3/156): ceph-immutable-object-cache-19.0.0-167 969 kB/s | 145 kB 00:00 2024-05-08T10:52:17.705 INFO:teuthology.orchestra.run.smithi174.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-08T10:52:17.705 INFO:teuthology.orchestra.run.smithi174.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-08T10:52:17.716 INFO:teuthology.orchestra.run.smithi174.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-05-08T10:52:17.717 INFO:teuthology.orchestra.run.smithi174.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-05-08T10:52:17.717 INFO:teuthology.orchestra.run.smithi174.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-05-08T10:52:17.718 INFO:teuthology.orchestra.run.smithi174.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-05-08T10:52:17.720 INFO:teuthology.orchestra.run.smithi174.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-05-08T10:52:17.722 INFO:teuthology.orchestra.run.smithi174.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-05-08T10:52:17.723 INFO:teuthology.orchestra.run.smithi174.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-05-08T10:52:17.734 INFO:teuthology.orchestra.run.smithi033.stdout:(4/156): ceph-base-19.0.0-1670.g1fb5d106.el9.x8 5.4 MB/s | 5.3 MB 00:00 2024-05-08T10:52:17.784 INFO:teuthology.orchestra.run.smithi174.stdout:Dependencies resolved. 2024-05-08T10:52:17.784 INFO:teuthology.orchestra.run.smithi033.stdout:(5/156): ceph-mds-19.0.0-1670.g1fb5d106.el9.x86 7.1 MB/s | 2.1 MB 00:00 2024-05-08T10:52:17.794 INFO:teuthology.orchestra.run.smithi174.stdout:======================================================================================= 2024-05-08T10:52:17.795 INFO:teuthology.orchestra.run.smithi174.stdout: Package Arch Version Repository Size 2024-05-08T10:52:17.795 INFO:teuthology.orchestra.run.smithi174.stdout:======================================================================================= 2024-05-08T10:52:17.795 INFO:teuthology.orchestra.run.smithi174.stdout:Installing: 2024-05-08T10:52:17.795 INFO:teuthology.orchestra.run.smithi174.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-05-08T10:52:17.795 INFO:teuthology.orchestra.run.smithi174.stdout: ceph x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 6.6 k 2024-05-08T10:52:17.795 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-base x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 5.3 M 2024-05-08T10:52:17.795 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-fuse x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 887 k 2024-05-08T10:52:17.795 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 145 k 2024-05-08T10:52:17.795 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 1.5 M 2024-05-08T10:52:17.795 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-cephadm noarch 2:19.0.0-1670.g1fb5d106.el9 ceph-noarch 138 k 2024-05-08T10:52:17.797 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-dashboard noarch 2:19.0.0-1670.g1fb5d106.el9 ceph-noarch 1.8 M 2024-05-08T10:52:17.797 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-1670.g1fb5d106.el9 ceph-noarch 7.4 M 2024-05-08T10:52:17.797 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-rook noarch 2:19.0.0-1670.g1fb5d106.el9 ceph-noarch 49 k 2024-05-08T10:52:17.797 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-radosgw x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 9.8 M 2024-05-08T10:52:17.797 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-test x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 47 M 2024-05-08T10:52:17.798 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-volume noarch 2:19.0.0-1670.g1fb5d106.el9 ceph-noarch 264 k 2024-05-08T10:52:17.798 INFO:teuthology.orchestra.run.smithi174.stdout: cephadm noarch 2:19.0.0-1670.g1fb5d106.el9 ceph-noarch 748 k 2024-05-08T10:52:17.798 INFO:teuthology.orchestra.run.smithi174.stdout: cephfs-mirror x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 220 k 2024-05-08T10:52:17.798 INFO:teuthology.orchestra.run.smithi174.stdout: cephfs-shell x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 27 k 2024-05-08T10:52:17.798 INFO:teuthology.orchestra.run.smithi174.stdout: cephfs-top noarch 2:19.0.0-1670.g1fb5d106.el9 ceph-noarch 18 k 2024-05-08T10:52:17.798 INFO:teuthology.orchestra.run.smithi174.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-05-08T10:52:17.798 INFO:teuthology.orchestra.run.smithi174.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-05-08T10:52:17.799 INFO:teuthology.orchestra.run.smithi174.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-05-08T10:52:17.799 INFO:teuthology.orchestra.run.smithi174.stdout: libcephfs-devel x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 31 k 2024-05-08T10:52:17.799 INFO:teuthology.orchestra.run.smithi174.stdout: libcephfs2 x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 743 k 2024-05-08T10:52:17.799 INFO:teuthology.orchestra.run.smithi174.stdout: librados-devel x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 126 k 2024-05-08T10:52:17.799 INFO:teuthology.orchestra.run.smithi174.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-05-08T10:52:17.799 INFO:teuthology.orchestra.run.smithi174.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-05-08T10:52:17.800 INFO:teuthology.orchestra.run.smithi174.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-05-08T10:52:17.800 INFO:teuthology.orchestra.run.smithi174.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-05-08T10:52:17.800 INFO:teuthology.orchestra.run.smithi174.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-05-08T10:52:17.800 INFO:teuthology.orchestra.run.smithi174.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-05-08T10:52:17.801 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cephfs x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 162 k 2024-05-08T10:52:17.801 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rados x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 321 k 2024-05-08T10:52:17.801 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rbd x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 299 k 2024-05-08T10:52:17.801 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rgw x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 99 k 2024-05-08T10:52:17.801 INFO:teuthology.orchestra.run.smithi174.stdout: rbd-fuse x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 85 k 2024-05-08T10:52:17.801 INFO:teuthology.orchestra.run.smithi174.stdout: rbd-mirror x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 3.1 M 2024-05-08T10:52:17.801 INFO:teuthology.orchestra.run.smithi174.stdout: rbd-nbd x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 171 k 2024-05-08T10:52:17.802 INFO:teuthology.orchestra.run.smithi174.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-05-08T10:52:17.802 INFO:teuthology.orchestra.run.smithi174.stdout:Upgrading: 2024-05-08T10:52:17.802 INFO:teuthology.orchestra.run.smithi174.stdout: NetworkManager x86_64 1:1.47.5-1.el9 baseos 2.3 M 2024-05-08T10:52:17.802 INFO:teuthology.orchestra.run.smithi174.stdout: NetworkManager-libnm x86_64 1:1.47.5-1.el9 baseos 1.8 M 2024-05-08T10:52:17.802 INFO:teuthology.orchestra.run.smithi174.stdout: NetworkManager-team x86_64 1:1.47.5-1.el9 baseos 42 k 2024-05-08T10:52:17.802 INFO:teuthology.orchestra.run.smithi174.stdout: NetworkManager-tui x86_64 1:1.47.5-1.el9 baseos 248 k 2024-05-08T10:52:17.803 INFO:teuthology.orchestra.run.smithi174.stdout: librados2 x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 3.4 M 2024-05-08T10:52:17.803 INFO:teuthology.orchestra.run.smithi174.stdout: librbd1 x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 3.1 M 2024-05-08T10:52:17.803 INFO:teuthology.orchestra.run.smithi174.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-05-08T10:52:17.803 INFO:teuthology.orchestra.run.smithi174.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-05-08T10:52:17.803 INFO:teuthology.orchestra.run.smithi174.stdout:Installing dependencies: 2024-05-08T10:52:17.803 INFO:teuthology.orchestra.run.smithi174.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-08T10:52:17.803 INFO:teuthology.orchestra.run.smithi174.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-05-08T10:52:17.803 INFO:teuthology.orchestra.run.smithi174.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-08T10:52:17.803 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-common x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 20 M 2024-05-08T10:52:17.803 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-grafana-dashboards noarch 2:19.0.0-1670.g1fb5d106.el9 ceph-noarch 31 k 2024-05-08T10:52:17.803 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mds x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 2.1 M 2024-05-08T10:52:17.803 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-modules-core noarch 2:19.0.0-1670.g1fb5d106.el9 ceph-noarch 248 k 2024-05-08T10:52:17.803 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mon x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 4.7 M 2024-05-08T10:52:17.803 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-osd x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 17 M 2024-05-08T10:52:17.804 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-prometheus-alerts noarch 2:19.0.0-1670.g1fb5d106.el9 ceph-noarch 15 k 2024-05-08T10:52:17.804 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-selinux x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 25 k 2024-05-08T10:52:17.804 INFO:teuthology.orchestra.run.smithi174.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-08T10:52:17.804 INFO:teuthology.orchestra.run.smithi174.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-08T10:52:17.804 INFO:teuthology.orchestra.run.smithi174.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-08T10:52:17.804 INFO:teuthology.orchestra.run.smithi174.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-08T10:52:17.804 INFO:teuthology.orchestra.run.smithi174.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-08T10:52:17.804 INFO:teuthology.orchestra.run.smithi174.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-08T10:52:17.804 INFO:teuthology.orchestra.run.smithi174.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-08T10:52:17.804 INFO:teuthology.orchestra.run.smithi174.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-08T10:52:17.804 INFO:teuthology.orchestra.run.smithi174.stdout: libcephsqlite x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 163 k 2024-05-08T10:52:17.804 INFO:teuthology.orchestra.run.smithi174.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-08T10:52:17.804 INFO:teuthology.orchestra.run.smithi174.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-08T10:52:17.804 INFO:teuthology.orchestra.run.smithi174.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-08T10:52:17.804 INFO:teuthology.orchestra.run.smithi174.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-08T10:52:17.805 INFO:teuthology.orchestra.run.smithi174.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-08T10:52:17.805 INFO:teuthology.orchestra.run.smithi174.stdout: libradosstriper1 x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 501 k 2024-05-08T10:52:17.805 INFO:teuthology.orchestra.run.smithi174.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-08T10:52:17.805 INFO:teuthology.orchestra.run.smithi174.stdout: librgw2 x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 5.1 M 2024-05-08T10:52:17.805 INFO:teuthology.orchestra.run.smithi174.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-08T10:52:17.805 INFO:teuthology.orchestra.run.smithi174.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-05-08T10:52:17.805 INFO:teuthology.orchestra.run.smithi174.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-08T10:52:17.805 INFO:teuthology.orchestra.run.smithi174.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-08T10:52:17.805 INFO:teuthology.orchestra.run.smithi174.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-08T10:52:17.805 INFO:teuthology.orchestra.run.smithi174.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-05-08T10:52:17.805 INFO:teuthology.orchestra.run.smithi174.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-08T10:52:17.805 INFO:teuthology.orchestra.run.smithi174.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-08T10:52:17.805 INFO:teuthology.orchestra.run.smithi174.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-08T10:52:17.805 INFO:teuthology.orchestra.run.smithi174.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-05-08T10:52:17.806 INFO:teuthology.orchestra.run.smithi174.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-08T10:52:17.806 INFO:teuthology.orchestra.run.smithi174.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-08T10:52:17.806 INFO:teuthology.orchestra.run.smithi174.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-08T10:52:17.806 INFO:teuthology.orchestra.run.smithi174.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-05-08T10:52:17.806 INFO:teuthology.orchestra.run.smithi174.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-08T10:52:17.806 INFO:teuthology.orchestra.run.smithi174.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-08T10:52:17.806 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-08T10:52:17.806 INFO:teuthology.orchestra.run.smithi174.stdout: python3-ceph-argparse x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 45 k 2024-05-08T10:52:17.806 INFO:teuthology.orchestra.run.smithi174.stdout: python3-ceph-common x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 131 k 2024-05-08T10:52:17.806 INFO:teuthology.orchestra.run.smithi174.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-08T10:52:17.806 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-08T10:52:17.806 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-08T10:52:17.806 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-08T10:52:17.807 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-05-08T10:52:17.807 INFO:teuthology.orchestra.run.smithi174.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-05-08T10:52:17.807 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-08T10:52:17.807 INFO:teuthology.orchestra.run.smithi174.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-08T10:52:17.807 INFO:teuthology.orchestra.run.smithi174.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-08T10:52:17.807 INFO:teuthology.orchestra.run.smithi174.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-08T10:52:17.807 INFO:teuthology.orchestra.run.smithi174.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-08T10:52:17.807 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-08T10:52:17.807 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-08T10:52:17.807 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-08T10:52:17.807 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-08T10:52:17.808 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-08T10:52:17.808 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-08T10:52:17.808 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-08T10:52:17.808 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-08T10:52:17.808 INFO:teuthology.orchestra.run.smithi174.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-08T10:52:17.808 INFO:teuthology.orchestra.run.smithi174.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-08T10:52:17.808 INFO:teuthology.orchestra.run.smithi174.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-08T10:52:17.808 INFO:teuthology.orchestra.run.smithi174.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-08T10:52:17.808 INFO:teuthology.orchestra.run.smithi174.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-08T10:52:17.808 INFO:teuthology.orchestra.run.smithi174.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-08T10:52:17.808 INFO:teuthology.orchestra.run.smithi174.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-08T10:52:17.808 INFO:teuthology.orchestra.run.smithi174.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-08T10:52:17.808 INFO:teuthology.orchestra.run.smithi174.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-08T10:52:17.808 INFO:teuthology.orchestra.run.smithi174.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-08T10:52:17.809 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-08T10:52:17.809 INFO:teuthology.orchestra.run.smithi174.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-08T10:52:17.809 INFO:teuthology.orchestra.run.smithi174.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-08T10:52:17.809 INFO:teuthology.orchestra.run.smithi174.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-08T10:52:17.809 INFO:teuthology.orchestra.run.smithi174.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-08T10:52:17.809 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-08T10:52:17.809 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-08T10:52:17.809 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-08T10:52:17.809 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-08T10:52:17.809 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-05-08T10:52:17.809 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-08T10:52:17.809 INFO:teuthology.orchestra.run.smithi174.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-08T10:52:17.809 INFO:teuthology.orchestra.run.smithi174.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-08T10:52:17.809 INFO:teuthology.orchestra.run.smithi174.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-08T10:52:17.810 INFO:teuthology.orchestra.run.smithi174.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-08T10:52:17.810 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-08T10:52:17.810 INFO:teuthology.orchestra.run.smithi174.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-08T10:52:17.810 INFO:teuthology.orchestra.run.smithi174.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-08T10:52:17.810 INFO:teuthology.orchestra.run.smithi174.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-08T10:52:17.810 INFO:teuthology.orchestra.run.smithi174.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-08T10:52:17.810 INFO:teuthology.orchestra.run.smithi174.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-08T10:52:17.810 INFO:teuthology.orchestra.run.smithi174.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-05-08T10:52:17.810 INFO:teuthology.orchestra.run.smithi174.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-08T10:52:17.811 INFO:teuthology.orchestra.run.smithi174.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-08T10:52:17.811 INFO:teuthology.orchestra.run.smithi174.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-08T10:52:17.811 INFO:teuthology.orchestra.run.smithi174.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-08T10:52:17.811 INFO:teuthology.orchestra.run.smithi174.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-08T10:52:17.811 INFO:teuthology.orchestra.run.smithi174.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-08T10:52:17.811 INFO:teuthology.orchestra.run.smithi174.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-08T10:52:17.811 INFO:teuthology.orchestra.run.smithi174.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-08T10:52:17.812 INFO:teuthology.orchestra.run.smithi174.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-08T10:52:17.812 INFO:teuthology.orchestra.run.smithi174.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-05-08T10:52:17.812 INFO:teuthology.orchestra.run.smithi174.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-08T10:52:17.812 INFO:teuthology.orchestra.run.smithi174.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-05-08T10:52:17.812 INFO:teuthology.orchestra.run.smithi174.stdout:Installing weak dependencies: 2024-05-08T10:52:17.812 INFO:teuthology.orchestra.run.smithi174.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-08T10:52:17.812 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-08T10:52:17.812 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction Summary 2024-05-08T10:52:17.812 INFO:teuthology.orchestra.run.smithi174.stdout:======================================================================================= 2024-05-08T10:52:17.813 INFO:teuthology.orchestra.run.smithi174.stdout:Install 148 Packages 2024-05-08T10:52:17.813 INFO:teuthology.orchestra.run.smithi174.stdout:Upgrade 8 Packages 2024-05-08T10:52:17.813 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-08T10:52:17.813 INFO:teuthology.orchestra.run.smithi174.stdout:Total download size: 220 M 2024-05-08T10:52:17.813 INFO:teuthology.orchestra.run.smithi174.stdout:Downloading Packages: 2024-05-08T10:52:17.977 INFO:teuthology.orchestra.run.smithi033.stdout:(6/156): ceph-mgr-19.0.0-1670.g1fb5d106.el9.x86 6.2 MB/s | 1.5 MB 00:00 2024-05-08T10:52:18.601 INFO:teuthology.orchestra.run.smithi033.stdout:(7/156): ceph-mon-19.0.0-1670.g1fb5d106.el9.x86 5.7 MB/s | 4.7 MB 00:00 2024-05-08T10:52:18.980 INFO:teuthology.orchestra.run.smithi174.stdout:(1/156): ceph-19.0.0-1670.g1fb5d106.el9.x86_64. 17 kB/s | 6.6 kB 00:00 2024-05-08T10:52:19.727 INFO:teuthology.orchestra.run.smithi033.stdout:(8/156): ceph-radosgw-19.0.0-1670.g1fb5d106.el9 8.7 MB/s | 9.8 MB 00:01 2024-05-08T10:52:19.822 INFO:teuthology.orchestra.run.smithi174.stdout:(2/156): ceph-fuse-19.0.0-1670.g1fb5d106.el9.x8 1.0 MB/s | 887 kB 00:00 2024-05-08T10:52:19.927 INFO:teuthology.orchestra.run.smithi033.stdout:(9/156): ceph-common-19.0.0-1670.g1fb5d106.el9. 6.2 MB/s | 20 MB 00:03 2024-05-08T10:52:19.938 INFO:teuthology.orchestra.run.smithi174.stdout:(3/156): ceph-base-19.0.0-1670.g1fb5d106.el9.x8 4.0 MB/s | 5.3 MB 00:01 2024-05-08T10:52:19.944 INFO:teuthology.orchestra.run.smithi033.stdout:(10/156): ceph-selinux-19.0.0-1670.g1fb5d106.el 116 kB/s | 25 kB 00:00 2024-05-08T10:52:19.964 INFO:teuthology.orchestra.run.smithi174.stdout:(4/156): ceph-immutable-object-cache-19.0.0-167 1.0 MB/s | 145 kB 00:00 2024-05-08T10:52:20.164 INFO:teuthology.orchestra.run.smithi174.stdout:(5/156): ceph-mds-19.0.0-1670.g1fb5d106.el9.x86 9.5 MB/s | 2.1 MB 00:00 2024-05-08T10:52:20.478 INFO:teuthology.orchestra.run.smithi174.stdout:(6/156): ceph-mon-19.0.0-1670.g1fb5d106.el9.x86 15 MB/s | 4.7 MB 00:00 2024-05-08T10:52:20.581 INFO:teuthology.orchestra.run.smithi174.stdout:(7/156): ceph-mgr-19.0.0-1670.g1fb5d106.el9.x86 2.4 MB/s | 1.5 MB 00:00 2024-05-08T10:52:20.594 INFO:teuthology.orchestra.run.smithi033.stdout:(11/156): cephfs-mirror-19.0.0-1670.g1fb5d106.e 338 kB/s | 220 kB 00:00 2024-05-08T10:52:20.694 INFO:teuthology.orchestra.run.smithi033.stdout:(12/156): cephfs-shell-19.0.0-1670.g1fb5d106.el 271 kB/s | 27 kB 00:00 2024-05-08T10:52:20.903 INFO:teuthology.orchestra.run.smithi033.stdout:(13/156): ceph-osd-19.0.0-1670.g1fb5d106.el9.x8 5.7 MB/s | 17 MB 00:02 2024-05-08T10:52:20.920 INFO:teuthology.orchestra.run.smithi033.stdout:(14/156): libcephfs-devel-19.0.0-1670.g1fb5d106 138 kB/s | 31 kB 00:00 2024-05-08T10:52:21.195 INFO:teuthology.orchestra.run.smithi033.stdout:(15/156): libcephsqlite-19.0.0-1670.g1fb5d106.e 594 kB/s | 163 kB 00:00 2024-05-08T10:52:21.354 INFO:teuthology.orchestra.run.smithi033.stdout:(16/156): libcephfs2-19.0.0-1670.g1fb5d106.el9. 1.6 MB/s | 743 kB 00:00 2024-05-08T10:52:21.387 INFO:teuthology.orchestra.run.smithi033.stdout:(17/156): librados-devel-19.0.0-1670.g1fb5d106. 660 kB/s | 126 kB 00:00 2024-05-08T10:52:21.674 INFO:teuthology.orchestra.run.smithi174.stdout:(8/156): ceph-osd-19.0.0-1670.g1fb5d106.el9.x86 14 MB/s | 17 MB 00:01 2024-05-08T10:52:21.724 INFO:teuthology.orchestra.run.smithi174.stdout:(9/156): ceph-selinux-19.0.0-1670.g1fb5d106.el9 508 kB/s | 25 kB 00:00 2024-05-08T10:52:21.754 INFO:teuthology.orchestra.run.smithi033.stdout:(18/156): libradosstriper1-19.0.0-1670.g1fb5d10 1.2 MB/s | 501 kB 00:00 2024-05-08T10:52:21.863 INFO:teuthology.orchestra.run.smithi033.stdout:(19/156): python3-ceph-argparse-19.0.0-1670.g1f 416 kB/s | 45 kB 00:00 2024-05-08T10:52:22.063 INFO:teuthology.orchestra.run.smithi033.stdout:(20/156): python3-ceph-common-19.0.0-1670.g1fb5 657 kB/s | 131 kB 00:00 2024-05-08T10:52:22.272 INFO:teuthology.orchestra.run.smithi033.stdout:(21/156): python3-cephfs-19.0.0-1670.g1fb5d106. 776 kB/s | 162 kB 00:00 2024-05-08T10:52:22.597 INFO:teuthology.orchestra.run.smithi033.stdout:(22/156): python3-rados-19.0.0-1670.g1fb5d106.e 988 kB/s | 321 kB 00:00 2024-05-08T10:52:22.889 INFO:teuthology.orchestra.run.smithi033.stdout:(23/156): python3-rbd-19.0.0-1670.g1fb5d106.el9 1.0 MB/s | 299 kB 00:00 2024-05-08T10:52:23.014 INFO:teuthology.orchestra.run.smithi033.stdout:(24/156): python3-rgw-19.0.0-1670.g1fb5d106.el9 794 kB/s | 99 kB 00:00 2024-05-08T10:52:23.139 INFO:teuthology.orchestra.run.smithi033.stdout:(25/156): rbd-fuse-19.0.0-1670.g1fb5d106.el9.x8 683 kB/s | 85 kB 00:00 2024-05-08T10:52:23.865 INFO:teuthology.orchestra.run.smithi033.stdout:(26/156): librgw2-19.0.0-1670.g1fb5d106.el9.x86 2.1 MB/s | 5.1 MB 00:02 2024-05-08T10:52:23.874 INFO:teuthology.orchestra.run.smithi174.stdout:(10/156): ceph-radosgw-19.0.0-1670.g1fb5d106.el 3.0 MB/s | 9.8 MB 00:03 2024-05-08T10:52:23.982 INFO:teuthology.orchestra.run.smithi174.stdout:(11/156): cephfs-mirror-19.0.0-1670.g1fb5d106.e 2.0 MB/s | 220 kB 00:00 2024-05-08T10:52:24.015 INFO:teuthology.orchestra.run.smithi033.stdout:(27/156): rbd-nbd-19.0.0-1670.g1fb5d106.el9.x86 1.1 MB/s | 171 kB 00:00 2024-05-08T10:52:24.074 INFO:teuthology.orchestra.run.smithi174.stdout:(12/156): cephfs-shell-19.0.0-1670.g1fb5d106.el 295 kB/s | 27 kB 00:00 2024-05-08T10:52:24.098 INFO:teuthology.orchestra.run.smithi033.stdout:(28/156): ceph-grafana-dashboards-19.0.0-1670.g 379 kB/s | 31 kB 00:00 2024-05-08T10:52:24.175 INFO:teuthology.orchestra.run.smithi174.stdout:(13/156): libcephfs-devel-19.0.0-1670.g1fb5d106 312 kB/s | 31 kB 00:00 2024-05-08T10:52:24.274 INFO:teuthology.orchestra.run.smithi033.stdout:(29/156): rbd-mirror-19.0.0-1670.g1fb5d106.el9. 2.7 MB/s | 3.1 MB 00:01 2024-05-08T10:52:24.299 INFO:teuthology.orchestra.run.smithi033.stdout:(30/156): ceph-mgr-cephadm-19.0.0-1670.g1fb5d10 689 kB/s | 138 kB 00:00 2024-05-08T10:52:24.641 INFO:teuthology.orchestra.run.smithi033.stdout:(31/156): ceph-mgr-dashboard-19.0.0-1670.g1fb5d 4.9 MB/s | 1.8 MB 00:00 2024-05-08T10:52:24.733 INFO:teuthology.orchestra.run.smithi033.stdout:(32/156): ceph-mgr-modules-core-19.0.0-1670.g1f 2.6 MB/s | 248 kB 00:00 2024-05-08T10:52:24.792 INFO:teuthology.orchestra.run.smithi174.stdout:(14/156): ceph-test-19.0.0-1670.g1fb5d106.el9.x 15 MB/s | 47 MB 00:03 2024-05-08T10:52:24.825 INFO:teuthology.orchestra.run.smithi033.stdout:(33/156): ceph-mgr-rook-19.0.0-1670.g1fb5d106.e 539 kB/s | 49 kB 00:00 2024-05-08T10:52:24.833 INFO:teuthology.orchestra.run.smithi174.stdout:(15/156): libcephfs2-19.0.0-1670.g1fb5d106.el9. 1.1 MB/s | 743 kB 00:00 2024-05-08T10:52:24.859 INFO:teuthology.orchestra.run.smithi174.stdout:(16/156): libcephsqlite-19.0.0-1670.g1fb5d106.e 2.4 MB/s | 163 kB 00:00 2024-05-08T10:52:24.892 INFO:teuthology.orchestra.run.smithi033.stdout:(34/156): ceph-prometheus-alerts-19.0.0-1670.g1 230 kB/s | 15 kB 00:00 2024-05-08T10:52:24.892 INFO:teuthology.orchestra.run.smithi174.stdout:(17/156): librados-devel-19.0.0-1670.g1fb5d106. 2.1 MB/s | 126 kB 00:00 2024-05-08T10:52:24.926 INFO:teuthology.orchestra.run.smithi174.stdout:(18/156): libradosstriper1-19.0.0-1670.g1fb5d10 7.3 MB/s | 501 kB 00:00 2024-05-08T10:52:24.976 INFO:teuthology.orchestra.run.smithi174.stdout:(19/156): python3-ceph-argparse-19.0.0-1670.g1f 905 kB/s | 45 kB 00:00 2024-05-08T10:52:24.984 INFO:teuthology.orchestra.run.smithi033.stdout:(35/156): ceph-volume-19.0.0-1670.g1fb5d106.el9 2.8 MB/s | 264 kB 00:00 2024-05-08T10:52:25.026 INFO:teuthology.orchestra.run.smithi174.stdout:(20/156): python3-ceph-common-19.0.0-1670.g1fb5 2.6 MB/s | 131 kB 00:00 2024-05-08T10:52:25.085 INFO:teuthology.orchestra.run.smithi174.stdout:(21/156): python3-cephfs-19.0.0-1670.g1fb5d106. 2.7 MB/s | 162 kB 00:00 2024-05-08T10:52:25.152 INFO:teuthology.orchestra.run.smithi174.stdout:(22/156): python3-rados-19.0.0-1670.g1fb5d106.e 4.7 MB/s | 321 kB 00:00 2024-05-08T10:52:25.176 INFO:teuthology.orchestra.run.smithi033.stdout:(36/156): cephadm-19.0.0-1670.g1fb5d106.el9.noa 3.8 MB/s | 748 kB 00:00 2024-05-08T10:52:25.202 INFO:teuthology.orchestra.run.smithi174.stdout:(23/156): python3-rbd-19.0.0-1670.g1fb5d106.el9 5.8 MB/s | 299 kB 00:00 2024-05-08T10:52:25.243 INFO:teuthology.orchestra.run.smithi033.stdout:(37/156): cephfs-top-19.0.0-1670.g1fb5d106.el9. 274 kB/s | 18 kB 00:00 2024-05-08T10:52:25.253 INFO:teuthology.orchestra.run.smithi174.stdout:(24/156): python3-rgw-19.0.0-1670.g1fb5d106.el9 1.9 MB/s | 99 kB 00:00 2024-05-08T10:52:25.303 INFO:teuthology.orchestra.run.smithi174.stdout:(25/156): rbd-fuse-19.0.0-1670.g1fb5d106.el9.x8 1.7 MB/s | 85 kB 00:00 2024-05-08T10:52:25.327 INFO:teuthology.orchestra.run.smithi033.stdout:(38/156): fuse-2.9.9-15.el9.x86_64.rpm 961 kB/s | 80 kB 00:00 2024-05-08T10:52:25.544 INFO:teuthology.orchestra.run.smithi033.stdout:(39/156): libgfortran-11.4.1-3.el9.x86_64.rpm 3.6 MB/s | 803 kB 00:00 2024-05-08T10:52:25.544 INFO:teuthology.orchestra.run.smithi174.stdout:(26/156): rbd-mirror-19.0.0-1670.g1fb5d106.el9. 13 MB/s | 3.1 MB 00:00 2024-05-08T10:52:25.628 INFO:teuthology.orchestra.run.smithi174.stdout:(27/156): rbd-nbd-19.0.0-1670.g1fb5d106.el9.x86 2.0 MB/s | 171 kB 00:00 2024-05-08T10:52:25.669 INFO:teuthology.orchestra.run.smithi033.stdout:(40/156): libquadmath-11.4.1-3.el9.x86_64.rpm 1.5 MB/s | 195 kB 00:00 2024-05-08T10:52:25.679 INFO:teuthology.orchestra.run.smithi174.stdout:(28/156): ceph-grafana-dashboards-19.0.0-1670.g 629 kB/s | 31 kB 00:00 2024-05-08T10:52:25.737 INFO:teuthology.orchestra.run.smithi174.stdout:(29/156): ceph-mgr-cephadm-19.0.0-1670.g1fb5d10 2.3 MB/s | 138 kB 00:00 2024-05-08T10:52:25.786 INFO:teuthology.orchestra.run.smithi033.stdout:(41/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.1 MB/s | 253 kB 00:00 2024-05-08T10:52:25.888 INFO:teuthology.orchestra.run.smithi174.stdout:(30/156): ceph-mgr-dashboard-19.0.0-1670.g1fb5d 12 MB/s | 1.8 MB 00:00 2024-05-08T10:52:25.945 INFO:teuthology.orchestra.run.smithi033.stdout:(42/156): ceph-mgr-diskprediction-local-19.0.0- 4.5 MB/s | 7.4 MB 00:01 2024-05-08T10:52:25.954 INFO:teuthology.orchestra.run.smithi174.stdout:(31/156): librgw2-19.0.0-1670.g1fb5d106.el9.x86 4.8 MB/s | 5.1 MB 00:01 2024-05-08T10:52:26.020 INFO:teuthology.orchestra.run.smithi033.stdout:(43/156): python3-ply-3.11-14.el9.noarch.rpm 1.4 MB/s | 106 kB 00:00 2024-05-08T10:52:26.055 INFO:teuthology.orchestra.run.smithi174.stdout:(32/156): ceph-mgr-modules-core-19.0.0-1670.g1f 2.4 MB/s | 248 kB 00:00 2024-05-08T10:52:26.103 INFO:teuthology.orchestra.run.smithi033.stdout:(44/156): python3-pycparser-2.20-6.el9.noarch.r 1.6 MB/s | 135 kB 00:00 2024-05-08T10:52:26.145 INFO:teuthology.orchestra.run.smithi033.stdout:(45/156): python3-cryptography-36.0.1-4.el9.x86 3.4 MB/s | 1.2 MB 00:00 2024-05-08T10:52:26.147 INFO:teuthology.orchestra.run.smithi174.stdout:(33/156): ceph-mgr-rook-19.0.0-1670.g1fb5d106.e 538 kB/s | 49 kB 00:00 2024-05-08T10:52:26.231 INFO:teuthology.orchestra.run.smithi174.stdout:(34/156): ceph-prometheus-alerts-19.0.0-1670.g1 184 kB/s | 15 kB 00:00 2024-05-08T10:52:26.237 INFO:teuthology.orchestra.run.smithi033.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 936 kB/s | 125 kB 00:00 2024-05-08T10:52:26.296 INFO:teuthology.orchestra.run.smithi033.stdout:(47/156): python3-urllib3-1.26.5-5.el9.noarch.r 1.4 MB/s | 215 kB 00:00 2024-05-08T10:52:26.340 INFO:teuthology.orchestra.run.smithi174.stdout:(35/156): ceph-mgr-diskprediction-local-19.0.0- 16 MB/s | 7.4 MB 00:00 2024-05-08T10:52:26.365 INFO:teuthology.orchestra.run.smithi174.stdout:(36/156): ceph-volume-19.0.0-1670.g1fb5d106.el9 1.9 MB/s | 264 kB 00:00 2024-05-08T10:52:26.415 INFO:teuthology.orchestra.run.smithi174.stdout:(37/156): cephadm-19.0.0-1670.g1fb5d106.el9.noa 9.7 MB/s | 748 kB 00:00 2024-05-08T10:52:26.432 INFO:teuthology.orchestra.run.smithi174.stdout:(38/156): cephfs-top-19.0.0-1670.g1fb5d106.el9. 273 kB/s | 18 kB 00:00 2024-05-08T10:52:26.491 INFO:teuthology.orchestra.run.smithi174.stdout:(39/156): fuse-2.9.9-15.el9.x86_64.rpm 1.0 MB/s | 80 kB 00:00 2024-05-08T10:52:26.549 INFO:teuthology.orchestra.run.smithi174.stdout:(40/156): libgfortran-11.4.1-3.el9.x86_64.rpm 6.7 MB/s | 803 kB 00:00 2024-05-08T10:52:26.608 INFO:teuthology.orchestra.run.smithi174.stdout:(41/156): libquadmath-11.4.1-3.el9.x86_64.rpm 1.6 MB/s | 195 kB 00:00 2024-05-08T10:52:26.658 INFO:teuthology.orchestra.run.smithi174.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.3 MB/s | 253 kB 00:00 2024-05-08T10:52:26.725 INFO:teuthology.orchestra.run.smithi174.stdout:(43/156): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 106 kB 00:00 2024-05-08T10:52:26.758 INFO:teuthology.orchestra.run.smithi174.stdout:(44/156): python3-cryptography-36.0.1-4.el9.x86 8.2 MB/s | 1.2 MB 00:00 2024-05-08T10:52:26.817 INFO:teuthology.orchestra.run.smithi174.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 1.4 MB/s | 135 kB 00:00 2024-05-08T10:52:26.834 INFO:teuthology.orchestra.run.smithi174.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 1.6 MB/s | 125 kB 00:00 2024-05-08T10:52:26.901 INFO:teuthology.orchestra.run.smithi174.stdout:(47/156): python3-urllib3-1.26.5-5.el9.noarch.r 2.5 MB/s | 215 kB 00:00 2024-05-08T10:52:27.155 INFO:teuthology.orchestra.run.smithi033.stdout:(48/156): automake-1.16.2-8.el9.noarch.rpm 751 kB/s | 689 kB 00:00 2024-05-08T10:52:27.280 INFO:teuthology.orchestra.run.smithi033.stdout:(49/156): bison-3.7.4-5.el9.x86_64.rpm 959 kB/s | 943 kB 00:00 2024-05-08T10:52:27.913 INFO:teuthology.orchestra.run.smithi033.stdout:(50/156): ceph-test-19.0.0-1670.g1fb5d106.el9.x 5.9 MB/s | 47 MB 00:07 2024-05-08T10:52:27.951 INFO:teuthology.orchestra.run.smithi174.stdout:(48/156): automake-1.16.2-8.el9.noarch.rpm 617 kB/s | 689 kB 00:01 2024-05-08T10:52:28.060 INFO:teuthology.orchestra.run.smithi174.stdout:(49/156): bison-3.7.4-5.el9.x86_64.rpm 814 kB/s | 943 kB 00:01 2024-05-08T10:52:28.347 INFO:teuthology.orchestra.run.smithi033.stdout:(51/156): boost-program-options-1.75.0-8.el9.x8 90 kB/s | 107 kB 00:01 2024-05-08T10:52:28.414 INFO:teuthology.orchestra.run.smithi033.stdout:(52/156): elfutils-libelf-devel-0.190-2.el9.x86 19 kB/s | 21 kB 00:01 2024-05-08T10:52:28.735 INFO:teuthology.orchestra.run.smithi174.stdout:(50/156): elfutils-libelf-devel-0.190-2.el9.x86 32 kB/s | 21 kB 00:00 2024-05-08T10:52:28.844 INFO:teuthology.orchestra.run.smithi174.stdout:(51/156): boost-program-options-1.75.0-8.el9.x8 120 kB/s | 107 kB 00:00 2024-05-08T10:52:28.939 INFO:teuthology.orchestra.run.smithi033.stdout:(53/156): flex-2.6.4-9.el9.x86_64.rpm 315 kB/s | 313 kB 00:00 2024-05-08T10:52:28.981 INFO:teuthology.orchestra.run.smithi033.stdout:(54/156): flexiblas-3.0.4-8.el9.x86_64.rpm 52 kB/s | 33 kB 00:00 2024-05-08T10:52:29.444 INFO:teuthology.orchestra.run.smithi174.stdout:(52/156): flexiblas-3.0.4-8.el9.x86_64.rpm 54 kB/s | 33 kB 00:00 2024-05-08T10:52:29.464 INFO:teuthology.orchestra.run.smithi033.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 35 kB/s | 18 kB 00:00 2024-05-08T10:52:29.498 INFO:teuthology.orchestra.run.smithi033.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 22 kB/s | 11 kB 00:00 2024-05-08T10:52:29.556 INFO:teuthology.orchestra.run.smithi033.stdout:(57/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.6 MB/s | 3.0 MB 00:01 2024-05-08T10:52:29.602 INFO:teuthology.orchestra.run.smithi174.stdout:(53/156): flex-2.6.4-9.el9.x86_64.rpm 362 kB/s | 313 kB 00:00 2024-05-08T10:52:30.157 INFO:teuthology.orchestra.run.smithi033.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 69 kB/s | 45 kB 00:00 2024-05-08T10:52:30.161 INFO:teuthology.orchestra.run.smithi174.stdout:(54/156): flexiblas-openblas-openmp-3.0.4-8.el9 33 kB/s | 18 kB 00:00 2024-05-08T10:52:30.257 INFO:teuthology.orchestra.run.smithi033.stdout:(59/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 202 kB/s | 160 kB 00:00 2024-05-08T10:52:30.482 INFO:teuthology.orchestra.run.smithi033.stdout:(60/156): librdkafka-1.6.1-102.el9.x86_64.rpm 716 kB/s | 662 kB 00:00 2024-05-08T10:52:30.586 INFO:teuthology.orchestra.run.smithi174.stdout:(55/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.6 MB/s | 3.0 MB 00:01 2024-05-08T10:52:30.803 INFO:teuthology.orchestra.run.smithi174.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 17 kB/s | 11 kB 00:00 2024-05-08T10:52:30.857 INFO:teuthology.orchestra.run.smithi033.stdout:(61/156): libuuid-devel-2.37.4-18.el9.x86_64.rp 42 kB/s | 25 kB 00:00 2024-05-08T10:52:31.132 INFO:teuthology.orchestra.run.smithi033.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 73 kB/s | 47 kB 00:00 2024-05-08T10:52:31.158 INFO:teuthology.orchestra.run.smithi033.stdout:(63/156): libtool-2.4.6-45.el9.x86_64.rpm 582 kB/s | 582 kB 00:01 2024-05-08T10:52:31.429 INFO:teuthology.orchestra.run.smithi174.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 190 kB/s | 160 kB 00:00 2024-05-08T10:52:31.454 INFO:teuthology.orchestra.run.smithi174.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 70 kB/s | 45 kB 00:00 2024-05-08T10:52:31.708 INFO:teuthology.orchestra.run.smithi033.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 344 kB/s | 292 kB 00:00 2024-05-08T10:52:31.754 INFO:teuthology.orchestra.run.smithi174.stdout:(59/156): ceph-common-19.0.0-1670.g1fb5d106.el9 1.5 MB/s | 20 MB 00:13 2024-05-08T10:52:31.775 INFO:teuthology.orchestra.run.smithi033.stdout:(65/156): openblas-0.3.21-2.el9.x86_64.rpm 57 kB/s | 35 kB 00:00 2024-05-08T10:52:31.943 INFO:teuthology.orchestra.run.smithi033.stdout:(66/156): lua-5.4.4-4.el9.x86_64.rpm 233 kB/s | 188 kB 00:00 2024-05-08T10:52:32.396 INFO:teuthology.orchestra.run.smithi174.stdout:(60/156): libuuid-devel-2.37.4-18.el9.x86_64.rp 40 kB/s | 25 kB 00:00 2024-05-08T10:52:32.521 INFO:teuthology.orchestra.run.smithi174.stdout:(61/156): librdkafka-1.6.1-102.el9.x86_64.rpm 607 kB/s | 662 kB 00:01 2024-05-08T10:52:32.563 INFO:teuthology.orchestra.run.smithi174.stdout:(62/156): libtool-2.4.6-45.el9.x86_64.rpm 525 kB/s | 582 kB 00:01 2024-05-08T10:52:32.934 INFO:teuthology.orchestra.run.smithi033.stdout:(67/156): openblas-openmp-0.3.21-2.el9.x86_64.r 3.9 MB/s | 4.7 MB 00:01 2024-05-08T10:52:33.018 INFO:teuthology.orchestra.run.smithi033.stdout:(68/156): openssl-devel-3.2.1-1.el9.x86_64.rpm 3.6 MB/s | 4.4 MB 00:01 2024-05-08T10:52:33.056 INFO:teuthology.orchestra.run.smithi174.stdout:(63/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 72 kB/s | 47 kB 00:00 2024-05-08T10:52:33.077 INFO:teuthology.orchestra.run.smithi033.stdout:(69/156): postgresql-13.14-1.el9.x86_64.rpm 1.4 MB/s | 1.6 MB 00:01 2024-05-08T10:52:33.347 INFO:teuthology.orchestra.run.smithi174.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 354 kB/s | 292 kB 00:00 2024-05-08T10:52:33.364 INFO:teuthology.orchestra.run.smithi174.stdout:(65/156): lua-5.4.4-4.el9.x86_64.rpm 235 kB/s | 188 kB 00:00 2024-05-08T10:52:33.673 INFO:teuthology.orchestra.run.smithi174.stdout:(66/156): openblas-0.3.21-2.el9.x86_64.rpm 57 kB/s | 35 kB 00:00 2024-05-08T10:52:33.827 INFO:teuthology.orchestra.run.smithi033.stdout:(70/156): postgresql-private-libs-13.14-1.el9.x 165 kB/s | 133 kB 00:00 2024-05-08T10:52:33.919 INFO:teuthology.orchestra.run.smithi033.stdout:(71/156): postgresql-contrib-13.14-1.el9.x86_64 926 kB/s | 911 kB 00:00 2024-05-08T10:52:34.402 INFO:teuthology.orchestra.run.smithi033.stdout:(72/156): postgresql-server-13.14-1.el9.x86_64. 4.4 MB/s | 5.8 MB 00:01 2024-05-08T10:52:34.539 INFO:teuthology.orchestra.run.smithi174.stdout:(67/156): openblas-openmp-0.3.21-2.el9.x86_64.r 4.0 MB/s | 4.7 MB 00:01 2024-05-08T10:52:34.598 INFO:teuthology.orchestra.run.smithi174.stdout:(68/156): openssl-devel-3.2.1-1.el9.x86_64.rpm 3.6 MB/s | 4.4 MB 00:01 2024-05-08T10:52:34.702 INFO:teuthology.orchestra.run.smithi033.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 112 kB/s | 87 kB 00:00 2024-05-08T10:52:34.740 INFO:teuthology.orchestra.run.smithi174.stdout:(69/156): postgresql-13.14-1.el9.x86_64.rpm 1.5 MB/s | 1.6 MB 00:01 2024-05-08T10:52:34.902 INFO:teuthology.orchestra.run.smithi033.stdout:(74/156): protobuf-3.14.0-13.el9.x86_64.rpm 961 kB/s | 1.0 MB 00:01 2024-05-08T10:52:35.490 INFO:teuthology.orchestra.run.smithi174.stdout:(70/156): postgresql-private-libs-13.14-1.el9.x 149 kB/s | 133 kB 00:00 2024-05-08T10:52:35.682 INFO:teuthology.orchestra.run.smithi174.stdout:(71/156): postgresql-contrib-13.14-1.el9.x86_64 798 kB/s | 911 kB 00:01 2024-05-08T10:52:35.753 INFO:teuthology.orchestra.run.smithi033.stdout:(75/156): python3-devel-3.9.18-3.el9.x86_64.rpm 233 kB/s | 244 kB 00:01 2024-05-08T10:52:35.845 INFO:teuthology.orchestra.run.smithi033.stdout:(76/156): python3-babel-2.9.1-2.el9.noarch.rpm 4.1 MB/s | 6.0 MB 00:01 2024-05-08T10:52:35.937 INFO:teuthology.orchestra.run.smithi033.stdout:(77/156): python3-jinja2-2.11.3-5.el9.noarch.rp 240 kB/s | 248 kB 00:01 2024-05-08T10:52:36.199 INFO:teuthology.orchestra.run.smithi174.stdout:(72/156): postgresql-server-13.14-1.el9.x86_64. 4.0 MB/s | 5.8 MB 00:01 2024-05-08T10:52:36.441 INFO:teuthology.orchestra.run.smithi174.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 115 kB/s | 87 kB 00:00 2024-05-08T10:52:36.454 INFO:teuthology.orchestra.run.smithi033.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 37 kB/s | 26 kB 00:00 2024-05-08T10:52:36.479 INFO:teuthology.orchestra.run.smithi033.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 30 kB/s | 19 kB 00:00 2024-05-08T10:52:36.524 INFO:teuthology.orchestra.run.smithi174.stdout:(74/156): protobuf-3.14.0-13.el9.x86_64.rpm 1.0 MB/s | 1.0 MB 00:01 2024-05-08T10:52:36.779 INFO:teuthology.orchestra.run.smithi033.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 204 kB/s | 172 kB 00:00 2024-05-08T10:52:37.096 INFO:teuthology.orchestra.run.smithi033.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 54 kB/s | 35 kB 00:00 2024-05-08T10:52:37.291 INFO:teuthology.orchestra.run.smithi174.stdout:(75/156): python3-devel-3.9.18-3.el9.x86_64.rpm 297 kB/s | 244 kB 00:00 2024-05-08T10:52:37.350 INFO:teuthology.orchestra.run.smithi174.stdout:(76/156): python3-jinja2-2.11.3-5.el9.noarch.rp 300 kB/s | 248 kB 00:00 2024-05-08T10:52:37.492 INFO:teuthology.orchestra.run.smithi174.stdout:(77/156): python3-babel-2.9.1-2.el9.noarch.rpm 4.6 MB/s | 6.0 MB 00:01 2024-05-08T10:52:37.596 INFO:teuthology.orchestra.run.smithi033.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 307 kB/s | 250 kB 00:00 2024-05-08T10:52:37.671 INFO:teuthology.orchestra.run.smithi033.stdout:(83/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.3 MB/s | 5.1 MB 00:01 2024-05-08T10:52:37.913 INFO:teuthology.orchestra.run.smithi033.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 272 kB/s | 222 kB 00:00 2024-05-08T10:52:37.926 INFO:teuthology.orchestra.run.smithi174.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 40 kB/s | 26 kB 00:00 2024-05-08T10:52:37.951 INFO:teuthology.orchestra.run.smithi174.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 32 kB/s | 19 kB 00:00 2024-05-08T10:52:38.297 INFO:teuthology.orchestra.run.smithi033.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 110 kB/s | 77 kB 00:00 2024-05-08T10:52:38.309 INFO:teuthology.orchestra.run.smithi174.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 211 kB/s | 172 kB 00:00 2024-05-08T10:52:38.322 INFO:teuthology.orchestra.run.smithi033.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 65 kB/s | 42 kB 00:00 2024-05-08T10:52:38.526 INFO:teuthology.orchestra.run.smithi174.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 58 kB/s | 35 kB 00:00 2024-05-08T10:52:38.739 INFO:teuthology.orchestra.run.smithi033.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 326 kB/s | 269 kB 00:00 2024-05-08T10:52:39.047 INFO:teuthology.orchestra.run.smithi033.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 212 kB/s | 159 kB 00:00 2024-05-08T10:52:39.126 INFO:teuthology.orchestra.run.smithi174.stdout:(82/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.3 MB/s | 5.1 MB 00:01 2024-05-08T10:52:39.151 INFO:teuthology.orchestra.run.smithi174.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 297 kB/s | 250 kB 00:00 2024-05-08T10:52:39.173 INFO:teuthology.orchestra.run.smithi033.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 328 kB/s | 279 kB 00:00 2024-05-08T10:52:39.352 INFO:teuthology.orchestra.run.smithi174.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 269 kB/s | 222 kB 00:00 2024-05-08T10:52:39.373 INFO:teuthology.orchestra.run.smithi033.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 80 kB/s | 51 kB 00:00 2024-05-08T10:52:39.690 INFO:teuthology.orchestra.run.smithi033.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 84 kB/s | 54 kB 00:00 2024-05-08T10:52:39.769 INFO:teuthology.orchestra.run.smithi174.stdout:(85/156): python3-prettytable-0.7.2-27.el9.noar 68 kB/s | 42 kB 00:00 2024-05-08T10:52:39.811 INFO:teuthology.orchestra.run.smithi174.stdout:(86/156): python3-packaging-20.9-5.el9.noarch.r 113 kB/s | 77 kB 00:00 2024-05-08T10:52:39.999 INFO:teuthology.orchestra.run.smithi033.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 67 kB/s | 42 kB 00:00 2024-05-08T10:52:40.236 INFO:teuthology.orchestra.run.smithi174.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 324 kB/s | 269 kB 00:00 2024-05-08T10:52:40.307 INFO:teuthology.orchestra.run.smithi033.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 72 kB/s | 44 kB 00:00 2024-05-08T10:52:40.528 INFO:teuthology.orchestra.run.smithi174.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 209 kB/s | 159 kB 00:00 2024-05-08T10:52:40.644 INFO:teuthology.orchestra.run.smithi174.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 335 kB/s | 279 kB 00:00 2024-05-08T10:52:40.674 INFO:teuthology.orchestra.run.smithi033.stdout:(94/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 11 MB/s | 16 MB 00:01 2024-05-08T10:52:40.875 INFO:teuthology.orchestra.run.smithi033.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 252 kB/s | 221 kB 00:00 2024-05-08T10:52:40.895 INFO:teuthology.orchestra.run.smithi174.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 77 kB/s | 51 kB 00:00 2024-05-08T10:52:41.100 INFO:teuthology.orchestra.run.smithi033.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 45 kB/s | 36 kB 00:00 2024-05-08T10:52:41.212 INFO:teuthology.orchestra.run.smithi174.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 78 kB/s | 54 kB 00:00 2024-05-08T10:52:41.333 INFO:teuthology.orchestra.run.smithi033.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 75 kB/s | 47 kB 00:00 2024-05-08T10:52:41.545 INFO:teuthology.orchestra.run.smithi174.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 67 kB/s | 42 kB 00:00 2024-05-08T10:52:41.734 INFO:teuthology.orchestra.run.smithi033.stdout:(98/156): socat-1.7.4.1-5.el9.x86_64.rpm 355 kB/s | 305 kB 00:00 2024-05-08T10:52:41.759 INFO:teuthology.orchestra.run.smithi033.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 88 kB/s | 58 kB 00:00 2024-05-08T10:52:41.871 INFO:teuthology.orchestra.run.smithi174.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 67 kB/s | 44 kB 00:00 2024-05-08T10:52:42.109 INFO:teuthology.orchestra.run.smithi033.stdout:(100/156): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 125 kB/s | 94 kB 00:00 2024-05-08T10:52:42.159 INFO:teuthology.orchestra.run.smithi033.stdout:(101/156): lua-devel-5.4.4-4.el9.x86_64.rpm 457 kB/s | 22 kB 00:00 2024-05-08T10:52:42.260 INFO:teuthology.orchestra.run.smithi033.stdout:(102/156): protobuf-compiler-3.14.0-13.el9.x86_ 8.4 MB/s | 863 kB 00:00 2024-05-08T10:52:42.263 INFO:teuthology.orchestra.run.smithi174.stdout:(94/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 10 MB/s | 16 MB 00:01 2024-05-08T10:52:42.435 INFO:teuthology.orchestra.run.smithi033.stdout:(103/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 66 kB/s | 45 kB 00:00 2024-05-08T10:52:42.460 INFO:teuthology.orchestra.run.smithi033.stdout:(104/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 88 kB/s | 64 kB 00:00 2024-05-08T10:52:42.479 INFO:teuthology.orchestra.run.smithi174.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 237 kB/s | 221 kB 00:00 2024-05-08T10:52:42.688 INFO:teuthology.orchestra.run.smithi174.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 44 kB/s | 36 kB 00:00 2024-05-08T10:52:42.711 INFO:teuthology.orchestra.run.smithi033.stdout:(105/156): grpc-data-1.46.7-10.el9.noarch.rpm 78 kB/s | 19 kB 00:00 2024-05-08T10:52:42.736 INFO:teuthology.orchestra.run.smithi033.stdout:(106/156): abseil-cpp-20211102.0-3.el9.x86_64.r 1.1 MB/s | 548 kB 00:00 2024-05-08T10:52:42.811 INFO:teuthology.orchestra.run.smithi033.stdout:(107/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 347 kB/s | 26 kB 00:00 2024-05-08T10:52:42.870 INFO:teuthology.orchestra.run.smithi033.stdout:(108/156): gperftools-libs-2.9.1-2.el9.x86_64.r 714 kB/s | 309 kB 00:00 2024-05-08T10:52:42.895 INFO:teuthology.orchestra.run.smithi033.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 583 kB/s | 49 kB 00:00 2024-05-08T10:52:42.913 INFO:teuthology.orchestra.run.smithi174.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 76 kB/s | 47 kB 00:00 2024-05-08T10:52:42.953 INFO:teuthology.orchestra.run.smithi033.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 809 kB/s | 67 kB 00:00 2024-05-08T10:52:42.979 INFO:teuthology.orchestra.run.smithi033.stdout:(111/156): luarocks-3.9.2-1.el9.noarch.rpm 1.8 MB/s | 151 kB 00:00 2024-05-08T10:52:43.096 INFO:teuthology.orchestra.run.smithi033.stdout:(112/156): python3-asyncssh-2.13.2-5.el9.noarch 4.6 MB/s | 548 kB 00:00 2024-05-08T10:52:43.138 INFO:teuthology.orchestra.run.smithi033.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 4.5 MB/s | 839 kB 00:00 2024-05-08T10:52:43.172 INFO:teuthology.orchestra.run.smithi033.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 578 kB/s | 43 kB 00:00 2024-05-08T10:52:43.213 INFO:teuthology.orchestra.run.smithi033.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 428 kB/s | 32 kB 00:00 2024-05-08T10:52:43.272 INFO:teuthology.orchestra.run.smithi033.stdout:(116/156): libarrow-9.0.0-11.el9.x86_64.rpm 7.9 MB/s | 4.4 MB 00:00 2024-05-08T10:52:43.297 INFO:teuthology.orchestra.run.smithi033.stdout:(117/156): python3-certifi-2021.10.8-2.el9.noar 119 kB/s | 15 kB 00:00 2024-05-08T10:52:43.305 INFO:teuthology.orchestra.run.smithi174.stdout:(98/156): socat-1.7.4.1-5.el9.x86_64.rpm 369 kB/s | 305 kB 00:00 2024-05-08T10:52:43.323 INFO:teuthology.orchestra.run.smithi033.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 1.5 MB/s | 172 kB 00:00 2024-05-08T10:52:43.347 INFO:teuthology.orchestra.run.smithi174.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 88 kB/s | 58 kB 00:00 2024-05-08T10:52:43.373 INFO:teuthology.orchestra.run.smithi033.stdout:(119/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.9 MB/s | 303 kB 00:00 2024-05-08T10:52:43.398 INFO:teuthology.orchestra.run.smithi033.stdout:(120/156): python3-cherrypy-18.6.1-2.el9.noarch 2.8 MB/s | 358 kB 00:00 2024-05-08T10:52:43.423 INFO:teuthology.orchestra.run.smithi033.stdout:(121/156): python3-colorama-0.4.4-12.el9.noarch 352 kB/s | 35 kB 00:00 2024-05-08T10:52:43.449 INFO:teuthology.orchestra.run.smithi033.stdout:(122/156): python3-google-auth-2.29.0-1.el9.noa 2.7 MB/s | 206 kB 00:00 2024-05-08T10:52:43.499 INFO:teuthology.orchestra.run.smithi033.stdout:(123/156): python3-grpcio-tools-1.46.7-10.el9.x 1.9 MB/s | 144 kB 00:00 2024-05-08T10:52:43.525 INFO:teuthology.orchestra.run.smithi033.stdout:(124/156): python3-jaraco-8.2.1-3.el9.noarch.rp 142 kB/s | 11 kB 00:00 2024-05-08T10:52:43.592 INFO:teuthology.orchestra.run.smithi033.stdout:(125/156): python3-grpcio-1.46.7-10.el9.x86_64. 11 MB/s | 2.0 MB 00:00 2024-05-08T10:52:43.614 INFO:teuthology.orchestra.run.smithi174.stdout:(100/156): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 134 kB/s | 94 kB 00:00 2024-05-08T10:52:43.616 INFO:teuthology.orchestra.run.smithi033.stdout:(126/156): python3-jaraco-classes-3.2.1-5.el9.n 151 kB/s | 18 kB 00:00 2024-05-08T10:52:43.642 INFO:teuthology.orchestra.run.smithi033.stdout:(127/156): python3-jaraco-collections-3.0.0-8.e 198 kB/s | 23 kB 00:00 2024-05-08T10:52:43.667 INFO:teuthology.orchestra.run.smithi033.stdout:(128/156): python3-jaraco-functools-3.5.0-2.el9 258 kB/s | 19 kB 00:00 2024-05-08T10:52:43.717 INFO:teuthology.orchestra.run.smithi033.stdout:(129/156): python3-jaraco-text-3.2.0-6.el9.noar 262 kB/s | 20 kB 00:00 2024-05-08T10:52:43.731 INFO:teuthology.orchestra.run.smithi174.stdout:(101/156): lua-devel-5.4.4-4.el9.x86_64.rpm 191 kB/s | 22 kB 00:00 2024-05-08T10:52:43.742 INFO:teuthology.orchestra.run.smithi033.stdout:(130/156): python3-logutils-0.3.5-21.el9.noarch 615 kB/s | 46 kB 00:00 2024-05-08T10:52:43.784 INFO:teuthology.orchestra.run.smithi033.stdout:(131/156): python3-kubernetes-26.1.0-2.el9.noar 7.2 MB/s | 1.0 MB 00:00 2024-05-08T10:52:43.810 INFO:teuthology.orchestra.run.smithi033.stdout:(132/156): python3-more-itertools-8.12.0-2.el9. 857 kB/s | 79 kB 00:00 2024-05-08T10:52:43.826 INFO:teuthology.orchestra.run.smithi033.stdout:(133/156): python3-natsort-7.1.1-5.el9.noarch.r 689 kB/s | 58 kB 00:00 2024-05-08T10:52:43.860 INFO:teuthology.orchestra.run.smithi033.stdout:(134/156): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-05-08T10:52:43.877 INFO:teuthology.orchestra.run.smithi033.stdout:(135/156): python3-portend-3.1.0-2.el9.noarch.r 244 kB/s | 16 kB 00:00 2024-05-08T10:52:43.902 INFO:teuthology.orchestra.run.smithi033.stdout:(136/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-05-08T10:52:43.923 INFO:teuthology.orchestra.run.smithi174.stdout:(102/156): protobuf-compiler-3.14.0-13.el9.x86_ 4.4 MB/s | 863 kB 00:00 2024-05-08T10:52:43.936 INFO:teuthology.orchestra.run.smithi033.stdout:(137/156): python3-pyperclip-1.8.2-2.el9.noarch 374 kB/s | 28 kB 00:00 2024-05-08T10:52:43.965 INFO:teuthology.orchestra.run.smithi174.stdout:(103/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 73 kB/s | 45 kB 00:00 2024-05-08T10:52:43.990 INFO:teuthology.orchestra.run.smithi033.stdout:(138/156): python3-repoze-lru-0.7-16.el9.noarch 273 kB/s | 31 kB 00:00 2024-05-08T10:52:44.006 INFO:teuthology.orchestra.run.smithi174.stdout:(104/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 91 kB/s | 64 kB 00:00 2024-05-08T10:52:44.014 INFO:teuthology.orchestra.run.smithi033.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 786 kB/s | 59 kB 00:00 2024-05-08T10:52:44.037 INFO:teuthology.orchestra.run.smithi033.stdout:(140/156): python3-routes-2.5.1-5.el9.noarch.rp 1.4 MB/s | 188 kB 00:00 2024-05-08T10:52:44.062 INFO:teuthology.orchestra.run.smithi033.stdout:(141/156): python3-tempora-5.0.0-2.el9.noarch.r 499 kB/s | 36 kB 00:00 2024-05-08T10:52:44.087 INFO:teuthology.orchestra.run.smithi033.stdout:(142/156): python3-typing-extensions-4.4.0-2.el 677 kB/s | 51 kB 00:00 2024-05-08T10:52:44.121 INFO:teuthology.orchestra.run.smithi033.stdout:(143/156): python3-webob-1.8.7-6.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-05-08T10:52:44.146 INFO:teuthology.orchestra.run.smithi033.stdout:(144/156): python3-websocket-client-1.2.3-2.el9 1.0 MB/s | 90 kB 00:00 2024-05-08T10:52:44.171 INFO:teuthology.orchestra.run.smithi033.stdout:(145/156): python3-werkzeug-2.0.3-3.el9.1.noarc 5.0 MB/s | 427 kB 00:00 2024-05-08T10:52:44.197 INFO:teuthology.orchestra.run.smithi033.stdout:(146/156): python3-zc-lockfile-2.0-10.el9.noarc 265 kB/s | 20 kB 00:00 2024-05-08T10:52:44.231 INFO:teuthology.orchestra.run.smithi033.stdout:(147/156): re2-20211101-3.el9.x86_64.rpm 2.2 MB/s | 192 kB 00:00 2024-05-08T10:52:44.266 INFO:teuthology.orchestra.run.smithi174.stdout:(105/156): grpc-data-1.46.7-10.el9.noarch.rpm 75 kB/s | 19 kB 00:00 2024-05-08T10:52:44.280 INFO:teuthology.orchestra.run.smithi033.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-05-08T10:52:44.491 INFO:teuthology.orchestra.run.smithi174.stdout:(106/156): gperftools-libs-2.9.1-2.el9.x86_64.r 588 kB/s | 309 kB 00:00 2024-05-08T10:52:44.549 INFO:teuthology.orchestra.run.smithi174.stdout:(107/156): abseil-cpp-20211102.0-3.el9.x86_64.r 876 kB/s | 548 kB 00:00 2024-05-08T10:52:44.648 INFO:teuthology.orchestra.run.smithi033.stdout:(149/156): NetworkManager-1.47.5-1.el9.x86_64.r 6.3 MB/s | 2.3 MB 00:00 2024-05-08T10:52:44.750 INFO:teuthology.orchestra.run.smithi174.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 100 kB/s | 26 kB 00:00 2024-05-08T10:52:44.840 INFO:teuthology.orchestra.run.smithi033.stdout:(150/156): NetworkManager-libnm-1.47.5-1.el9.x8 9.5 MB/s | 1.8 MB 00:00 2024-05-08T10:52:44.886 INFO:teuthology.orchestra.run.smithi174.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 144 kB/s | 49 kB 00:00 2024-05-08T10:52:44.906 INFO:teuthology.orchestra.run.smithi033.stdout:(151/156): NetworkManager-team-1.47.5-1.el9.x86 627 kB/s | 42 kB 00:00 2024-05-08T10:52:44.990 INFO:teuthology.orchestra.run.smithi033.stdout:(152/156): NetworkManager-tui-1.47.5-1.el9.x86_ 2.9 MB/s | 248 kB 00:00 2024-05-08T10:52:45.125 INFO:teuthology.orchestra.run.smithi174.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 179 kB/s | 67 kB 00:00 2024-05-08T10:52:45.190 INFO:teuthology.orchestra.run.smithi033.stdout:(153/156): openssl-3.2.1-1.el9.x86_64.rpm 6.7 MB/s | 1.3 MB 00:00 2024-05-08T10:52:45.316 INFO:teuthology.orchestra.run.smithi033.stdout:(154/156): librados2-19.0.0-1670.g1fb5d106.el9. 3.0 MB/s | 3.4 MB 00:01 2024-05-08T10:52:45.384 INFO:teuthology.orchestra.run.smithi174.stdout:(111/156): luarocks-3.9.2-1.el9.noarch.rpm 303 kB/s | 151 kB 00:00 2024-05-08T10:52:45.441 INFO:teuthology.orchestra.run.smithi033.stdout:(155/156): librbd1-19.0.0-1670.g1fb5d106.el9.x8 2.6 MB/s | 3.1 MB 00:01 2024-05-08T10:52:45.609 INFO:teuthology.orchestra.run.smithi174.stdout:(112/156): libarrow-9.0.0-11.el9.x86_64.rpm 3.3 MB/s | 4.4 MB 00:01 2024-05-08T10:52:45.810 INFO:teuthology.orchestra.run.smithi174.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 1.2 MB/s | 839 kB 00:00 2024-05-08T10:52:45.985 INFO:teuthology.orchestra.run.smithi174.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 116 kB/s | 43 kB 00:00 2024-05-08T10:52:46.008 INFO:teuthology.orchestra.run.smithi033.stdout:(156/156): openssl-libs-3.2.1-1.el9.x86_64.rpm 2.9 MB/s | 2.4 MB 00:00 2024-05-08T10:52:46.015 INFO:teuthology.orchestra.run.smithi033.stdout:-------------------------------------------------------------------------------- 2024-05-08T10:52:46.015 INFO:teuthology.orchestra.run.smithi033.stdout:Total 7.4 MB/s | 220 MB 00:29 2024-05-08T10:52:46.269 INFO:teuthology.orchestra.run.smithi174.stdout:(115/156): python3-asyncssh-2.13.2-5.el9.noarch 620 kB/s | 548 kB 00:00 2024-05-08T10:52:46.293 INFO:teuthology.orchestra.run.smithi174.stdout:(116/156): python3-cachetools-4.2.4-1.el9.noarc 66 kB/s | 32 kB 00:00 2024-05-08T10:52:46.477 INFO:teuthology.orchestra.run.smithi174.stdout:(117/156): python3-certifi-2021.10.8-2.el9.noar 30 kB/s | 15 kB 00:00 2024-05-08T10:52:46.761 INFO:teuthology.orchestra.run.smithi174.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 349 kB/s | 172 kB 00:00 2024-05-08T10:52:47.028 INFO:teuthology.orchestra.run.smithi174.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 488 kB/s | 358 kB 00:00 2024-05-08T10:52:47.053 INFO:teuthology.orchestra.run.smithi174.stdout:(120/156): python3-colorama-0.4.4-12.el9.noarch 121 kB/s | 35 kB 00:00 2024-05-08T10:52:47.145 INFO:teuthology.orchestra.run.smithi174.stdout:(121/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 454 kB/s | 303 kB 00:00 2024-05-08T10:52:47.253 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction check 2024-05-08T10:52:47.424 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction check succeeded. 2024-05-08T10:52:47.424 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction test 2024-05-08T10:52:47.571 INFO:teuthology.orchestra.run.smithi174.stdout:(122/156): python3-google-auth-2.29.0-1.el9.noa 379 kB/s | 206 kB 00:00 2024-05-08T10:52:47.646 INFO:teuthology.orchestra.run.smithi174.stdout:(123/156): python3-grpcio-tools-1.46.7-10.el9.x 289 kB/s | 144 kB 00:00 2024-05-08T10:52:47.746 INFO:teuthology.orchestra.run.smithi174.stdout:(124/156): python3-jaraco-8.2.1-3.el9.noarch.rp 61 kB/s | 11 kB 00:00 2024-05-08T10:52:47.913 INFO:teuthology.orchestra.run.smithi174.stdout:(125/156): python3-grpcio-1.46.7-10.el9.x86_64. 2.4 MB/s | 2.0 MB 00:00 2024-05-08T10:52:47.938 INFO:teuthology.orchestra.run.smithi174.stdout:(126/156): python3-jaraco-classes-3.2.1-5.el9.n 60 kB/s | 18 kB 00:00 2024-05-08T10:52:48.005 INFO:teuthology.orchestra.run.smithi174.stdout:(127/156): python3-jaraco-collections-3.0.0-8.e 89 kB/s | 23 kB 00:00 2024-05-08T10:52:48.180 INFO:teuthology.orchestra.run.smithi174.stdout:(128/156): python3-jaraco-functools-3.5.0-2.el9 73 kB/s | 19 kB 00:00 2024-05-08T10:52:48.206 INFO:teuthology.orchestra.run.smithi174.stdout:(129/156): python3-jaraco-text-3.2.0-6.el9.noar 74 kB/s | 20 kB 00:00 2024-05-08T10:52:48.514 INFO:teuthology.orchestra.run.smithi174.stdout:(130/156): python3-logutils-0.3.5-21.el9.noarch 139 kB/s | 46 kB 00:00 2024-05-08T10:52:48.539 INFO:teuthology.orchestra.run.smithi174.stdout:(131/156): python3-more-itertools-8.12.0-2.el9. 236 kB/s | 79 kB 00:00 2024-05-08T10:52:48.656 INFO:teuthology.orchestra.run.smithi174.stdout:(132/156): python3-kubernetes-26.1.0-2.el9.noar 1.6 MB/s | 1.0 MB 00:00 2024-05-08T10:52:48.832 INFO:teuthology.orchestra.run.smithi174.stdout:(133/156): python3-natsort-7.1.1-5.el9.noarch.r 182 kB/s | 58 kB 00:00 2024-05-08T10:52:48.898 INFO:teuthology.orchestra.run.smithi174.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 68 kB/s | 16 kB 00:00 2024-05-08T10:52:49.007 INFO:teuthology.orchestra.run.smithi174.stdout:(135/156): python3-pecan-1.4.2-3.el9.noarch.rpm 583 kB/s | 272 kB 00:00 2024-05-08T10:52:49.149 INFO:teuthology.orchestra.run.smithi174.stdout:(136/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 283 kB/s | 90 kB 00:00 2024-05-08T10:52:49.182 INFO:teuthology.orchestra.run.smithi174.stdout:(137/156): python3-pyperclip-1.8.2-2.el9.noarch 99 kB/s | 28 kB 00:00 2024-05-08T10:52:49.249 INFO:teuthology.orchestra.run.smithi174.stdout:(138/156): python3-repoze-lru-0.7-16.el9.noarch 127 kB/s | 31 kB 00:00 2024-05-08T10:52:49.500 INFO:teuthology.orchestra.run.smithi174.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 186 kB/s | 59 kB 00:00 2024-05-08T10:52:49.525 INFO:teuthology.orchestra.run.smithi174.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 130 kB/s | 36 kB 00:00 2024-05-08T10:52:49.550 INFO:teuthology.orchestra.run.smithi174.stdout:(141/156): python3-routes-2.5.1-5.el9.noarch.rp 470 kB/s | 188 kB 00:00 2024-05-08T10:52:49.684 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction test succeeded. 2024-05-08T10:52:49.685 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction 2024-05-08T10:52:49.826 INFO:teuthology.orchestra.run.smithi174.stdout:(142/156): python3-typing-extensions-4.4.0-2.el 157 kB/s | 51 kB 00:00 2024-05-08T10:52:49.859 INFO:teuthology.orchestra.run.smithi174.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 291 kB/s | 90 kB 00:00 2024-05-08T10:52:50.026 INFO:teuthology.orchestra.run.smithi174.stdout:(144/156): python3-webob-1.8.7-6.el9.noarch.rpm 459 kB/s | 230 kB 00:00 2024-05-08T10:52:50.101 INFO:teuthology.orchestra.run.smithi174.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 82 kB/s | 20 kB 00:00 2024-05-08T10:52:50.393 INFO:teuthology.orchestra.run.smithi174.stdout:(146/156): python3-werkzeug-2.0.3-3.el9.1.noarc 753 kB/s | 427 kB 00:00 2024-05-08T10:52:50.427 INFO:teuthology.orchestra.run.smithi174.stdout:(147/156): re2-20211101-3.el9.x86_64.rpm 478 kB/s | 192 kB 00:00 2024-05-08T10:52:50.694 INFO:teuthology.orchestra.run.smithi174.stdout:(148/156): librbd1-19.0.0-1670.g1fb5d106.el9.x8 12 MB/s | 3.1 MB 00:00 2024-05-08T10:52:50.827 INFO:teuthology.orchestra.run.smithi174.stdout:(149/156): NetworkManager-1.47.5-1.el9.x86_64.r 17 MB/s | 2.3 MB 00:00 2024-05-08T10:52:50.861 INFO:teuthology.orchestra.run.smithi174.stdout:(150/156): thrift-0.15.0-2.el9.x86_64.rpm 2.1 MB/s | 1.6 MB 00:00 2024-05-08T10:52:50.911 INFO:teuthology.orchestra.run.smithi174.stdout:(151/156): NetworkManager-team-1.47.5-1.el9.x86 839 kB/s | 42 kB 00:00 2024-05-08T10:52:51.012 INFO:teuthology.orchestra.run.smithi174.stdout:(152/156): NetworkManager-libnm-1.47.5-1.el9.x8 9.9 MB/s | 1.8 MB 00:00 2024-05-08T10:52:51.041 INFO:teuthology.orchestra.run.smithi174.stdout:(153/156): NetworkManager-tui-1.47.5-1.el9.x86_ 1.9 MB/s | 248 kB 00:00 2024-05-08T10:52:51.146 INFO:teuthology.orchestra.run.smithi174.stdout:(154/156): librados2-19.0.0-1670.g1fb5d106.el9. 4.5 MB/s | 3.4 MB 00:00 2024-05-08T10:52:51.204 INFO:teuthology.orchestra.run.smithi174.stdout:(155/156): openssl-3.2.1-1.el9.x86_64.rpm 7.0 MB/s | 1.3 MB 00:00 2024-05-08T10:52:51.271 INFO:teuthology.orchestra.run.smithi174.stdout:(156/156): openssl-libs-3.2.1-1.el9.x86_64.rpm 10 MB/s | 2.4 MB 00:00 2024-05-08T10:52:51.275 INFO:teuthology.orchestra.run.smithi174.stdout:-------------------------------------------------------------------------------- 2024-05-08T10:52:51.275 INFO:teuthology.orchestra.run.smithi174.stdout:Total 6.6 MB/s | 220 MB 00:33 2024-05-08T10:52:52.499 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction check 2024-05-08T10:52:52.652 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction check succeeded. 2024-05-08T10:52:52.652 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction test 2024-05-08T10:52:54.764 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction test succeeded. 2024-05-08T10:52:54.765 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction 2024-05-08T10:52:55.988 INFO:teuthology.orchestra.run.smithi033.stdout: Preparing : 1/1 2024-05-08T10:52:56.054 INFO:teuthology.orchestra.run.smithi033.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/164 2024-05-08T10:52:56.092 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-05-08T10:52:56.148 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-05-08T10:52:56.188 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-05-08T10:52:56.213 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-05-08T10:52:56.271 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-05-08T10:52:56.619 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-05-08T10:52:56.722 INFO:teuthology.orchestra.run.smithi033.stdout: Upgrading : librados2-2:19.0.0-1670.g1fb5d106.el9.x86_64 8/164 2024-05-08T10:52:56.864 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: librados2-2:19.0.0-1670.g1fb5d106.el9.x86_64 8/164 2024-05-08T10:52:56.898 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libcephfs2-2:19.0.0-1670.g1fb5d106.el9.x86_64 9/164 2024-05-08T10:52:57.000 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: libcephfs2-2:19.0.0-1670.g1fb5d106.el9.x86_64 9/164 2024-05-08T10:52:57.028 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-rados-2:19.0.0-1670.g1fb5d106.el9.x86_64 10/164 2024-05-08T10:52:57.224 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/164 2024-05-08T10:52:57.284 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/164 2024-05-08T10:52:57.310 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libcephsqlite-2:19.0.0-1670.g1fb5d106.el9.x86_64 13/164 2024-05-08T10:52:57.416 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: libcephsqlite-2:19.0.0-1670.g1fb5d106.el9.x86_64 13/164 2024-05-08T10:52:57.461 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libradosstriper1-2:19.0.0-1670.g1fb5d106.el9.x86 14/164 2024-05-08T10:52:57.525 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: libradosstriper1-2:19.0.0-1670.g1fb5d106.el9.x86 14/164 2024-05-08T10:52:57.554 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-08T10:52:57.579 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-08T10:52:57.723 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-08T10:52:57.883 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-08T10:52:58.026 INFO:teuthology.orchestra.run.smithi033.stdout: Upgrading : NetworkManager-libnm-1:1.47.5-1.el9.x86_64 17/164 2024-05-08T10:52:58.086 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.5-1.el9.x86_64 17/164 2024-05-08T10:52:58.208 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-08T10:52:58.271 INFO:teuthology.orchestra.run.smithi033.stdout: Upgrading : NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-08T10:52:58.492 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-08T10:52:58.605 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : re2-1:20211101-3.el9.x86_64 19/164 2024-05-08T10:52:58.701 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-05-08T10:52:58.745 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-05-08T10:52:58.787 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-05-08T10:52:58.862 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-05-08T10:52:58.903 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-05-08T10:52:58.946 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 25/164 2024-05-08T10:52:58.979 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 26/164 2024-05-08T10:52:59.006 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : lua-5.4.4-4.el9.x86_64 27/164 2024-05-08T10:52:59.078 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 28/164 2024-05-08T10:52:59.138 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 29/164 2024-05-08T10:52:59.173 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 30/164 2024-05-08T10:52:59.211 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 31/164 2024-05-08T10:52:59.289 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 32/164 2024-05-08T10:52:59.322 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-ceph-common-2:19.0.0-1670.g1fb5d106.el9. 33/164 2024-05-08T10:52:59.366 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-ceph-argparse-2:19.0.0-1670.g1fb5d106.el 34/164 2024-05-08T10:52:59.394 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-cephfs-2:19.0.0-1670.g1fb5d106.el9.x86_6 35/164 2024-05-08T10:52:59.468 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 36/164 2024-05-08T10:52:59.526 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : luarocks-3.9.2-1.el9.noarch 37/164 2024-05-08T10:52:59.603 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 38/164 2024-05-08T10:52:59.749 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 39/164 2024-05-08T10:52:59.805 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 40/164 2024-05-08T10:53:00.359 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-rsa-4.9-2.el9.noarch 41/164 2024-05-08T10:53:00.442 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 42/164 2024-05-08T10:53:00.478 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 43/164 2024-05-08T10:53:00.522 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 44/164 2024-05-08T10:53:00.559 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : librados-devel-2:19.0.0-1670.g1fb5d106.el9.x86_6 45/164 2024-05-08T10:53:00.602 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 46/164 2024-05-08T10:53:00.772 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 47/164 2024-05-08T10:53:00.794 INFO:teuthology.orchestra.run.smithi174.stdout: Preparing : 1/1 2024-05-08T10:53:00.820 INFO:teuthology.orchestra.run.smithi033.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 48/164 2024-05-08T10:53:00.877 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 49/164 2024-05-08T10:53:00.897 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/164 2024-05-08T10:53:00.937 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-05-08T10:53:00.951 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 50/164 2024-05-08T10:53:00.987 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 51/164 2024-05-08T10:53:01.002 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-05-08T10:53:01.024 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 52/164 2024-05-08T10:53:01.042 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-05-08T10:53:01.068 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-05-08T10:53:01.071 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 53/164 2024-05-08T10:53:01.106 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 54/164 2024-05-08T10:53:01.120 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-05-08T10:53:01.151 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 55/164 2024-05-08T10:53:01.192 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 56/164 2024-05-08T10:53:01.335 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 57/164 2024-05-08T10:53:01.409 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 58/164 2024-05-08T10:53:01.444 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 59/164 2024-05-08T10:53:01.447 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-05-08T10:53:01.486 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 60/164 2024-05-08T10:53:01.552 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : librados2-2:19.0.0-1670.g1fb5d106.el9.x86_64 8/164 2024-05-08T10:53:01.584 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-05-08T10:53:01.620 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 62/164 2024-05-08T10:53:01.660 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-05-08T10:53:01.682 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: librados2-2:19.0.0-1670.g1fb5d106.el9.x86_64 8/164 2024-05-08T10:53:01.692 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-05-08T10:53:01.717 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-05-08T10:53:01.720 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libcephfs2-2:19.0.0-1670.g1fb5d106.el9.x86_64 9/164 2024-05-08T10:53:01.802 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-05-08T10:53:01.816 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: libcephfs2-2:19.0.0-1670.g1fb5d106.el9.x86_64 9/164 2024-05-08T10:53:01.850 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-rados-2:19.0.0-1670.g1fb5d106.el9.x86_64 10/164 2024-05-08T10:53:01.932 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-05-08T10:53:01.966 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-05-08T10:53:01.998 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-05-08T10:53:02.029 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-05-08T10:53:02.046 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/164 2024-05-08T10:53:02.068 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-05-08T10:53:02.105 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/164 2024-05-08T10:53:02.108 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-05-08T10:53:02.124 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libcephsqlite-2:19.0.0-1670.g1fb5d106.el9.x86_64 13/164 2024-05-08T10:53:02.137 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-05-08T10:53:02.172 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-05-08T10:53:02.205 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-05-08T10:53:02.228 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: libcephsqlite-2:19.0.0-1670.g1fb5d106.el9.x86_64 13/164 2024-05-08T10:53:02.248 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-05-08T10:53:02.250 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libradosstriper1-2:19.0.0-1670.g1fb5d106.el9.x86 14/164 2024-05-08T10:53:02.282 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-05-08T10:53:02.296 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: libradosstriper1-2:19.0.0-1670.g1fb5d106.el9.x86 14/164 2024-05-08T10:53:02.326 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-08T10:53:02.347 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-08T10:53:02.372 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-05-08T10:53:02.427 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-05-08T10:53:02.459 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-05-08T10:53:02.507 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-05-08T10:53:02.511 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-08T10:53:02.617 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-packaging-20.9-5.el9.noarch 82/164 2024-05-08T10:53:02.670 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/164 2024-05-08T10:53:02.693 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-08T10:53:02.815 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : NetworkManager-libnm-1:1.47.5-1.el9.x86_64 17/164 2024-05-08T10:53:02.866 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.5-1.el9.x86_64 17/164 2024-05-08T10:53:02.978 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-08T10:53:03.051 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-08T10:53:03.261 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-08T10:53:03.373 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : re2-1:20211101-3.el9.x86_64 19/164 2024-05-08T10:53:03.431 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/164 2024-05-08T10:53:03.468 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-05-08T10:53:03.491 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/164 2024-05-08T10:53:03.513 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-05-08T10:53:03.525 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/164 2024-05-08T10:53:03.557 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-05-08T10:53:03.622 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-05-08T10:53:03.627 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/164 2024-05-08T10:53:03.658 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-05-08T10:53:03.683 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 88/164 2024-05-08T10:53:03.700 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 25/164 2024-05-08T10:53:03.733 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 26/164 2024-05-08T10:53:03.761 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : lua-5.4.4-4.el9.x86_64 27/164 2024-05-08T10:53:03.773 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-05-08T10:53:03.818 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-05-08T10:53:03.828 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 28/164 2024-05-08T10:53:03.882 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 29/164 2024-05-08T10:53:03.914 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 30/164 2024-05-08T10:53:03.957 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 31/164 2024-05-08T10:53:04.001 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : openblas-0.3.21-2.el9.x86_64 91/164 2024-05-08T10:53:04.032 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 32/164 2024-05-08T10:53:04.032 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 92/164 2024-05-08T10:53:04.076 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-ceph-common-2:19.0.0-1670.g1fb5d106.el9. 33/164 2024-05-08T10:53:04.113 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-05-08T10:53:04.120 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-ceph-argparse-2:19.0.0-1670.g1fb5d106.el 34/164 2024-05-08T10:53:04.148 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-cephfs-2:19.0.0-1670.g1fb5d106.el9.x86_6 35/164 2024-05-08T10:53:04.217 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 36/164 2024-05-08T10:53:04.271 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : luarocks-3.9.2-1.el9.noarch 37/164 2024-05-08T10:53:04.345 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 38/164 2024-05-08T10:53:04.477 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 39/164 2024-05-08T10:53:04.532 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 40/164 2024-05-08T10:53:04.807 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-05-08T10:53:04.917 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-05-08T10:53:05.050 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-rsa-4.9-2.el9.noarch 41/164 2024-05-08T10:53:05.136 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 42/164 2024-05-08T10:53:05.165 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 43/164 2024-05-08T10:53:05.208 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 44/164 2024-05-08T10:53:05.246 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : librados-devel-2:19.0.0-1670.g1fb5d106.el9.x86_6 45/164 2024-05-08T10:53:05.288 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 46/164 2024-05-08T10:53:05.438 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 47/164 2024-05-08T10:53:05.481 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 48/164 2024-05-08T10:53:05.536 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 49/164 2024-05-08T10:53:05.608 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 50/164 2024-05-08T10:53:05.640 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 51/164 2024-05-08T10:53:05.677 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 52/164 2024-05-08T10:53:05.723 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 53/164 2024-05-08T10:53:05.760 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 54/164 2024-05-08T10:53:05.803 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 55/164 2024-05-08T10:53:05.845 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 56/164 2024-05-08T10:53:05.980 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 57/164 2024-05-08T10:53:06.028 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 58/164 2024-05-08T10:53:06.059 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 59/164 2024-05-08T10:53:06.103 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 60/164 2024-05-08T10:53:06.202 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-05-08T10:53:06.224 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 62/164 2024-05-08T10:53:06.260 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-05-08T10:53:06.270 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-05-08T10:53:06.306 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-05-08T10:53:06.330 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-05-08T10:53:06.345 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-05-08T10:53:06.365 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-05-08T10:53:06.389 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 99/164 2024-05-08T10:53:06.436 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-05-08T10:53:06.563 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-05-08T10:53:06.603 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-05-08T10:53:06.641 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-05-08T10:53:06.676 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-05-08T10:53:06.712 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-05-08T10:53:06.714 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-05-08T10:53:06.744 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-05-08T10:53:06.752 INFO:teuthology.orchestra.run.smithi033.stdout: Upgrading : librbd1-2:19.0.0-1670.g1fb5d106.el9.x86_64 101/164 2024-05-08T10:53:06.774 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-05-08T10:53:06.808 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-05-08T10:53:06.835 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: librbd1-2:19.0.0-1670.g1fb5d106.el9.x86_64 101/164 2024-05-08T10:53:06.842 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-05-08T10:53:06.865 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-rbd-2:19.0.0-1670.g1fb5d106.el9.x86_64 102/164 2024-05-08T10:53:06.883 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-05-08T10:53:06.902 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-05-08T10:53:06.917 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-05-08T10:53:07.004 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-05-08T10:53:07.051 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-05-08T10:53:07.087 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-05-08T10:53:07.134 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-05-08T10:53:07.232 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-packaging-20.9-5.el9.noarch 82/164 2024-05-08T10:53:07.280 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/164 2024-05-08T10:53:07.382 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-05-08T10:53:07.404 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : librgw2-2:19.0.0-1670.g1fb5d106.el9.x86_64 105/164 2024-05-08T10:53:07.459 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: librgw2-2:19.0.0-1670.g1fb5d106.el9.x86_64 105/164 2024-05-08T10:53:07.489 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-rgw-2:19.0.0-1670.g1fb5d106.el9.x86_64 106/164 2024-05-08T10:53:07.994 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/164 2024-05-08T10:53:08.044 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/164 2024-05-08T10:53:08.086 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/164 2024-05-08T10:53:08.184 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/164 2024-05-08T10:53:08.235 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 88/164 2024-05-08T10:53:08.322 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-05-08T10:53:08.362 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-05-08T10:53:08.530 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : openblas-0.3.21-2.el9.x86_64 91/164 2024-05-08T10:53:08.552 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 92/164 2024-05-08T10:53:08.630 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-05-08T10:53:09.275 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-05-08T10:53:09.391 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-05-08T10:53:09.783 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-common-2:19.0.0-1670.g1fb5d106.el9.x86_64 107/164 2024-05-08T10:53:09.819 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-common-2:19.0.0-1670.g1fb5d106.el9.x86_64 107/164 2024-05-08T10:53:10.392 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-common-2:19.0.0-1670.g1fb5d106.el9.x86_64 107/164 2024-05-08T10:53:10.430 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-base-2:19.0.0-1670.g1fb5d106.el9.x86_64 108/164 2024-05-08T10:53:10.524 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-base-2:19.0.0-1670.g1fb5d106.el9.x86_64 108/164 2024-05-08T10:53:10.524 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-08T10:53:10.524 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-08T10:53:10.524 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:53:10.565 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-selinux-2:19.0.0-1670.g1fb5d106.el9.x86_64 109/164 2024-05-08T10:53:10.626 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-05-08T10:53:10.697 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-05-08T10:53:10.724 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-05-08T10:53:10.758 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 99/164 2024-05-08T10:53:11.065 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-05-08T10:53:11.112 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : librbd1-2:19.0.0-1670.g1fb5d106.el9.x86_64 101/164 2024-05-08T10:53:11.190 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: librbd1-2:19.0.0-1670.g1fb5d106.el9.x86_64 101/164 2024-05-08T10:53:11.217 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-rbd-2:19.0.0-1670.g1fb5d106.el9.x86_64 102/164 2024-05-08T10:53:11.253 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-05-08T10:53:11.706 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-05-08T10:53:11.732 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : librgw2-2:19.0.0-1670.g1fb5d106.el9.x86_64 105/164 2024-05-08T10:53:11.802 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: librgw2-2:19.0.0-1670.g1fb5d106.el9.x86_64 105/164 2024-05-08T10:53:11.816 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-rgw-2:19.0.0-1670.g1fb5d106.el9.x86_64 106/164 2024-05-08T10:53:14.018 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-common-2:19.0.0-1670.g1fb5d106.el9.x86_64 107/164 2024-05-08T10:53:14.054 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-common-2:19.0.0-1670.g1fb5d106.el9.x86_64 107/164 2024-05-08T10:53:14.614 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-common-2:19.0.0-1670.g1fb5d106.el9.x86_64 107/164 2024-05-08T10:53:14.649 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-base-2:19.0.0-1670.g1fb5d106.el9.x86_64 108/164 2024-05-08T10:53:14.739 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-base-2:19.0.0-1670.g1fb5d106.el9.x86_64 108/164 2024-05-08T10:53:14.739 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-08T10:53:14.739 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-08T10:53:14.739 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-08T10:53:14.775 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-selinux-2:19.0.0-1670.g1fb5d106.el9.x86_64 109/164 2024-05-08T10:53:22.609 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-selinux-2:19.0.0-1670.g1fb5d106.el9.x86_64 109/164 2024-05-08T10:53:22.609 INFO:teuthology.orchestra.run.smithi033.stdout:skipping the directory /sys 2024-05-08T10:53:22.609 INFO:teuthology.orchestra.run.smithi033.stdout:skipping the directory /proc 2024-05-08T10:53:22.609 INFO:teuthology.orchestra.run.smithi033.stdout:skipping the directory /mnt 2024-05-08T10:53:22.609 INFO:teuthology.orchestra.run.smithi033.stdout:skipping the directory /var/tmp 2024-05-08T10:53:22.609 INFO:teuthology.orchestra.run.smithi033.stdout:skipping the directory /home 2024-05-08T10:53:22.609 INFO:teuthology.orchestra.run.smithi033.stdout:skipping the directory /root 2024-05-08T10:53:22.609 INFO:teuthology.orchestra.run.smithi033.stdout:skipping the directory /tmp 2024-05-08T10:53:22.610 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:53:22.806 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-volume-2:19.0.0-1670.g1fb5d106.el9.noarch 110/164 2024-05-08T10:53:22.823 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-volume-2:19.0.0-1670.g1fb5d106.el9.noarch 110/164 2024-05-08T10:53:22.824 INFO:teuthology.orchestra.run.smithi033.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T10:53:22.824 INFO:teuthology.orchestra.run.smithi033.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-08T10:53:22.824 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:53:24.360 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-osd-2:19.0.0-1670.g1fb5d106.el9.x86_64 111/164 2024-05-08T10:53:24.388 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-osd-2:19.0.0-1670.g1fb5d106.el9.x86_64 111/164 2024-05-08T10:53:24.389 INFO:teuthology.orchestra.run.smithi033.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T10:53:24.389 INFO:teuthology.orchestra.run.smithi033.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-08T10:53:24.389 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-08T10:53:24.389 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-08T10:53:24.389 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:53:24.602 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mds-2:19.0.0-1670.g1fb5d106.el9.x86_64 112/164 2024-05-08T10:53:24.627 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-mds-2:19.0.0-1670.g1fb5d106.el9.x86_64 112/164 2024-05-08T10:53:24.627 INFO:teuthology.orchestra.run.smithi033.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T10:53:24.627 INFO:teuthology.orchestra.run.smithi033.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-08T10:53:24.627 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-08T10:53:24.628 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-08T10:53:24.628 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:53:25.094 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mon-2:19.0.0-1670.g1fb5d106.el9.x86_64 113/164 2024-05-08T10:53:25.120 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-mon-2:19.0.0-1670.g1fb5d106.el9.x86_64 113/164 2024-05-08T10:53:25.120 INFO:teuthology.orchestra.run.smithi033.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T10:53:25.120 INFO:teuthology.orchestra.run.smithi033.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-08T10:53:25.120 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-08T10:53:25.120 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-08T10:53:25.120 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:53:25.233 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-05-08T10:53:25.292 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-05-08T10:53:25.355 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-05-08T10:53:25.552 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-05-08T10:53:25.604 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-05-08T10:53:25.686 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-05-08T10:53:25.775 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-05-08T10:53:25.927 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-05-08T10:53:25.988 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-05-08T10:53:26.020 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-05-08T10:53:26.047 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : fuse-2.9.9-15.el9.x86_64 124/164 2024-05-08T10:53:26.485 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: cephadm-2:19.0.0-1670.g1fb5d106.el9.noarch 125/164 2024-05-08T10:53:26.521 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : cephadm-2:19.0.0-1670.g1fb5d106.el9.noarch 125/164 2024-05-08T10:53:26.553 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-1670.g1fb5d106.e 126/164 2024-05-08T10:53:26.616 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-1670.g1fb5d106. 127/164 2024-05-08T10:53:26.628 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-selinux-2:19.0.0-1670.g1fb5d106.el9.x86_64 109/164 2024-05-08T10:53:26.628 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /sys 2024-05-08T10:53:26.628 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /proc 2024-05-08T10:53:26.628 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /mnt 2024-05-08T10:53:26.628 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /var/tmp 2024-05-08T10:53:26.629 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /home 2024-05-08T10:53:26.629 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /root 2024-05-08T10:53:26.629 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /tmp 2024-05-08T10:53:26.629 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-08T10:53:26.643 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-1670.g1fb5d106.el9.noa 128/164 2024-05-08T10:53:26.789 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-volume-2:19.0.0-1670.g1fb5d106.el9.noarch 110/164 2024-05-08T10:53:26.806 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-volume-2:19.0.0-1670.g1fb5d106.el9.noarch 110/164 2024-05-08T10:53:26.806 INFO:teuthology.orchestra.run.smithi174.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T10:53:26.806 INFO:teuthology.orchestra.run.smithi174.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-08T10:53:26.806 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-08T10:53:26.887 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-1670.g1fb5d106.el9.noa 128/164 2024-05-08T10:53:26.919 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-1670.g1fb5d106.el9.n 129/164 2024-05-08T10:53:27.934 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-1670.g1fb5d106.el9.n 129/164 2024-05-08T10:53:27.961 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-1670.g1fb 130/164 2024-05-08T10:53:28.071 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-1670.g1fb 130/164 2024-05-08T10:53:28.240 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-1670.g1fb5d106.el 131/164 2024-05-08T10:53:28.272 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mgr-2:19.0.0-1670.g1fb5d106.el9.x86_64 132/164 2024-05-08T10:53:28.297 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-mgr-2:19.0.0-1670.g1fb5d106.el9.x86_64 132/164 2024-05-08T10:53:28.297 INFO:teuthology.orchestra.run.smithi033.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T10:53:28.297 INFO:teuthology.orchestra.run.smithi033.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-08T10:53:28.297 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-08T10:53:28.297 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-08T10:53:28.297 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:53:28.309 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-osd-2:19.0.0-1670.g1fb5d106.el9.x86_64 111/164 2024-05-08T10:53:28.336 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-osd-2:19.0.0-1670.g1fb5d106.el9.x86_64 111/164 2024-05-08T10:53:28.336 INFO:teuthology.orchestra.run.smithi174.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T10:53:28.336 INFO:teuthology.orchestra.run.smithi174.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-08T10:53:28.336 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-08T10:53:28.336 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-08T10:53:28.336 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-08T10:53:28.348 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mgr-rook-2:19.0.0-1670.g1fb5d106.el9.noarch 133/164 2024-05-08T10:53:28.360 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-1670.g1fb5d106.el9.noarch 133/164 2024-05-08T10:53:28.461 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-2:19.0.0-1670.g1fb5d106.el9.x86_64 134/164 2024-05-08T10:53:28.517 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-fuse-2:19.0.0-1670.g1fb5d106.el9.x86_64 135/164 2024-05-08T10:53:28.543 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mds-2:19.0.0-1670.g1fb5d106.el9.x86_64 112/164 2024-05-08T10:53:28.566 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-mds-2:19.0.0-1670.g1fb5d106.el9.x86_64 112/164 2024-05-08T10:53:28.567 INFO:teuthology.orchestra.run.smithi174.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T10:53:28.567 INFO:teuthology.orchestra.run.smithi174.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-08T10:53:28.567 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-08T10:53:28.567 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-08T10:53:28.567 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-08T10:53:29.010 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mon-2:19.0.0-1670.g1fb5d106.el9.x86_64 113/164 2024-05-08T10:53:29.033 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-mon-2:19.0.0-1670.g1fb5d106.el9.x86_64 113/164 2024-05-08T10:53:29.033 INFO:teuthology.orchestra.run.smithi174.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T10:53:29.034 INFO:teuthology.orchestra.run.smithi174.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-08T10:53:29.034 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-08T10:53:29.034 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-08T10:53:29.034 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-08T10:53:29.140 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-05-08T10:53:29.189 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-05-08T10:53:29.244 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-05-08T10:53:29.417 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libtool-2.4.6-45.el9.x86_64 136/164 2024-05-08T10:53:29.431 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-05-08T10:53:29.459 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-radosgw-2:19.0.0-1670.g1fb5d106.el9.x86_64 137/164 2024-05-08T10:53:29.477 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-05-08T10:53:29.484 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-1670.g1fb5d106.el9.x86_64 137/164 2024-05-08T10:53:29.484 INFO:teuthology.orchestra.run.smithi033.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T10:53:29.485 INFO:teuthology.orchestra.run.smithi033.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-08T10:53:29.485 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-08T10:53:29.485 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-08T10:53:29.485 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:53:29.526 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-1670.g1fb5d 138/164 2024-05-08T10:53:29.551 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-1670.g1fb5d 138/164 2024-05-08T10:53:29.551 INFO:teuthology.orchestra.run.smithi033.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T10:53:29.551 INFO:teuthology.orchestra.run.smithi033.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-08T10:53:29.551 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:53:29.555 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-05-08T10:53:29.602 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : cephfs-mirror-2:19.0.0-1670.g1fb5d106.el9.x86_64 139/164 2024-05-08T10:53:29.627 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-1670.g1fb5d106.el9.x86_64 139/164 2024-05-08T10:53:29.627 INFO:teuthology.orchestra.run.smithi033.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T10:53:29.627 INFO:teuthology.orchestra.run.smithi033.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-05-08T10:53:29.627 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-08T10:53:29.627 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-08T10:53:29.628 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:53:29.643 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-05-08T10:53:29.784 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-05-08T10:53:29.830 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-05-08T10:53:29.868 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-05-08T10:53:29.895 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : fuse-2.9.9-15.el9.x86_64 124/164 2024-05-08T10:53:29.953 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : rbd-mirror-2:19.0.0-1670.g1fb5d106.el9.x86_64 140/164 2024-05-08T10:53:29.978 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: rbd-mirror-2:19.0.0-1670.g1fb5d106.el9.x86_64 140/164 2024-05-08T10:53:29.978 INFO:teuthology.orchestra.run.smithi033.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T10:53:29.978 INFO:teuthology.orchestra.run.smithi033.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-08T10:53:29.978 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-08T10:53:29.978 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-08T10:53:29.979 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:53:30.364 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: cephadm-2:19.0.0-1670.g1fb5d106.el9.noarch 125/164 2024-05-08T10:53:30.393 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : cephadm-2:19.0.0-1670.g1fb5d106.el9.noarch 125/164 2024-05-08T10:53:30.424 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-1670.g1fb5d106.e 126/164 2024-05-08T10:53:30.485 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-1670.g1fb5d106. 127/164 2024-05-08T10:53:30.516 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-1670.g1fb5d106.el9.noa 128/164 2024-05-08T10:53:30.746 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-1670.g1fb5d106.el9.noa 128/164 2024-05-08T10:53:30.775 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-1670.g1fb5d106.el9.n 129/164 2024-05-08T10:53:31.739 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-1670.g1fb5d106.el9.n 129/164 2024-05-08T10:53:31.775 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-1670.g1fb 130/164 2024-05-08T10:53:31.878 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-1670.g1fb 130/164 2024-05-08T10:53:32.038 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-1670.g1fb5d106.el 131/164 2024-05-08T10:53:32.069 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mgr-2:19.0.0-1670.g1fb5d106.el9.x86_64 132/164 2024-05-08T10:53:32.094 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-mgr-2:19.0.0-1670.g1fb5d106.el9.x86_64 132/164 2024-05-08T10:53:32.094 INFO:teuthology.orchestra.run.smithi174.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T10:53:32.094 INFO:teuthology.orchestra.run.smithi174.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-08T10:53:32.094 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-08T10:53:32.094 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-08T10:53:32.094 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-08T10:53:32.161 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mgr-rook-2:19.0.0-1670.g1fb5d106.el9.noarch 133/164 2024-05-08T10:53:32.173 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-1670.g1fb5d106.el9.noarch 133/164 2024-05-08T10:53:32.270 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-2:19.0.0-1670.g1fb5d106.el9.x86_64 134/164 2024-05-08T10:53:32.323 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-fuse-2:19.0.0-1670.g1fb5d106.el9.x86_64 135/164 2024-05-08T10:53:33.175 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libtool-2.4.6-45.el9.x86_64 136/164 2024-05-08T10:53:33.205 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-radosgw-2:19.0.0-1670.g1fb5d106.el9.x86_64 137/164 2024-05-08T10:53:33.230 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-1670.g1fb5d106.el9.x86_64 137/164 2024-05-08T10:53:33.230 INFO:teuthology.orchestra.run.smithi174.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T10:53:33.230 INFO:teuthology.orchestra.run.smithi174.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-08T10:53:33.230 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-08T10:53:33.230 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-08T10:53:33.230 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-08T10:53:33.273 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-1670.g1fb5d 138/164 2024-05-08T10:53:33.296 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-1670.g1fb5d 138/164 2024-05-08T10:53:33.296 INFO:teuthology.orchestra.run.smithi174.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T10:53:33.297 INFO:teuthology.orchestra.run.smithi174.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-08T10:53:33.297 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-08T10:53:33.348 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : cephfs-mirror-2:19.0.0-1670.g1fb5d106.el9.x86_64 139/164 2024-05-08T10:53:33.372 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-1670.g1fb5d106.el9.x86_64 139/164 2024-05-08T10:53:33.372 INFO:teuthology.orchestra.run.smithi174.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T10:53:33.372 INFO:teuthology.orchestra.run.smithi174.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-05-08T10:53:33.372 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-08T10:53:33.372 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-08T10:53:33.372 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-08T10:53:33.674 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : rbd-mirror-2:19.0.0-1670.g1fb5d106.el9.x86_64 140/164 2024-05-08T10:53:33.698 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: rbd-mirror-2:19.0.0-1670.g1fb5d106.el9.x86_64 140/164 2024-05-08T10:53:33.698 INFO:teuthology.orchestra.run.smithi174.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T10:53:33.698 INFO:teuthology.orchestra.run.smithi174.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-08T10:53:33.698 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-08T10:53:33.698 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-08T10:53:33.698 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-08T10:53:34.715 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-test-2:19.0.0-1670.g1fb5d106.el9.x86_64 141/164 2024-05-08T10:53:34.756 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : rbd-fuse-2:19.0.0-1670.g1fb5d106.el9.x86_64 142/164 2024-05-08T10:53:34.799 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : rbd-nbd-2:19.0.0-1670.g1fb5d106.el9.x86_64 143/164 2024-05-08T10:53:34.829 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 144/164 2024-05-08T10:53:34.857 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 145/164 2024-05-08T10:53:35.056 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : cephfs-shell-2:19.0.0-1670.g1fb5d106.el9.x86_64 146/164 2024-05-08T10:53:35.103 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 147/164 2024-05-08T10:53:35.133 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libcephfs-devel-2:19.0.0-1670.g1fb5d106.el9.x86_ 148/164 2024-05-08T10:53:35.193 INFO:teuthology.orchestra.run.smithi033.stdout: Upgrading : NetworkManager-team-1:1.47.5-1.el9.x86_64 149/164 2024-05-08T10:53:35.234 INFO:teuthology.orchestra.run.smithi033.stdout: Upgrading : NetworkManager-tui-1:1.47.5-1.el9.x86_64 150/164 2024-05-08T10:53:35.859 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-08T10:53:35.899 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-08T10:53:35.920 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-08T10:53:36.822 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : cephfs-top-2:19.0.0-1670.g1fb5d106.el9.noarch 152/164 2024-05-08T10:53:36.913 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 153/164 2024-05-08T10:53:36.961 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-05-08T10:53:37.052 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-05-08T10:53:37.082 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-05-08T10:53:37.109 INFO:teuthology.orchestra.run.smithi033.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 157/164 2024-05-08T10:53:37.109 INFO:teuthology.orchestra.run.smithi033.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-08T10:53:37.185 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-08T10:53:37.218 INFO:teuthology.orchestra.run.smithi033.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 159/164 2024-05-08T10:53:37.218 INFO:teuthology.orchestra.run.smithi033.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-08T10:53:37.286 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-08T10:53:37.311 INFO:teuthology.orchestra.run.smithi033.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 161/164 2024-05-08T10:53:37.317 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-08T10:53:37.317 INFO:teuthology.orchestra.run.smithi033.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-08T10:53:37.504 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-08T10:53:37.505 INFO:teuthology.orchestra.run.smithi033.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-08T10:53:37.589 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-08T10:53:37.665 INFO:teuthology.orchestra.run.smithi033.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-08T10:53:38.160 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-test-2:19.0.0-1670.g1fb5d106.el9.x86_64 141/164 2024-05-08T10:53:38.201 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : rbd-fuse-2:19.0.0-1670.g1fb5d106.el9.x86_64 142/164 2024-05-08T10:53:38.251 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : rbd-nbd-2:19.0.0-1670.g1fb5d106.el9.x86_64 143/164 2024-05-08T10:53:38.291 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 144/164 2024-05-08T10:53:38.318 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 145/164 2024-05-08T10:53:38.506 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : cephfs-shell-2:19.0.0-1670.g1fb5d106.el9.x86_64 146/164 2024-05-08T10:53:38.547 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 147/164 2024-05-08T10:53:38.578 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libcephfs-devel-2:19.0.0-1670.g1fb5d106.el9.x86_ 148/164 2024-05-08T10:53:38.607 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : NetworkManager-team-1:1.47.5-1.el9.x86_64 149/164 2024-05-08T10:53:38.653 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : NetworkManager-tui-1:1.47.5-1.el9.x86_64 150/164 2024-05-08T10:53:39.267 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-08T10:53:39.301 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-08T10:53:39.321 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-08T10:53:40.152 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : cephfs-top-2:19.0.0-1670.g1fb5d106.el9.noarch 152/164 2024-05-08T10:53:40.247 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 153/164 2024-05-08T10:53:40.292 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-05-08T10:53:40.395 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-05-08T10:53:40.425 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-05-08T10:53:40.451 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 157/164 2024-05-08T10:53:40.451 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-08T10:53:40.518 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-08T10:53:40.551 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 159/164 2024-05-08T10:53:40.551 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-08T10:53:40.636 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-08T10:53:40.660 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 161/164 2024-05-08T10:53:40.666 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-08T10:53:40.667 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-08T10:53:40.846 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-08T10:53:40.846 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-08T10:53:40.930 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-08T10:53:40.994 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-08T10:53:42.713 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-08T10:53:42.713 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-2:19.0.0-1670.g1fb5d106.el9.x86_64 1/164 2024-05-08T10:53:42.713 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-base-2:19.0.0-1670.g1fb5d106.el9.x86_64 2/164 2024-05-08T10:53:42.713 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-common-2:19.0.0-1670.g1fb5d106.el9.x86_64 3/164 2024-05-08T10:53:42.713 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-fuse-2:19.0.0-1670.g1fb5d106.el9.x86_64 4/164 2024-05-08T10:53:42.713 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-1670.g1fb5d 5/164 2024-05-08T10:53:42.713 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mds-2:19.0.0-1670.g1fb5d106.el9.x86_64 6/164 2024-05-08T10:53:42.714 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mgr-2:19.0.0-1670.g1fb5d106.el9.x86_64 7/164 2024-05-08T10:53:42.714 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mon-2:19.0.0-1670.g1fb5d106.el9.x86_64 8/164 2024-05-08T10:53:42.714 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-osd-2:19.0.0-1670.g1fb5d106.el9.x86_64 9/164 2024-05-08T10:53:42.714 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-radosgw-2:19.0.0-1670.g1fb5d106.el9.x86_64 10/164 2024-05-08T10:53:42.714 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-selinux-2:19.0.0-1670.g1fb5d106.el9.x86_64 11/164 2024-05-08T10:53:42.714 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-test-2:19.0.0-1670.g1fb5d106.el9.x86_64 12/164 2024-05-08T10:53:42.714 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : cephfs-mirror-2:19.0.0-1670.g1fb5d106.el9.x86_64 13/164 2024-05-08T10:53:42.714 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : cephfs-shell-2:19.0.0-1670.g1fb5d106.el9.x86_64 14/164 2024-05-08T10:53:42.714 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libcephfs-devel-2:19.0.0-1670.g1fb5d106.el9.x86_ 15/164 2024-05-08T10:53:42.714 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libcephfs2-2:19.0.0-1670.g1fb5d106.el9.x86_64 16/164 2024-05-08T10:53:42.714 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libcephsqlite-2:19.0.0-1670.g1fb5d106.el9.x86_64 17/164 2024-05-08T10:53:42.714 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librados-devel-2:19.0.0-1670.g1fb5d106.el9.x86_6 18/164 2024-05-08T10:53:42.714 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libradosstriper1-2:19.0.0-1670.g1fb5d106.el9.x86 19/164 2024-05-08T10:53:42.714 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librgw2-2:19.0.0-1670.g1fb5d106.el9.x86_64 20/164 2024-05-08T10:53:42.715 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-ceph-argparse-2:19.0.0-1670.g1fb5d106.el 21/164 2024-05-08T10:53:42.715 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-ceph-common-2:19.0.0-1670.g1fb5d106.el9. 22/164 2024-05-08T10:53:42.715 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-cephfs-2:19.0.0-1670.g1fb5d106.el9.x86_6 23/164 2024-05-08T10:53:42.715 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-rados-2:19.0.0-1670.g1fb5d106.el9.x86_64 24/164 2024-05-08T10:53:42.715 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-rbd-2:19.0.0-1670.g1fb5d106.el9.x86_64 25/164 2024-05-08T10:53:42.715 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-rgw-2:19.0.0-1670.g1fb5d106.el9.x86_64 26/164 2024-05-08T10:53:42.715 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : rbd-fuse-2:19.0.0-1670.g1fb5d106.el9.x86_64 27/164 2024-05-08T10:53:42.728 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : rbd-mirror-2:19.0.0-1670.g1fb5d106.el9.x86_64 28/164 2024-05-08T10:53:42.728 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : rbd-nbd-2:19.0.0-1670.g1fb5d106.el9.x86_64 29/164 2024-05-08T10:53:42.728 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-1670.g1fb5d106. 30/164 2024-05-08T10:53:42.728 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-1670.g1fb5d106.el9.noa 31/164 2024-05-08T10:53:42.728 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-1670.g1fb5d106.el9.n 32/164 2024-05-08T10:53:42.728 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-1670.g1fb 33/164 2024-05-08T10:53:42.728 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-1670.g1fb5d106.el 34/164 2024-05-08T10:53:42.729 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mgr-rook-2:19.0.0-1670.g1fb5d106.el9.noarch 35/164 2024-05-08T10:53:42.729 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-1670.g1fb5d106.e 36/164 2024-05-08T10:53:42.729 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-volume-2:19.0.0-1670.g1fb5d106.el9.noarch 37/164 2024-05-08T10:53:42.729 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : cephadm-2:19.0.0-1670.g1fb5d106.el9.noarch 38/164 2024-05-08T10:53:42.729 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : cephfs-top-2:19.0.0-1670.g1fb5d106.el9.noarch 39/164 2024-05-08T10:53:42.729 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/164 2024-05-08T10:53:42.729 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/164 2024-05-08T10:53:42.729 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/164 2024-05-08T10:53:42.729 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-05-08T10:53:42.729 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-05-08T10:53:42.729 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-05-08T10:53:42.729 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-05-08T10:53:42.729 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-05-08T10:53:42.729 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/164 2024-05-08T10:53:42.730 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-05-08T10:53:42.730 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-05-08T10:53:42.730 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-05-08T10:53:42.730 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/164 2024-05-08T10:53:42.730 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-05-08T10:53:42.730 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-05-08T10:53:42.730 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-05-08T10:53:42.730 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-05-08T10:53:42.730 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-05-08T10:53:42.730 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-05-08T10:53:42.730 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-05-08T10:53:42.730 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-05-08T10:53:42.730 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/164 2024-05-08T10:53:42.731 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/164 2024-05-08T10:53:42.731 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-05-08T10:53:42.731 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-05-08T10:53:42.731 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-05-08T10:53:42.731 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/164 2024-05-08T10:53:42.731 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/164 2024-05-08T10:53:42.731 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/164 2024-05-08T10:53:42.731 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/164 2024-05-08T10:53:42.731 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/164 2024-05-08T10:53:42.731 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/164 2024-05-08T10:53:42.731 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/164 2024-05-08T10:53:42.731 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-05-08T10:53:42.732 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-05-08T10:53:42.732 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-05-08T10:53:42.732 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/164 2024-05-08T10:53:42.732 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/164 2024-05-08T10:53:42.732 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/164 2024-05-08T10:53:42.732 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/164 2024-05-08T10:53:42.732 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/164 2024-05-08T10:53:42.732 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/164 2024-05-08T10:53:42.732 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/164 2024-05-08T10:53:42.732 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/164 2024-05-08T10:53:42.732 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/164 2024-05-08T10:53:42.732 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/164 2024-05-08T10:53:42.732 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/164 2024-05-08T10:53:42.733 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/164 2024-05-08T10:53:42.733 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/164 2024-05-08T10:53:42.733 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/164 2024-05-08T10:53:42.733 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/164 2024-05-08T10:53:42.733 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/164 2024-05-08T10:53:42.733 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/164 2024-05-08T10:53:42.733 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/164 2024-05-08T10:53:42.733 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/164 2024-05-08T10:53:42.733 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/164 2024-05-08T10:53:42.733 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/164 2024-05-08T10:53:42.733 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/164 2024-05-08T10:53:42.733 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/164 2024-05-08T10:53:42.734 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/164 2024-05-08T10:53:42.734 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/164 2024-05-08T10:53:42.734 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/164 2024-05-08T10:53:42.734 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/164 2024-05-08T10:53:42.734 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/164 2024-05-08T10:53:42.734 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/164 2024-05-08T10:53:42.734 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/164 2024-05-08T10:53:42.734 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/164 2024-05-08T10:53:42.734 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/164 2024-05-08T10:53:42.734 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 108/164 2024-05-08T10:53:42.734 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 109/164 2024-05-08T10:53:42.734 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/164 2024-05-08T10:53:42.734 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/164 2024-05-08T10:53:42.734 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/164 2024-05-08T10:53:42.735 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 113/164 2024-05-08T10:53:42.735 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/164 2024-05-08T10:53:42.735 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/164 2024-05-08T10:53:42.735 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/164 2024-05-08T10:53:42.735 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/164 2024-05-08T10:53:42.735 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/164 2024-05-08T10:53:42.735 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/164 2024-05-08T10:53:42.735 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/164 2024-05-08T10:53:42.735 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/164 2024-05-08T10:53:42.735 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/164 2024-05-08T10:53:42.735 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-05-08T10:53:42.735 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-05-08T10:53:42.736 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-05-08T10:53:42.736 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-05-08T10:53:42.736 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-05-08T10:53:42.736 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-05-08T10:53:42.736 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-05-08T10:53:42.736 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-05-08T10:53:42.736 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-05-08T10:53:42.736 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-05-08T10:53:42.736 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-05-08T10:53:42.736 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-05-08T10:53:42.736 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-05-08T10:53:42.737 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-05-08T10:53:42.737 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-05-08T10:53:42.737 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-05-08T10:53:42.737 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-05-08T10:53:42.737 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-05-08T10:53:42.737 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-05-08T10:53:42.737 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/164 2024-05-08T10:53:42.737 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/164 2024-05-08T10:53:42.738 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-05-08T10:53:42.738 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-05-08T10:53:42.738 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-05-08T10:53:42.738 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/164 2024-05-08T10:53:42.738 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-05-08T10:53:42.738 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librados2-2:19.0.0-1670.g1fb5d106.el9.x86_64 149/164 2024-05-08T10:53:42.739 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-05-08T10:53:42.739 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librbd1-2:19.0.0-1670.g1fb5d106.el9.x86_64 151/164 2024-05-08T10:53:42.739 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-05-08T10:53:42.739 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : NetworkManager-1:1.47.5-1.el9.x86_64 153/164 2024-05-08T10:53:42.739 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/164 2024-05-08T10:53:42.739 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : NetworkManager-libnm-1:1.47.5-1.el9.x86_64 155/164 2024-05-08T10:53:42.739 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/164 2024-05-08T10:53:42.740 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : NetworkManager-team-1:1.47.5-1.el9.x86_64 157/164 2024-05-08T10:53:42.740 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/164 2024-05-08T10:53:42.740 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : NetworkManager-tui-1:1.47.5-1.el9.x86_64 159/164 2024-05-08T10:53:42.740 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/164 2024-05-08T10:53:42.740 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 161/164 2024-05-08T10:53:42.740 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 162/164 2024-05-08T10:53:42.740 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 163/164 2024-05-08T10:53:45.165 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-08T10:53:45.165 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:53:45.165 INFO:teuthology.orchestra.run.smithi033.stdout:Upgraded: 2024-05-08T10:53:45.165 INFO:teuthology.orchestra.run.smithi033.stdout: NetworkManager-1:1.47.5-1.el9.x86_64 2024-05-08T10:53:45.166 INFO:teuthology.orchestra.run.smithi033.stdout: NetworkManager-libnm-1:1.47.5-1.el9.x86_64 2024-05-08T10:53:45.166 INFO:teuthology.orchestra.run.smithi033.stdout: NetworkManager-team-1:1.47.5-1.el9.x86_64 2024-05-08T10:53:45.166 INFO:teuthology.orchestra.run.smithi033.stdout: NetworkManager-tui-1:1.47.5-1.el9.x86_64 2024-05-08T10:53:45.166 INFO:teuthology.orchestra.run.smithi033.stdout: librados2-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-05-08T10:53:45.166 INFO:teuthology.orchestra.run.smithi033.stdout: librbd1-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-05-08T10:53:45.166 INFO:teuthology.orchestra.run.smithi033.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-05-08T10:53:45.166 INFO:teuthology.orchestra.run.smithi033.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-05-08T10:53:45.166 INFO:teuthology.orchestra.run.smithi033.stdout:Installed: 2024-05-08T10:53:45.166 INFO:teuthology.orchestra.run.smithi033.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-08T10:53:45.166 INFO:teuthology.orchestra.run.smithi033.stdout: automake-1.16.2-8.el9.noarch 2024-05-08T10:53:45.166 INFO:teuthology.orchestra.run.smithi033.stdout: bison-3.7.4-5.el9.x86_64 2024-05-08T10:53:45.166 INFO:teuthology.orchestra.run.smithi033.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-08T10:53:45.167 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-05-08T10:53:45.167 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-base-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-05-08T10:53:45.167 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-common-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-05-08T10:53:45.167 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-fuse-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-05-08T10:53:45.167 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-grafana-dashboards-2:19.0.0-1670.g1fb5d106.el9.noarch 2024-05-08T10:53:45.167 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-immutable-object-cache-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-05-08T10:53:45.167 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mds-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-05-08T10:53:45.167 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-05-08T10:53:45.167 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-cephadm-2:19.0.0-1670.g1fb5d106.el9.noarch 2024-05-08T10:53:45.167 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-dashboard-2:19.0.0-1670.g1fb5d106.el9.noarch 2024-05-08T10:53:45.167 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-diskprediction-local-2:19.0.0-1670.g1fb5d106.el9.noarch 2024-05-08T10:53:45.167 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-modules-core-2:19.0.0-1670.g1fb5d106.el9.noarch 2024-05-08T10:53:45.167 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-rook-2:19.0.0-1670.g1fb5d106.el9.noarch 2024-05-08T10:53:45.167 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mon-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-05-08T10:53:45.168 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-osd-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-05-08T10:53:45.168 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-prometheus-alerts-2:19.0.0-1670.g1fb5d106.el9.noarch 2024-05-08T10:53:45.168 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-radosgw-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-05-08T10:53:45.168 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-selinux-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-05-08T10:53:45.168 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-test-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-05-08T10:53:45.168 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-volume-2:19.0.0-1670.g1fb5d106.el9.noarch 2024-05-08T10:53:45.168 INFO:teuthology.orchestra.run.smithi033.stdout: cephadm-2:19.0.0-1670.g1fb5d106.el9.noarch 2024-05-08T10:53:45.168 INFO:teuthology.orchestra.run.smithi033.stdout: cephfs-mirror-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-05-08T10:53:45.168 INFO:teuthology.orchestra.run.smithi033.stdout: cephfs-shell-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-05-08T10:53:45.168 INFO:teuthology.orchestra.run.smithi033.stdout: cephfs-top-2:19.0.0-1670.g1fb5d106.el9.noarch 2024-05-08T10:53:45.168 INFO:teuthology.orchestra.run.smithi033.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-05-08T10:53:45.168 INFO:teuthology.orchestra.run.smithi033.stdout: flex-2.6.4-9.el9.x86_64 2024-05-08T10:53:45.168 INFO:teuthology.orchestra.run.smithi033.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-08T10:53:45.168 INFO:teuthology.orchestra.run.smithi033.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-08T10:53:45.169 INFO:teuthology.orchestra.run.smithi033.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-08T10:53:45.169 INFO:teuthology.orchestra.run.smithi033.stdout: fuse-2.9.9-15.el9.x86_64 2024-05-08T10:53:45.169 INFO:teuthology.orchestra.run.smithi033.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-08T10:53:45.169 INFO:teuthology.orchestra.run.smithi033.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-08T10:53:45.169 INFO:teuthology.orchestra.run.smithi033.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-05-08T10:53:45.169 INFO:teuthology.orchestra.run.smithi033.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-08T10:53:45.169 INFO:teuthology.orchestra.run.smithi033.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-08T10:53:45.169 INFO:teuthology.orchestra.run.smithi033.stdout: libcephfs-devel-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-05-08T10:53:45.169 INFO:teuthology.orchestra.run.smithi033.stdout: libcephfs2-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-05-08T10:53:45.169 INFO:teuthology.orchestra.run.smithi033.stdout: libcephsqlite-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-05-08T10:53:45.169 INFO:teuthology.orchestra.run.smithi033.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-08T10:53:45.169 INFO:teuthology.orchestra.run.smithi033.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-08T10:53:45.169 INFO:teuthology.orchestra.run.smithi033.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-08T10:53:45.170 INFO:teuthology.orchestra.run.smithi033.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-08T10:53:45.170 INFO:teuthology.orchestra.run.smithi033.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-08T10:53:45.170 INFO:teuthology.orchestra.run.smithi033.stdout: librados-devel-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-05-08T10:53:45.170 INFO:teuthology.orchestra.run.smithi033.stdout: libradosstriper1-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-05-08T10:53:45.170 INFO:teuthology.orchestra.run.smithi033.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-08T10:53:45.170 INFO:teuthology.orchestra.run.smithi033.stdout: librgw2-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-05-08T10:53:45.170 INFO:teuthology.orchestra.run.smithi033.stdout: libtool-2.4.6-45.el9.x86_64 2024-05-08T10:53:45.170 INFO:teuthology.orchestra.run.smithi033.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-08T10:53:45.170 INFO:teuthology.orchestra.run.smithi033.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-05-08T10:53:45.170 INFO:teuthology.orchestra.run.smithi033.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-05-08T10:53:45.170 INFO:teuthology.orchestra.run.smithi033.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-08T10:53:45.170 INFO:teuthology.orchestra.run.smithi033.stdout: lua-5.4.4-4.el9.x86_64 2024-05-08T10:53:45.170 INFO:teuthology.orchestra.run.smithi033.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-08T10:53:45.171 INFO:teuthology.orchestra.run.smithi033.stdout: luarocks-3.9.2-1.el9.noarch 2024-05-08T10:53:45.171 INFO:teuthology.orchestra.run.smithi033.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-08T10:53:45.171 INFO:teuthology.orchestra.run.smithi033.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-08T10:53:45.171 INFO:teuthology.orchestra.run.smithi033.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-05-08T10:53:45.171 INFO:teuthology.orchestra.run.smithi033.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-08T10:53:45.171 INFO:teuthology.orchestra.run.smithi033.stdout: postgresql-13.14-1.el9.x86_64 2024-05-08T10:53:45.171 INFO:teuthology.orchestra.run.smithi033.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-05-08T10:53:45.171 INFO:teuthology.orchestra.run.smithi033.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-05-08T10:53:45.171 INFO:teuthology.orchestra.run.smithi033.stdout: postgresql-server-13.14-1.el9.x86_64 2024-05-08T10:53:45.171 INFO:teuthology.orchestra.run.smithi033.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-08T10:53:45.171 INFO:teuthology.orchestra.run.smithi033.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-08T10:53:45.171 INFO:teuthology.orchestra.run.smithi033.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-08T10:53:45.171 INFO:teuthology.orchestra.run.smithi033.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-05-08T10:53:45.171 INFO:teuthology.orchestra.run.smithi033.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-08T10:53:45.172 INFO:teuthology.orchestra.run.smithi033.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-08T10:53:45.172 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-08T10:53:45.172 INFO:teuthology.orchestra.run.smithi033.stdout: python3-ceph-argparse-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-05-08T10:53:45.172 INFO:teuthology.orchestra.run.smithi033.stdout: python3-ceph-common-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-05-08T10:53:45.172 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cephfs-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-05-08T10:53:45.172 INFO:teuthology.orchestra.run.smithi033.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-08T10:53:45.172 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-08T10:53:45.172 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-08T10:53:45.172 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-08T10:53:45.172 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-05-08T10:53:45.172 INFO:teuthology.orchestra.run.smithi033.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-05-08T10:53:45.172 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-08T10:53:45.172 INFO:teuthology.orchestra.run.smithi033.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-08T10:53:45.172 INFO:teuthology.orchestra.run.smithi033.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-08T10:53:45.173 INFO:teuthology.orchestra.run.smithi033.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-08T10:53:45.173 INFO:teuthology.orchestra.run.smithi033.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-08T10:53:45.173 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-08T10:53:45.173 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-08T10:53:45.173 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-08T10:53:45.173 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-08T10:53:45.173 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-08T10:53:45.173 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-08T10:53:45.173 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-08T10:53:45.173 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-08T10:53:45.173 INFO:teuthology.orchestra.run.smithi033.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-08T10:53:45.173 INFO:teuthology.orchestra.run.smithi033.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-08T10:53:45.173 INFO:teuthology.orchestra.run.smithi033.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-08T10:53:45.174 INFO:teuthology.orchestra.run.smithi033.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-08T10:53:45.174 INFO:teuthology.orchestra.run.smithi033.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-08T10:53:45.174 INFO:teuthology.orchestra.run.smithi033.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-08T10:53:45.174 INFO:teuthology.orchestra.run.smithi033.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-08T10:53:45.174 INFO:teuthology.orchestra.run.smithi033.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-08T10:53:45.174 INFO:teuthology.orchestra.run.smithi033.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-08T10:53:45.174 INFO:teuthology.orchestra.run.smithi033.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-08T10:53:45.174 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-08T10:53:45.174 INFO:teuthology.orchestra.run.smithi033.stdout: python3-ply-3.11-14.el9.noarch 2024-05-08T10:53:45.174 INFO:teuthology.orchestra.run.smithi033.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-08T10:53:45.174 INFO:teuthology.orchestra.run.smithi033.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-08T10:53:45.175 INFO:teuthology.orchestra.run.smithi033.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-08T10:53:45.175 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-08T10:53:45.175 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-08T10:53:45.175 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-08T10:53:45.175 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-08T10:53:45.175 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-05-08T10:53:45.175 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-08T10:53:45.175 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rados-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-05-08T10:53:45.175 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rbd-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-05-08T10:53:45.175 INFO:teuthology.orchestra.run.smithi033.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-08T10:53:45.175 INFO:teuthology.orchestra.run.smithi033.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-08T10:53:45.175 INFO:teuthology.orchestra.run.smithi033.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-08T10:53:45.175 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rgw-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-05-08T10:53:45.175 INFO:teuthology.orchestra.run.smithi033.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-08T10:53:45.175 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-08T10:53:45.176 INFO:teuthology.orchestra.run.smithi033.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-08T10:53:45.176 INFO:teuthology.orchestra.run.smithi033.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-08T10:53:45.176 INFO:teuthology.orchestra.run.smithi033.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-08T10:53:45.176 INFO:teuthology.orchestra.run.smithi033.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-08T10:53:45.176 INFO:teuthology.orchestra.run.smithi033.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-08T10:53:45.176 INFO:teuthology.orchestra.run.smithi033.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-05-08T10:53:45.176 INFO:teuthology.orchestra.run.smithi033.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-08T10:53:45.176 INFO:teuthology.orchestra.run.smithi033.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-08T10:53:45.176 INFO:teuthology.orchestra.run.smithi033.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-08T10:53:45.176 INFO:teuthology.orchestra.run.smithi033.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-08T10:53:45.176 INFO:teuthology.orchestra.run.smithi033.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-08T10:53:45.176 INFO:teuthology.orchestra.run.smithi033.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-08T10:53:45.177 INFO:teuthology.orchestra.run.smithi033.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-08T10:53:45.177 INFO:teuthology.orchestra.run.smithi033.stdout: rbd-fuse-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-05-08T10:53:45.177 INFO:teuthology.orchestra.run.smithi033.stdout: rbd-mirror-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-05-08T10:53:45.177 INFO:teuthology.orchestra.run.smithi033.stdout: rbd-nbd-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-05-08T10:53:45.177 INFO:teuthology.orchestra.run.smithi033.stdout: re2-1:20211101-3.el9.x86_64 2024-05-08T10:53:45.177 INFO:teuthology.orchestra.run.smithi033.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-08T10:53:45.177 INFO:teuthology.orchestra.run.smithi033.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-08T10:53:45.177 INFO:teuthology.orchestra.run.smithi033.stdout: uuid-1.6.2-55.el9.x86_64 2024-05-08T10:53:45.177 INFO:teuthology.orchestra.run.smithi033.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-05-08T10:53:45.177 INFO:teuthology.orchestra.run.smithi033.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-08T10:53:45.178 INFO:teuthology.orchestra.run.smithi033.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-05-08T10:53:45.178 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:53:45.178 INFO:teuthology.orchestra.run.smithi033.stdout:Complete! 2024-05-08T10:53:45.588 DEBUG:teuthology.parallel:result is None 2024-05-08T10:53:45.763 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-08T10:53:45.763 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-2:19.0.0-1670.g1fb5d106.el9.x86_64 1/164 2024-05-08T10:53:45.763 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-base-2:19.0.0-1670.g1fb5d106.el9.x86_64 2/164 2024-05-08T10:53:45.763 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-common-2:19.0.0-1670.g1fb5d106.el9.x86_64 3/164 2024-05-08T10:53:45.763 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-fuse-2:19.0.0-1670.g1fb5d106.el9.x86_64 4/164 2024-05-08T10:53:45.763 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-1670.g1fb5d 5/164 2024-05-08T10:53:45.763 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mds-2:19.0.0-1670.g1fb5d106.el9.x86_64 6/164 2024-05-08T10:53:45.763 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mgr-2:19.0.0-1670.g1fb5d106.el9.x86_64 7/164 2024-05-08T10:53:45.763 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mon-2:19.0.0-1670.g1fb5d106.el9.x86_64 8/164 2024-05-08T10:53:45.763 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-osd-2:19.0.0-1670.g1fb5d106.el9.x86_64 9/164 2024-05-08T10:53:45.763 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-radosgw-2:19.0.0-1670.g1fb5d106.el9.x86_64 10/164 2024-05-08T10:53:45.764 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-selinux-2:19.0.0-1670.g1fb5d106.el9.x86_64 11/164 2024-05-08T10:53:45.764 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-test-2:19.0.0-1670.g1fb5d106.el9.x86_64 12/164 2024-05-08T10:53:45.764 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : cephfs-mirror-2:19.0.0-1670.g1fb5d106.el9.x86_64 13/164 2024-05-08T10:53:45.764 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : cephfs-shell-2:19.0.0-1670.g1fb5d106.el9.x86_64 14/164 2024-05-08T10:53:45.764 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libcephfs-devel-2:19.0.0-1670.g1fb5d106.el9.x86_ 15/164 2024-05-08T10:53:45.764 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libcephfs2-2:19.0.0-1670.g1fb5d106.el9.x86_64 16/164 2024-05-08T10:53:45.764 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libcephsqlite-2:19.0.0-1670.g1fb5d106.el9.x86_64 17/164 2024-05-08T10:53:45.764 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librados-devel-2:19.0.0-1670.g1fb5d106.el9.x86_6 18/164 2024-05-08T10:53:45.764 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libradosstriper1-2:19.0.0-1670.g1fb5d106.el9.x86 19/164 2024-05-08T10:53:45.764 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librgw2-2:19.0.0-1670.g1fb5d106.el9.x86_64 20/164 2024-05-08T10:53:45.764 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-ceph-argparse-2:19.0.0-1670.g1fb5d106.el 21/164 2024-05-08T10:53:45.764 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-ceph-common-2:19.0.0-1670.g1fb5d106.el9. 22/164 2024-05-08T10:53:45.764 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-cephfs-2:19.0.0-1670.g1fb5d106.el9.x86_6 23/164 2024-05-08T10:53:45.764 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-rados-2:19.0.0-1670.g1fb5d106.el9.x86_64 24/164 2024-05-08T10:53:45.765 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-rbd-2:19.0.0-1670.g1fb5d106.el9.x86_64 25/164 2024-05-08T10:53:45.765 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-rgw-2:19.0.0-1670.g1fb5d106.el9.x86_64 26/164 2024-05-08T10:53:45.765 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : rbd-fuse-2:19.0.0-1670.g1fb5d106.el9.x86_64 27/164 2024-05-08T10:53:45.765 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : rbd-mirror-2:19.0.0-1670.g1fb5d106.el9.x86_64 28/164 2024-05-08T10:53:45.777 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : rbd-nbd-2:19.0.0-1670.g1fb5d106.el9.x86_64 29/164 2024-05-08T10:53:45.777 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-1670.g1fb5d106. 30/164 2024-05-08T10:53:45.777 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-1670.g1fb5d106.el9.noa 31/164 2024-05-08T10:53:45.777 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-1670.g1fb5d106.el9.n 32/164 2024-05-08T10:53:45.778 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-1670.g1fb 33/164 2024-05-08T10:53:45.778 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-1670.g1fb5d106.el 34/164 2024-05-08T10:53:45.778 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mgr-rook-2:19.0.0-1670.g1fb5d106.el9.noarch 35/164 2024-05-08T10:53:45.778 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-1670.g1fb5d106.e 36/164 2024-05-08T10:53:45.778 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-volume-2:19.0.0-1670.g1fb5d106.el9.noarch 37/164 2024-05-08T10:53:45.778 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : cephadm-2:19.0.0-1670.g1fb5d106.el9.noarch 38/164 2024-05-08T10:53:45.778 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : cephfs-top-2:19.0.0-1670.g1fb5d106.el9.noarch 39/164 2024-05-08T10:53:45.778 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/164 2024-05-08T10:53:45.778 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/164 2024-05-08T10:53:45.778 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/164 2024-05-08T10:53:45.778 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-05-08T10:53:45.778 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-05-08T10:53:45.779 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-05-08T10:53:45.779 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-05-08T10:53:45.779 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-05-08T10:53:45.779 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/164 2024-05-08T10:53:45.779 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-05-08T10:53:45.779 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-05-08T10:53:45.779 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-05-08T10:53:45.779 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/164 2024-05-08T10:53:45.779 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-05-08T10:53:45.779 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-05-08T10:53:45.779 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-05-08T10:53:45.779 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-05-08T10:53:45.779 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-05-08T10:53:45.779 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-05-08T10:53:45.780 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-05-08T10:53:45.780 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-05-08T10:53:45.780 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/164 2024-05-08T10:53:45.780 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/164 2024-05-08T10:53:45.780 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-05-08T10:53:45.780 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-05-08T10:53:45.780 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-05-08T10:53:45.780 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/164 2024-05-08T10:53:45.780 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/164 2024-05-08T10:53:45.780 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/164 2024-05-08T10:53:45.780 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/164 2024-05-08T10:53:45.780 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/164 2024-05-08T10:53:45.780 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/164 2024-05-08T10:53:45.780 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/164 2024-05-08T10:53:45.781 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-05-08T10:53:45.781 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-05-08T10:53:45.781 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-05-08T10:53:45.781 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/164 2024-05-08T10:53:45.781 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/164 2024-05-08T10:53:45.781 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/164 2024-05-08T10:53:45.781 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/164 2024-05-08T10:53:45.781 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/164 2024-05-08T10:53:45.781 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/164 2024-05-08T10:53:45.781 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/164 2024-05-08T10:53:45.781 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/164 2024-05-08T10:53:45.781 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/164 2024-05-08T10:53:45.781 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/164 2024-05-08T10:53:45.782 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/164 2024-05-08T10:53:45.782 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/164 2024-05-08T10:53:45.782 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/164 2024-05-08T10:53:45.782 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/164 2024-05-08T10:53:45.782 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/164 2024-05-08T10:53:45.782 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/164 2024-05-08T10:53:45.782 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/164 2024-05-08T10:53:45.782 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/164 2024-05-08T10:53:45.782 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/164 2024-05-08T10:53:45.782 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/164 2024-05-08T10:53:45.782 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/164 2024-05-08T10:53:45.782 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/164 2024-05-08T10:53:45.782 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/164 2024-05-08T10:53:45.783 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/164 2024-05-08T10:53:45.783 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/164 2024-05-08T10:53:45.783 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/164 2024-05-08T10:53:45.783 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/164 2024-05-08T10:53:45.783 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/164 2024-05-08T10:53:45.783 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/164 2024-05-08T10:53:45.783 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/164 2024-05-08T10:53:45.783 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/164 2024-05-08T10:53:45.783 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/164 2024-05-08T10:53:45.783 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 108/164 2024-05-08T10:53:45.783 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 109/164 2024-05-08T10:53:45.783 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/164 2024-05-08T10:53:45.783 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/164 2024-05-08T10:53:45.783 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/164 2024-05-08T10:53:45.784 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 113/164 2024-05-08T10:53:45.784 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/164 2024-05-08T10:53:45.784 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/164 2024-05-08T10:53:45.784 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/164 2024-05-08T10:53:45.784 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/164 2024-05-08T10:53:45.784 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/164 2024-05-08T10:53:45.784 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/164 2024-05-08T10:53:45.784 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/164 2024-05-08T10:53:45.784 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/164 2024-05-08T10:53:45.784 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/164 2024-05-08T10:53:45.784 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-05-08T10:53:45.784 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-05-08T10:53:45.784 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-05-08T10:53:45.784 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-05-08T10:53:45.785 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-05-08T10:53:45.785 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-05-08T10:53:45.785 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-05-08T10:53:45.785 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-05-08T10:53:45.785 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-05-08T10:53:45.785 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-05-08T10:53:45.785 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-05-08T10:53:45.785 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-05-08T10:53:45.785 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-05-08T10:53:45.785 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-05-08T10:53:45.785 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-05-08T10:53:45.785 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-05-08T10:53:45.785 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-05-08T10:53:45.785 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-05-08T10:53:45.786 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-05-08T10:53:45.786 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/164 2024-05-08T10:53:45.786 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/164 2024-05-08T10:53:45.786 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-05-08T10:53:45.786 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-05-08T10:53:45.786 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-05-08T10:53:45.786 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/164 2024-05-08T10:53:45.786 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-05-08T10:53:45.786 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librados2-2:19.0.0-1670.g1fb5d106.el9.x86_64 149/164 2024-05-08T10:53:45.786 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-05-08T10:53:45.786 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librbd1-2:19.0.0-1670.g1fb5d106.el9.x86_64 151/164 2024-05-08T10:53:45.786 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-05-08T10:53:45.786 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : NetworkManager-1:1.47.5-1.el9.x86_64 153/164 2024-05-08T10:53:45.786 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/164 2024-05-08T10:53:45.787 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : NetworkManager-libnm-1:1.47.5-1.el9.x86_64 155/164 2024-05-08T10:53:45.787 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/164 2024-05-08T10:53:45.787 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : NetworkManager-team-1:1.47.5-1.el9.x86_64 157/164 2024-05-08T10:53:45.787 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/164 2024-05-08T10:53:45.787 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : NetworkManager-tui-1:1.47.5-1.el9.x86_64 159/164 2024-05-08T10:53:45.787 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/164 2024-05-08T10:53:45.787 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 161/164 2024-05-08T10:53:45.787 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 162/164 2024-05-08T10:53:45.787 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 163/164 2024-05-08T10:53:48.318 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-08T10:53:48.319 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-08T10:53:48.319 INFO:teuthology.orchestra.run.smithi174.stdout:Upgraded: 2024-05-08T10:53:48.319 INFO:teuthology.orchestra.run.smithi174.stdout: NetworkManager-1:1.47.5-1.el9.x86_64 2024-05-08T10:53:48.319 INFO:teuthology.orchestra.run.smithi174.stdout: NetworkManager-libnm-1:1.47.5-1.el9.x86_64 2024-05-08T10:53:48.319 INFO:teuthology.orchestra.run.smithi174.stdout: NetworkManager-team-1:1.47.5-1.el9.x86_64 2024-05-08T10:53:48.319 INFO:teuthology.orchestra.run.smithi174.stdout: NetworkManager-tui-1:1.47.5-1.el9.x86_64 2024-05-08T10:53:48.319 INFO:teuthology.orchestra.run.smithi174.stdout: librados2-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-05-08T10:53:48.319 INFO:teuthology.orchestra.run.smithi174.stdout: librbd1-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-05-08T10:53:48.319 INFO:teuthology.orchestra.run.smithi174.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-05-08T10:53:48.319 INFO:teuthology.orchestra.run.smithi174.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-05-08T10:53:48.319 INFO:teuthology.orchestra.run.smithi174.stdout:Installed: 2024-05-08T10:53:48.319 INFO:teuthology.orchestra.run.smithi174.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-08T10:53:48.319 INFO:teuthology.orchestra.run.smithi174.stdout: automake-1.16.2-8.el9.noarch 2024-05-08T10:53:48.320 INFO:teuthology.orchestra.run.smithi174.stdout: bison-3.7.4-5.el9.x86_64 2024-05-08T10:53:48.320 INFO:teuthology.orchestra.run.smithi174.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-08T10:53:48.320 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-05-08T10:53:48.320 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-base-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-05-08T10:53:48.320 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-common-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-05-08T10:53:48.320 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-fuse-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-05-08T10:53:48.320 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-grafana-dashboards-2:19.0.0-1670.g1fb5d106.el9.noarch 2024-05-08T10:53:48.320 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-immutable-object-cache-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-05-08T10:53:48.320 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mds-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-05-08T10:53:48.320 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-05-08T10:53:48.320 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-cephadm-2:19.0.0-1670.g1fb5d106.el9.noarch 2024-05-08T10:53:48.320 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-dashboard-2:19.0.0-1670.g1fb5d106.el9.noarch 2024-05-08T10:53:48.320 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-diskprediction-local-2:19.0.0-1670.g1fb5d106.el9.noarch 2024-05-08T10:53:48.320 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-modules-core-2:19.0.0-1670.g1fb5d106.el9.noarch 2024-05-08T10:53:48.321 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-rook-2:19.0.0-1670.g1fb5d106.el9.noarch 2024-05-08T10:53:48.321 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mon-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-05-08T10:53:48.321 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-osd-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-05-08T10:53:48.321 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-prometheus-alerts-2:19.0.0-1670.g1fb5d106.el9.noarch 2024-05-08T10:53:48.321 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-radosgw-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-05-08T10:53:48.321 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-selinux-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-05-08T10:53:48.321 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-test-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-05-08T10:53:48.321 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-volume-2:19.0.0-1670.g1fb5d106.el9.noarch 2024-05-08T10:53:48.321 INFO:teuthology.orchestra.run.smithi174.stdout: cephadm-2:19.0.0-1670.g1fb5d106.el9.noarch 2024-05-08T10:53:48.321 INFO:teuthology.orchestra.run.smithi174.stdout: cephfs-mirror-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-05-08T10:53:48.321 INFO:teuthology.orchestra.run.smithi174.stdout: cephfs-shell-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-05-08T10:53:48.321 INFO:teuthology.orchestra.run.smithi174.stdout: cephfs-top-2:19.0.0-1670.g1fb5d106.el9.noarch 2024-05-08T10:53:48.321 INFO:teuthology.orchestra.run.smithi174.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-05-08T10:53:48.322 INFO:teuthology.orchestra.run.smithi174.stdout: flex-2.6.4-9.el9.x86_64 2024-05-08T10:53:48.322 INFO:teuthology.orchestra.run.smithi174.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-08T10:53:48.322 INFO:teuthology.orchestra.run.smithi174.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-08T10:53:48.322 INFO:teuthology.orchestra.run.smithi174.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-08T10:53:48.322 INFO:teuthology.orchestra.run.smithi174.stdout: fuse-2.9.9-15.el9.x86_64 2024-05-08T10:53:48.322 INFO:teuthology.orchestra.run.smithi174.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-08T10:53:48.322 INFO:teuthology.orchestra.run.smithi174.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-08T10:53:48.322 INFO:teuthology.orchestra.run.smithi174.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-05-08T10:53:48.322 INFO:teuthology.orchestra.run.smithi174.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-08T10:53:48.322 INFO:teuthology.orchestra.run.smithi174.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-08T10:53:48.322 INFO:teuthology.orchestra.run.smithi174.stdout: libcephfs-devel-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-05-08T10:53:48.322 INFO:teuthology.orchestra.run.smithi174.stdout: libcephfs2-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-05-08T10:53:48.322 INFO:teuthology.orchestra.run.smithi174.stdout: libcephsqlite-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-05-08T10:53:48.322 INFO:teuthology.orchestra.run.smithi174.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-08T10:53:48.323 INFO:teuthology.orchestra.run.smithi174.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-08T10:53:48.323 INFO:teuthology.orchestra.run.smithi174.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-08T10:53:48.323 INFO:teuthology.orchestra.run.smithi174.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-08T10:53:48.323 INFO:teuthology.orchestra.run.smithi174.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-08T10:53:48.323 INFO:teuthology.orchestra.run.smithi174.stdout: librados-devel-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-05-08T10:53:48.323 INFO:teuthology.orchestra.run.smithi174.stdout: libradosstriper1-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-05-08T10:53:48.323 INFO:teuthology.orchestra.run.smithi174.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-08T10:53:48.323 INFO:teuthology.orchestra.run.smithi174.stdout: librgw2-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-05-08T10:53:48.323 INFO:teuthology.orchestra.run.smithi174.stdout: libtool-2.4.6-45.el9.x86_64 2024-05-08T10:53:48.323 INFO:teuthology.orchestra.run.smithi174.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-08T10:53:48.323 INFO:teuthology.orchestra.run.smithi174.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-05-08T10:53:48.323 INFO:teuthology.orchestra.run.smithi174.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-05-08T10:53:48.323 INFO:teuthology.orchestra.run.smithi174.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-08T10:53:48.324 INFO:teuthology.orchestra.run.smithi174.stdout: lua-5.4.4-4.el9.x86_64 2024-05-08T10:53:48.324 INFO:teuthology.orchestra.run.smithi174.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-08T10:53:48.324 INFO:teuthology.orchestra.run.smithi174.stdout: luarocks-3.9.2-1.el9.noarch 2024-05-08T10:53:48.324 INFO:teuthology.orchestra.run.smithi174.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-08T10:53:48.324 INFO:teuthology.orchestra.run.smithi174.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-08T10:53:48.324 INFO:teuthology.orchestra.run.smithi174.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-05-08T10:53:48.324 INFO:teuthology.orchestra.run.smithi174.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-08T10:53:48.324 INFO:teuthology.orchestra.run.smithi174.stdout: postgresql-13.14-1.el9.x86_64 2024-05-08T10:53:48.324 INFO:teuthology.orchestra.run.smithi174.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-05-08T10:53:48.324 INFO:teuthology.orchestra.run.smithi174.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-05-08T10:53:48.324 INFO:teuthology.orchestra.run.smithi174.stdout: postgresql-server-13.14-1.el9.x86_64 2024-05-08T10:53:48.324 INFO:teuthology.orchestra.run.smithi174.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-08T10:53:48.324 INFO:teuthology.orchestra.run.smithi174.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-08T10:53:48.325 INFO:teuthology.orchestra.run.smithi174.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-08T10:53:48.325 INFO:teuthology.orchestra.run.smithi174.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-05-08T10:53:48.325 INFO:teuthology.orchestra.run.smithi174.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-08T10:53:48.325 INFO:teuthology.orchestra.run.smithi174.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-08T10:53:48.325 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-08T10:53:48.325 INFO:teuthology.orchestra.run.smithi174.stdout: python3-ceph-argparse-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-05-08T10:53:48.325 INFO:teuthology.orchestra.run.smithi174.stdout: python3-ceph-common-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-05-08T10:53:48.325 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cephfs-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-05-08T10:53:48.325 INFO:teuthology.orchestra.run.smithi174.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-08T10:53:48.325 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-08T10:53:48.325 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-08T10:53:48.325 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-08T10:53:48.325 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-05-08T10:53:48.325 INFO:teuthology.orchestra.run.smithi174.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-05-08T10:53:48.326 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-08T10:53:48.326 INFO:teuthology.orchestra.run.smithi174.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-08T10:53:48.326 INFO:teuthology.orchestra.run.smithi174.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-08T10:53:48.326 INFO:teuthology.orchestra.run.smithi174.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-08T10:53:48.326 INFO:teuthology.orchestra.run.smithi174.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-08T10:53:48.326 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-08T10:53:48.326 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-08T10:53:48.326 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-08T10:53:48.326 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-08T10:53:48.326 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-08T10:53:48.326 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-08T10:53:48.326 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-08T10:53:48.326 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-08T10:53:48.327 INFO:teuthology.orchestra.run.smithi174.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-08T10:53:48.327 INFO:teuthology.orchestra.run.smithi174.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-08T10:53:48.327 INFO:teuthology.orchestra.run.smithi174.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-08T10:53:48.327 INFO:teuthology.orchestra.run.smithi174.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-08T10:53:48.327 INFO:teuthology.orchestra.run.smithi174.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-08T10:53:48.327 INFO:teuthology.orchestra.run.smithi174.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-08T10:53:48.327 INFO:teuthology.orchestra.run.smithi174.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-08T10:53:48.327 INFO:teuthology.orchestra.run.smithi174.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-08T10:53:48.327 INFO:teuthology.orchestra.run.smithi174.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-08T10:53:48.327 INFO:teuthology.orchestra.run.smithi174.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-08T10:53:48.327 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-08T10:53:48.327 INFO:teuthology.orchestra.run.smithi174.stdout: python3-ply-3.11-14.el9.noarch 2024-05-08T10:53:48.327 INFO:teuthology.orchestra.run.smithi174.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-08T10:53:48.327 INFO:teuthology.orchestra.run.smithi174.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-08T10:53:48.328 INFO:teuthology.orchestra.run.smithi174.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-08T10:53:48.328 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-08T10:53:48.328 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-08T10:53:48.328 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-08T10:53:48.328 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-08T10:53:48.328 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-05-08T10:53:48.328 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-08T10:53:48.328 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rados-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-05-08T10:53:48.328 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rbd-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-05-08T10:53:48.328 INFO:teuthology.orchestra.run.smithi174.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-08T10:53:48.328 INFO:teuthology.orchestra.run.smithi174.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-08T10:53:48.328 INFO:teuthology.orchestra.run.smithi174.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-08T10:53:48.328 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rgw-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-05-08T10:53:48.328 INFO:teuthology.orchestra.run.smithi174.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-08T10:53:48.328 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-08T10:53:48.329 INFO:teuthology.orchestra.run.smithi174.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-08T10:53:48.329 INFO:teuthology.orchestra.run.smithi174.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-08T10:53:48.329 INFO:teuthology.orchestra.run.smithi174.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-08T10:53:48.329 INFO:teuthology.orchestra.run.smithi174.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-08T10:53:48.329 INFO:teuthology.orchestra.run.smithi174.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-08T10:53:48.329 INFO:teuthology.orchestra.run.smithi174.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-05-08T10:53:48.329 INFO:teuthology.orchestra.run.smithi174.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-08T10:53:48.329 INFO:teuthology.orchestra.run.smithi174.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-08T10:53:48.329 INFO:teuthology.orchestra.run.smithi174.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-08T10:53:48.329 INFO:teuthology.orchestra.run.smithi174.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-08T10:53:48.329 INFO:teuthology.orchestra.run.smithi174.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-08T10:53:48.329 INFO:teuthology.orchestra.run.smithi174.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-08T10:53:48.329 INFO:teuthology.orchestra.run.smithi174.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-08T10:53:48.330 INFO:teuthology.orchestra.run.smithi174.stdout: rbd-fuse-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-05-08T10:53:48.330 INFO:teuthology.orchestra.run.smithi174.stdout: rbd-mirror-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-05-08T10:53:48.330 INFO:teuthology.orchestra.run.smithi174.stdout: rbd-nbd-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-05-08T10:53:48.330 INFO:teuthology.orchestra.run.smithi174.stdout: re2-1:20211101-3.el9.x86_64 2024-05-08T10:53:48.330 INFO:teuthology.orchestra.run.smithi174.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-08T10:53:48.330 INFO:teuthology.orchestra.run.smithi174.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-08T10:53:48.330 INFO:teuthology.orchestra.run.smithi174.stdout: uuid-1.6.2-55.el9.x86_64 2024-05-08T10:53:48.330 INFO:teuthology.orchestra.run.smithi174.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-05-08T10:53:48.330 INFO:teuthology.orchestra.run.smithi174.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-08T10:53:48.331 INFO:teuthology.orchestra.run.smithi174.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-05-08T10:53:48.331 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-08T10:53:48.331 INFO:teuthology.orchestra.run.smithi174.stdout:Complete! 2024-05-08T10:53:48.738 DEBUG:teuthology.parallel:result is None 2024-05-08T10:53:48.739 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1fb5d10608dccee73edd6ef8a2c7b804a097c324 2024-05-08T10:53:48.879 DEBUG:teuthology.orchestra.run.smithi033:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-08T10:53:48.907 INFO:teuthology.orchestra.run.smithi033.stdout:19.0.0-1670.g1fb5d106.el9 2024-05-08T10:53:48.907 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1670.g1fb5d106.el9 2024-05-08T10:53:48.907 INFO:teuthology.task.install:The correct ceph version 19.0.0-1670.g1fb5d106 is installed. 2024-05-08T10:53:48.909 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1fb5d10608dccee73edd6ef8a2c7b804a097c324 2024-05-08T10:53:49.226 DEBUG:teuthology.orchestra.run.smithi174:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-08T10:53:49.249 INFO:teuthology.orchestra.run.smithi174.stdout:19.0.0-1670.g1fb5d106.el9 2024-05-08T10:53:49.250 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1670.g1fb5d106.el9 2024-05-08T10:53:49.250 INFO:teuthology.task.install:The correct ceph version 19.0.0-1670.g1fb5d106 is installed. 2024-05-08T10:53:49.252 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-05-08T10:53:49.252 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-05-08T10:53:49.252 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-08T10:53:49.285 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-05-08T10:53:49.285 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-08T10:53:49.317 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-05-08T10:53:49.317 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-05-08T10:53:49.317 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/usr/bin/daemon-helper 2024-05-08T10:53:49.356 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-08T10:53:49.426 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-05-08T10:53:49.426 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/usr/bin/daemon-helper 2024-05-08T10:53:49.450 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-08T10:53:49.516 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-05-08T10:53:49.516 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-05-08T10:53:49.516 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-08T10:53:49.547 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-08T10:53:49.617 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-05-08T10:53:49.617 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-08T10:53:49.641 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-08T10:53:49.707 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-05-08T10:53:49.707 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-05-08T10:53:49.707 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/usr/bin/stdin-killer 2024-05-08T10:53:49.742 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-08T10:53:49.809 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-05-08T10:53:49.809 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/usr/bin/stdin-killer 2024-05-08T10:53:49.833 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-08T10:53:49.900 INFO:teuthology.run_tasks:Running task ceph... 2024-05-08T10:53:49.995 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-05-08T10:53:49.995 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod 777 /var/log/ceph 2024-05-08T10:53:49.997 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod 777 /var/log/ceph 2024-05-08T10:53:50.024 INFO:tasks.ceph:Disabling ceph logrotate... 2024-05-08T10:53:50.024 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-08T10:53:50.066 DEBUG:teuthology.orchestra.run.smithi174:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-08T10:53:50.092 INFO:tasks.ceph:Creating extra log directories... 2024-05-08T10:53:50.092 DEBUG:teuthology.orchestra.run.smithi033:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-08T10:53:50.135 DEBUG:teuthology.orchestra.run.smithi174:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-08T10:53:50.170 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-05-08T10:53:50.170 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-05-08T10:53:50.170 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-05-08T10:53:50.171 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-05-08T10:53:50.171 DEBUG:teuthology.orchestra.run.smithi033:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-05-08T10:53:50.218 DEBUG:teuthology.orchestra.run.smithi033:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-05-08T10:53:50.335 DEBUG:teuthology.orchestra.run.smithi033:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-05-08T10:53:50.362 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-05-08T10:53:50.363 DEBUG:teuthology.orchestra.run.smithi174:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-05-08T10:53:50.378 DEBUG:teuthology.orchestra.run.smithi174:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-05-08T10:53:50.488 DEBUG:teuthology.orchestra.run.smithi174:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-05-08T10:53:50.519 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-05-08T10:53:50.519 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-05-08T10:53:50.519 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/jcollin-2024-05-08_10:38:33-fs:functional-main-distro-default-smithi/7697403', 'branch': 'main', 'description': 'fs:functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/mds-flush}', 'email': 'jcollin@redhat.com', 'first_in_suite': False, 'job_id': '7697403', 'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'jcollin-2024-05-08_10:38:33-fs:functional-main-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'main'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'sha1': '1fb5d10608dccee73edd6ef8a2c7b804a097c324'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '1fb5d10608dccee73edd6ef8a2c7b804a097c324'}}, 'kclient': {'syntax': 'v2'}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'subvolume_version': 1, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'origin-jcollin-testing', 'sha1': '01ce85a26cb3f8a34af686c5296fc2b3660a1e86'}}, 'owner': 'scheduled_jcollin@teuthology', 'priority': 2, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 101, 'sha1': '1fb5d10608dccee73edd6ef8a2c7b804a097c324', 'sleep_before_teardown': 0, 'suite': 'fs:functional', 'suite_branch': 'origin-jcollin-testing', 'suite_path': '/home/teuthworker/src/github.com_joscollin_ceph_01ce85a26cb3f8a34af686c5296fc2b3660a1e86/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/joscollin/ceph.git', 'suite_sha1': '01ce85a26cb3f8a34af686c5296fc2b3660a1e86', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi033.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHtIKUPltaV098aB4kFmMbFU4MnfhpK0NSBvhwGeNcp0uXmll4KCC4rQ/tvyHc73u5IhTi8/1rSHFWL4GUCGhtQ=', 'smithi174.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBtS3nTonDg82DT9OrdTj7uPHVZGLJjEg9BZYBXwzbrOLZxslRmjL75laxVECb3JYmUv+SQ8gSZxpA2AznMEWOI='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '1fb5d10608dccee73edd6ef8a2c7b804a097c324'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'sha1': '1fb5d10608dccee73edd6ef8a2c7b804a097c324', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_flush']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '1ae7ad82388e92a475afff437d49054826c019a1', 'timestamp': '2024-05-08_10:38:33', 'tube': 'smithi', 'user': 'jcollin', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-05-08T10:53:50.520 DEBUG:teuthology.orchestra.run.smithi033:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-08T10:53:50.523 DEBUG:teuthology.orchestra.run.smithi174:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-08T10:53:50.569 DEBUG:teuthology.orchestra.run.smithi033:> sudo install -d -m0777 -- /var/run/ceph 2024-05-08T10:53:50.579 DEBUG:teuthology.orchestra.run.smithi174:> sudo install -d -m0777 -- /var/run/ceph 2024-05-08T10:53:50.634 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-05-08T10:53:50.634 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/scratch_devs of=/dev/stdout 2024-05-08T10:53:50.661 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-08T10:53:50.661 DEBUG:teuthology.orchestra.run.smithi033:> stat /dev/vg_nvme/lv_1 2024-05-08T10:53:50.717 INFO:teuthology.orchestra.run.smithi033.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-08T10:53:50.717 INFO:teuthology.orchestra.run.smithi033.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T10:53:50.717 INFO:teuthology.orchestra.run.smithi033.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-05-08T10:53:50.717 INFO:teuthology.orchestra.run.smithi033.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T10:53:50.718 INFO:teuthology.orchestra.run.smithi033.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T10:53:50.718 INFO:teuthology.orchestra.run.smithi033.stdout:Access: 2024-05-08 10:53:38.033612587 +0000 2024-05-08T10:53:50.718 INFO:teuthology.orchestra.run.smithi033.stdout:Modify: 2024-05-08 10:51:35.016895437 +0000 2024-05-08T10:53:50.718 INFO:teuthology.orchestra.run.smithi033.stdout:Change: 2024-05-08 10:51:35.016895437 +0000 2024-05-08T10:53:50.718 INFO:teuthology.orchestra.run.smithi033.stdout: Birth: 2024-05-08 10:51:35.016895437 +0000 2024-05-08T10:53:50.718 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-08T10:53:50.783 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records in 2024-05-08T10:53:50.783 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records out 2024-05-08T10:53:50.783 INFO:teuthology.orchestra.run.smithi033.stderr:512 bytes copied, 0.000262249 s, 2.0 MB/s 2024-05-08T10:53:50.784 DEBUG:teuthology.orchestra.run.smithi033:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-08T10:53:50.842 DEBUG:teuthology.orchestra.run.smithi033:> stat /dev/vg_nvme/lv_2 2024-05-08T10:53:50.899 INFO:teuthology.orchestra.run.smithi033.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-08T10:53:50.899 INFO:teuthology.orchestra.run.smithi033.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T10:53:50.899 INFO:teuthology.orchestra.run.smithi033.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-05-08T10:53:50.899 INFO:teuthology.orchestra.run.smithi033.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T10:53:50.899 INFO:teuthology.orchestra.run.smithi033.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T10:53:50.899 INFO:teuthology.orchestra.run.smithi033.stdout:Access: 2024-05-08 10:53:38.033612587 +0000 2024-05-08T10:53:50.900 INFO:teuthology.orchestra.run.smithi033.stdout:Modify: 2024-05-08 10:51:35.370889594 +0000 2024-05-08T10:53:50.900 INFO:teuthology.orchestra.run.smithi033.stdout:Change: 2024-05-08 10:51:35.370889594 +0000 2024-05-08T10:53:50.900 INFO:teuthology.orchestra.run.smithi033.stdout: Birth: 2024-05-08 10:51:35.370889594 +0000 2024-05-08T10:53:50.900 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-08T10:53:50.963 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records in 2024-05-08T10:53:50.963 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records out 2024-05-08T10:53:50.964 INFO:teuthology.orchestra.run.smithi033.stderr:512 bytes copied, 0.000207063 s, 2.5 MB/s 2024-05-08T10:53:50.965 DEBUG:teuthology.orchestra.run.smithi033:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-08T10:53:51.022 DEBUG:teuthology.orchestra.run.smithi033:> stat /dev/vg_nvme/lv_3 2024-05-08T10:53:51.078 INFO:teuthology.orchestra.run.smithi033.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-08T10:53:51.078 INFO:teuthology.orchestra.run.smithi033.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T10:53:51.078 INFO:teuthology.orchestra.run.smithi033.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-05-08T10:53:51.078 INFO:teuthology.orchestra.run.smithi033.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T10:53:51.078 INFO:teuthology.orchestra.run.smithi033.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T10:53:51.078 INFO:teuthology.orchestra.run.smithi033.stdout:Access: 2024-05-08 10:53:38.034612571 +0000 2024-05-08T10:53:51.078 INFO:teuthology.orchestra.run.smithi033.stdout:Modify: 2024-05-08 10:51:35.715883899 +0000 2024-05-08T10:53:51.078 INFO:teuthology.orchestra.run.smithi033.stdout:Change: 2024-05-08 10:51:35.715883899 +0000 2024-05-08T10:53:51.079 INFO:teuthology.orchestra.run.smithi033.stdout: Birth: 2024-05-08 10:51:35.715883899 +0000 2024-05-08T10:53:51.079 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-08T10:53:51.142 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records in 2024-05-08T10:53:51.142 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records out 2024-05-08T10:53:51.142 INFO:teuthology.orchestra.run.smithi033.stderr:512 bytes copied, 0.000171324 s, 3.0 MB/s 2024-05-08T10:53:51.143 DEBUG:teuthology.orchestra.run.smithi033:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-08T10:53:51.201 DEBUG:teuthology.orchestra.run.smithi033:> stat /dev/vg_nvme/lv_4 2024-05-08T10:53:51.257 INFO:teuthology.orchestra.run.smithi033.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-08T10:53:51.257 INFO:teuthology.orchestra.run.smithi033.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T10:53:51.257 INFO:teuthology.orchestra.run.smithi033.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-05-08T10:53:51.257 INFO:teuthology.orchestra.run.smithi033.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T10:53:51.257 INFO:teuthology.orchestra.run.smithi033.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T10:53:51.257 INFO:teuthology.orchestra.run.smithi033.stdout:Access: 2024-05-08 10:53:38.034612571 +0000 2024-05-08T10:53:51.257 INFO:teuthology.orchestra.run.smithi033.stdout:Modify: 2024-05-08 10:51:36.064878139 +0000 2024-05-08T10:53:51.257 INFO:teuthology.orchestra.run.smithi033.stdout:Change: 2024-05-08 10:51:36.064878139 +0000 2024-05-08T10:53:51.257 INFO:teuthology.orchestra.run.smithi033.stdout: Birth: 2024-05-08 10:51:36.064878139 +0000 2024-05-08T10:53:51.257 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-08T10:53:51.321 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records in 2024-05-08T10:53:51.321 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records out 2024-05-08T10:53:51.321 INFO:teuthology.orchestra.run.smithi033.stderr:512 bytes copied, 0.000193408 s, 2.6 MB/s 2024-05-08T10:53:51.322 DEBUG:teuthology.orchestra.run.smithi033:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-08T10:53:51.379 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-08T10:53:51.380 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-05-08T10:53:51.380 DEBUG:teuthology.orchestra.run.smithi174:> dd if=/scratch_devs of=/dev/stdout 2024-05-08T10:53:51.396 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-08T10:53:51.397 DEBUG:teuthology.orchestra.run.smithi174:> stat /dev/vg_nvme/lv_1 2024-05-08T10:53:51.453 INFO:teuthology.orchestra.run.smithi174.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-08T10:53:51.453 INFO:teuthology.orchestra.run.smithi174.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T10:53:51.453 INFO:teuthology.orchestra.run.smithi174.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-05-08T10:53:51.453 INFO:teuthology.orchestra.run.smithi174.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T10:53:51.453 INFO:teuthology.orchestra.run.smithi174.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T10:53:51.453 INFO:teuthology.orchestra.run.smithi174.stdout:Access: 2024-05-08 10:53:41.351174597 +0000 2024-05-08T10:53:51.453 INFO:teuthology.orchestra.run.smithi174.stdout:Modify: 2024-05-08 10:51:23.581206764 +0000 2024-05-08T10:53:51.454 INFO:teuthology.orchestra.run.smithi174.stdout:Change: 2024-05-08 10:51:23.581206764 +0000 2024-05-08T10:53:51.454 INFO:teuthology.orchestra.run.smithi174.stdout: Birth: 2024-05-08 10:51:23.581206764 +0000 2024-05-08T10:53:51.454 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-08T10:53:51.517 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records in 2024-05-08T10:53:51.518 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records out 2024-05-08T10:53:51.518 INFO:teuthology.orchestra.run.smithi174.stderr:512 bytes copied, 0.000202051 s, 2.5 MB/s 2024-05-08T10:53:51.519 DEBUG:teuthology.orchestra.run.smithi174:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-08T10:53:51.576 DEBUG:teuthology.orchestra.run.smithi174:> stat /dev/vg_nvme/lv_2 2024-05-08T10:53:51.632 INFO:teuthology.orchestra.run.smithi174.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-08T10:53:51.633 INFO:teuthology.orchestra.run.smithi174.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T10:53:51.633 INFO:teuthology.orchestra.run.smithi174.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-05-08T10:53:51.633 INFO:teuthology.orchestra.run.smithi174.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T10:53:51.633 INFO:teuthology.orchestra.run.smithi174.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T10:53:51.633 INFO:teuthology.orchestra.run.smithi174.stdout:Access: 2024-05-08 10:53:41.351174597 +0000 2024-05-08T10:53:51.633 INFO:teuthology.orchestra.run.smithi174.stdout:Modify: 2024-05-08 10:51:23.930202269 +0000 2024-05-08T10:53:51.633 INFO:teuthology.orchestra.run.smithi174.stdout:Change: 2024-05-08 10:51:23.930202269 +0000 2024-05-08T10:53:51.633 INFO:teuthology.orchestra.run.smithi174.stdout: Birth: 2024-05-08 10:51:23.930202269 +0000 2024-05-08T10:53:51.633 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-08T10:53:51.697 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records in 2024-05-08T10:53:51.697 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records out 2024-05-08T10:53:51.697 INFO:teuthology.orchestra.run.smithi174.stderr:512 bytes copied, 0.0001927 s, 2.7 MB/s 2024-05-08T10:53:51.698 DEBUG:teuthology.orchestra.run.smithi174:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-08T10:53:51.754 DEBUG:teuthology.orchestra.run.smithi174:> stat /dev/vg_nvme/lv_3 2024-05-08T10:53:51.810 INFO:teuthology.orchestra.run.smithi174.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-08T10:53:51.810 INFO:teuthology.orchestra.run.smithi174.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T10:53:51.810 INFO:teuthology.orchestra.run.smithi174.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-05-08T10:53:51.810 INFO:teuthology.orchestra.run.smithi174.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T10:53:51.810 INFO:teuthology.orchestra.run.smithi174.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T10:53:51.810 INFO:teuthology.orchestra.run.smithi174.stdout:Access: 2024-05-08 10:53:41.352174584 +0000 2024-05-08T10:53:51.811 INFO:teuthology.orchestra.run.smithi174.stdout:Modify: 2024-05-08 10:51:24.447195610 +0000 2024-05-08T10:53:51.811 INFO:teuthology.orchestra.run.smithi174.stdout:Change: 2024-05-08 10:51:24.447195610 +0000 2024-05-08T10:53:51.811 INFO:teuthology.orchestra.run.smithi174.stdout: Birth: 2024-05-08 10:51:24.447195610 +0000 2024-05-08T10:53:51.811 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-08T10:53:51.873 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records in 2024-05-08T10:53:51.873 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records out 2024-05-08T10:53:51.873 INFO:teuthology.orchestra.run.smithi174.stderr:512 bytes copied, 0.000200967 s, 2.5 MB/s 2024-05-08T10:53:51.874 DEBUG:teuthology.orchestra.run.smithi174:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-08T10:53:51.931 DEBUG:teuthology.orchestra.run.smithi174:> stat /dev/vg_nvme/lv_4 2024-05-08T10:53:51.986 INFO:teuthology.orchestra.run.smithi174.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-08T10:53:51.986 INFO:teuthology.orchestra.run.smithi174.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T10:53:51.986 INFO:teuthology.orchestra.run.smithi174.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-05-08T10:53:51.986 INFO:teuthology.orchestra.run.smithi174.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T10:53:51.987 INFO:teuthology.orchestra.run.smithi174.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T10:53:51.987 INFO:teuthology.orchestra.run.smithi174.stdout:Access: 2024-05-08 10:53:41.352174584 +0000 2024-05-08T10:53:51.987 INFO:teuthology.orchestra.run.smithi174.stdout:Modify: 2024-05-08 10:51:24.779191334 +0000 2024-05-08T10:53:51.987 INFO:teuthology.orchestra.run.smithi174.stdout:Change: 2024-05-08 10:51:24.779191334 +0000 2024-05-08T10:53:51.987 INFO:teuthology.orchestra.run.smithi174.stdout: Birth: 2024-05-08 10:51:24.779191334 +0000 2024-05-08T10:53:51.987 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-08T10:53:52.050 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records in 2024-05-08T10:53:52.050 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records out 2024-05-08T10:53:52.050 INFO:teuthology.orchestra.run.smithi174.stderr:512 bytes copied, 0.000185657 s, 2.8 MB/s 2024-05-08T10:53:52.051 DEBUG:teuthology.orchestra.run.smithi174:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-08T10:53:52.107 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-08T10:53:52.107 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi033.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi174.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-08T10:53:52.108 INFO:tasks.ceph:Generating config... 2024-05-08T10:53:52.109 INFO:tasks.ceph:[client] client mount timeout = 600 2024-05-08T10:53:52.109 INFO:tasks.ceph:[client] debug client = 20 2024-05-08T10:53:52.109 INFO:tasks.ceph:[client] debug ms = 1 2024-05-08T10:53:52.109 INFO:tasks.ceph:[client] pid file = 2024-05-08T10:53:52.109 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-05-08T10:53:52.109 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-05-08T10:53:52.109 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-05-08T10:53:52.109 INFO:tasks.ceph:[mds] debug mds = 20 2024-05-08T10:53:52.110 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-05-08T10:53:52.110 INFO:tasks.ceph:[mds] debug ms = 1 2024-05-08T10:53:52.110 INFO:tasks.ceph:[mds] mds debug frag = True 2024-05-08T10:53:52.110 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-05-08T10:53:52.110 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-05-08T10:53:52.110 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-05-08T10:53:52.110 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-05-08T10:53:52.110 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-05-08T10:53:52.110 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-05-08T10:53:52.110 INFO:tasks.ceph:[mgr] debug client = 20 2024-05-08T10:53:52.110 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-05-08T10:53:52.110 INFO:tasks.ceph:[mgr] debug ms = 1 2024-05-08T10:53:52.110 INFO:tasks.ceph:[mon] debug mon = 20 2024-05-08T10:53:52.110 INFO:tasks.ceph:[mon] debug ms = 1 2024-05-08T10:53:52.111 INFO:tasks.ceph:[mon] debug paxos = 20 2024-05-08T10:53:52.111 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-05-08T10:53:52.111 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-05-08T10:53:52.111 INFO:tasks.ceph:[osd] bdev async discard = True 2024-05-08T10:53:52.111 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-05-08T10:53:52.111 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-05-08T10:53:52.111 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-05-08T10:53:52.111 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-05-08T10:53:52.111 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-05-08T10:53:52.111 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-05-08T10:53:52.111 INFO:tasks.ceph:[osd] debug ms = 1 2024-05-08T10:53:52.111 INFO:tasks.ceph:[osd] debug osd = 20 2024-05-08T10:53:52.111 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-05-08T10:53:52.111 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-05-08T10:53:52.111 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-05-08T10:53:52.112 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-05-08T10:53:52.112 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-05-08T10:53:52.112 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-05-08T10:53:52.112 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-05-08T10:53:52.112 INFO:tasks.ceph:Setting up mon.a... 2024-05-08T10:53:52.112 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-05-08T10:53:52.171 INFO:teuthology.orchestra.run.smithi033.stdout:creating /etc/ceph/ceph.keyring 2024-05-08T10:53:52.174 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-05-08T10:53:52.221 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-08T10:53:52.248 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.33'), ('mon.b', '172.21.15.174'), ('mon.c', '[v2:172.21.15.174:3301,v1:172.21.15.174:6790]')] 2024-05-08T10:53:52.248 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.33,172.21.15.174,[v2:172.21.15.174:3301,v1:172.21.15.174:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-05-08T10:53:52.249 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-05-08T10:53:52.249 DEBUG:teuthology.orchestra.run.smithi033:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-05-08T10:53:52.304 DEBUG:teuthology.orchestra.run.smithi033:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.33 --add b 172.21.15.174 --addv c '[v2:172.21.15.174:3301,v1:172.21.15.174:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-05-08T10:53:52.393 INFO:teuthology.orchestra.run.smithi033.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-05-08T10:53:52.393 INFO:teuthology.orchestra.run.smithi033.stdout:monmaptool: generated fsid 963217b2-c375-4f5a-95cf-88e199dd38ff 2024-05-08T10:53:52.393 INFO:teuthology.orchestra.run.smithi033.stdout:setting min_mon_release = quincy 2024-05-08T10:53:52.393 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 0 2024-05-08T10:53:52.393 INFO:teuthology.orchestra.run.smithi033.stdout:fsid 963217b2-c375-4f5a-95cf-88e199dd38ff 2024-05-08T10:53:52.393 INFO:teuthology.orchestra.run.smithi033.stdout:last_changed 2024-05-08T10:53:52.397418+0000 2024-05-08T10:53:52.394 INFO:teuthology.orchestra.run.smithi033.stdout:created 2024-05-08T10:53:52.397418+0000 2024-05-08T10:53:52.394 INFO:teuthology.orchestra.run.smithi033.stdout:min_mon_release 17 (quincy) 2024-05-08T10:53:52.394 INFO:teuthology.orchestra.run.smithi033.stdout:election_strategy: 1 2024-05-08T10:53:52.394 INFO:teuthology.orchestra.run.smithi033.stdout:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-05-08T10:53:52.394 INFO:teuthology.orchestra.run.smithi033.stdout:1: [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] mon.b 2024-05-08T10:53:52.394 INFO:teuthology.orchestra.run.smithi033.stdout:2: [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] mon.c 2024-05-08T10:53:52.394 INFO:teuthology.orchestra.run.smithi033.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-05-08T10:53:52.395 DEBUG:teuthology.orchestra.run.smithi033:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-05-08T10:53:52.411 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 963217b2-c375-4f5a-95cf-88e199dd38ff... 2024-05-08T10:53:52.412 DEBUG:teuthology.orchestra.run.smithi033:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-08T10:53:52.453 DEBUG:teuthology.orchestra.run.smithi174:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-08T10:53:52.495 INFO:teuthology.orchestra.run.smithi033.stdout:[global] 2024-05-08T10:53:52.496 INFO:teuthology.orchestra.run.smithi033.stdout: chdir = "" 2024-05-08T10:53:52.496 INFO:teuthology.orchestra.run.smithi033.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-08T10:53:52.496 INFO:teuthology.orchestra.run.smithi033.stdout: auth supported = cephx 2024-05-08T10:53:52.496 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:53:52.496 INFO:teuthology.orchestra.run.smithi033.stdout: filestore xattr use omap = true 2024-05-08T10:53:52.496 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:53:52.496 INFO:teuthology.orchestra.run.smithi033.stdout: mon clock drift allowed = 1.000 2024-05-08T10:53:52.496 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:53:52.496 INFO:teuthology.orchestra.run.smithi033.stdout: osd crush chooseleaf type = 0 2024-05-08T10:53:52.496 INFO:teuthology.orchestra.run.smithi033.stdout: auth debug = true 2024-05-08T10:53:52.496 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:53:52.496 INFO:teuthology.orchestra.run.smithi033.stdout: ms die on old message = true 2024-05-08T10:53:52.496 INFO:teuthology.orchestra.run.smithi033.stdout: ms die on bug = true 2024-05-08T10:53:52.496 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:53:52.496 INFO:teuthology.orchestra.run.smithi033.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-08T10:53:52.497 INFO:teuthology.orchestra.run.smithi033.stdout: mon pg warn max object skew = 0 2024-05-08T10:53:52.497 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:53:52.497 INFO:teuthology.orchestra.run.smithi033.stdout: # disable pg_autoscaler by default for new pools 2024-05-08T10:53:52.497 INFO:teuthology.orchestra.run.smithi033.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-08T10:53:52.497 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:53:52.497 INFO:teuthology.orchestra.run.smithi033.stdout: osd pool default size = 2 2024-05-08T10:53:52.497 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:53:52.497 INFO:teuthology.orchestra.run.smithi033.stdout: mon osd allow primary affinity = true 2024-05-08T10:53:52.497 INFO:teuthology.orchestra.run.smithi033.stdout: mon osd allow pg remap = true 2024-05-08T10:53:52.497 INFO:teuthology.orchestra.run.smithi033.stdout: mon warn on legacy crush tunables = false 2024-05-08T10:53:52.497 INFO:teuthology.orchestra.run.smithi033.stdout: mon warn on crush straw calc version zero = false 2024-05-08T10:53:52.497 INFO:teuthology.orchestra.run.smithi033.stdout: mon warn on no sortbitwise = false 2024-05-08T10:53:52.497 INFO:teuthology.orchestra.run.smithi033.stdout: mon warn on osd down out interval zero = false 2024-05-08T10:53:52.497 INFO:teuthology.orchestra.run.smithi033.stdout: mon warn on too few osds = false 2024-05-08T10:53:52.497 INFO:teuthology.orchestra.run.smithi033.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-08T10:53:52.498 INFO:teuthology.orchestra.run.smithi033.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-08T10:53:52.498 INFO:teuthology.orchestra.run.smithi033.stdout: mon_allow_pool_size_one = true 2024-05-08T10:53:52.498 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:53:52.498 INFO:teuthology.orchestra.run.smithi033.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-08T10:53:52.498 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:53:52.498 INFO:teuthology.orchestra.run.smithi033.stdout: osd default data pool replay window = 5 2024-05-08T10:53:52.498 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:53:52.498 INFO:teuthology.orchestra.run.smithi033.stdout: mon allow pool delete = true 2024-05-08T10:53:52.498 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:53:52.498 INFO:teuthology.orchestra.run.smithi033.stdout: mon cluster log file level = debug 2024-05-08T10:53:52.498 INFO:teuthology.orchestra.run.smithi033.stdout: debug asserts on shutdown = true 2024-05-08T10:53:52.498 INFO:teuthology.orchestra.run.smithi033.stdout: mon health detail to clog = false 2024-05-08T10:53:52.498 INFO:teuthology.orchestra.run.smithi033.stdout: mon host = "172.21.15.33,172.21.15.174,[v2:172.21.15.174:3301,v1:172.21.15.174:6790]" 2024-05-08T10:53:52.499 INFO:teuthology.orchestra.run.smithi033.stdout: ms die on skipped message = False 2024-05-08T10:53:52.499 INFO:teuthology.orchestra.run.smithi033.stdout: fsid = 963217b2-c375-4f5a-95cf-88e199dd38ff 2024-05-08T10:53:52.499 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:53:52.499 INFO:teuthology.orchestra.run.smithi033.stdout:[osd] 2024-05-08T10:53:52.499 INFO:teuthology.orchestra.run.smithi033.stdout: osd journal size = 100 2024-05-08T10:53:52.499 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:53:52.499 INFO:teuthology.orchestra.run.smithi033.stdout: osd scrub load threshold = 5.0 2024-05-08T10:53:52.499 INFO:teuthology.orchestra.run.smithi033.stdout: osd scrub max interval = 600 2024-05-08T10:53:52.499 INFO:teuthology.orchestra.run.smithi033.stdout: osd mclock profile = high_recovery_ops 2024-05-08T10:53:52.499 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:53:52.499 INFO:teuthology.orchestra.run.smithi033.stdout: osd recover clone overlap = true 2024-05-08T10:53:52.499 INFO:teuthology.orchestra.run.smithi033.stdout: osd recovery max chunk = 1048576 2024-05-08T10:53:52.499 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:53:52.499 INFO:teuthology.orchestra.run.smithi033.stdout: osd debug shutdown = true 2024-05-08T10:53:52.499 INFO:teuthology.orchestra.run.smithi033.stdout: osd debug op order = true 2024-05-08T10:53:52.500 INFO:teuthology.orchestra.run.smithi033.stdout: osd debug verify stray on activate = true 2024-05-08T10:53:52.500 INFO:teuthology.orchestra.run.smithi033.stdout: osd debug trim objects = true 2024-05-08T10:53:52.500 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:53:52.500 INFO:teuthology.orchestra.run.smithi033.stdout: osd open classes on start = true 2024-05-08T10:53:52.500 INFO:teuthology.orchestra.run.smithi033.stdout: osd debug pg log writeout = true 2024-05-08T10:53:52.500 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:53:52.500 INFO:teuthology.orchestra.run.smithi033.stdout: osd deep scrub update digest min age = 30 2024-05-08T10:53:52.500 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:53:52.500 INFO:teuthology.orchestra.run.smithi033.stdout: osd map max advance = 10 2024-05-08T10:53:52.500 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:53:52.501 INFO:teuthology.orchestra.run.smithi033.stdout: journal zero on create = true 2024-05-08T10:53:52.501 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:53:52.501 INFO:teuthology.orchestra.run.smithi033.stdout: filestore ondisk finisher threads = 3 2024-05-08T10:53:52.501 INFO:teuthology.orchestra.run.smithi033.stdout: filestore apply finisher threads = 3 2024-05-08T10:53:52.501 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:53:52.501 INFO:teuthology.orchestra.run.smithi033.stdout: bdev debug aio = true 2024-05-08T10:53:52.501 INFO:teuthology.orchestra.run.smithi033.stdout: osd debug misdirected ops = true 2024-05-08T10:53:52.501 INFO:teuthology.orchestra.run.smithi033.stdout: bdev async discard = True 2024-05-08T10:53:52.501 INFO:teuthology.orchestra.run.smithi033.stdout: bdev enable discard = True 2024-05-08T10:53:52.501 INFO:teuthology.orchestra.run.smithi033.stdout: bluestore allocator = bitmap 2024-05-08T10:53:52.501 INFO:teuthology.orchestra.run.smithi033.stdout: bluestore block size = 96636764160 2024-05-08T10:53:52.501 INFO:teuthology.orchestra.run.smithi033.stdout: bluestore fsck on mount = True 2024-05-08T10:53:52.501 INFO:teuthology.orchestra.run.smithi033.stdout: debug bluefs = 1/20 2024-05-08T10:53:52.501 INFO:teuthology.orchestra.run.smithi033.stdout: debug bluestore = 1/20 2024-05-08T10:53:52.501 INFO:teuthology.orchestra.run.smithi033.stdout: debug ms = 1 2024-05-08T10:53:52.502 INFO:teuthology.orchestra.run.smithi033.stdout: debug osd = 20 2024-05-08T10:53:52.502 INFO:teuthology.orchestra.run.smithi033.stdout: debug rocksdb = 4/10 2024-05-08T10:53:52.502 INFO:teuthology.orchestra.run.smithi033.stdout: mon osd backfillfull_ratio = 0.85 2024-05-08T10:53:52.502 INFO:teuthology.orchestra.run.smithi033.stdout: mon osd full ratio = 0.9 2024-05-08T10:53:52.502 INFO:teuthology.orchestra.run.smithi033.stdout: mon osd nearfull ratio = 0.8 2024-05-08T10:53:52.502 INFO:teuthology.orchestra.run.smithi033.stdout: osd failsafe full ratio = 0.95 2024-05-08T10:53:52.502 INFO:teuthology.orchestra.run.smithi033.stdout: osd objectstore = bluestore 2024-05-08T10:53:52.502 INFO:teuthology.orchestra.run.smithi033.stdout: osd op complaint time = 180 2024-05-08T10:53:52.502 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:53:52.502 INFO:teuthology.orchestra.run.smithi033.stdout:[mgr] 2024-05-08T10:53:52.502 INFO:teuthology.orchestra.run.smithi033.stdout: debug ms = 1 2024-05-08T10:53:52.502 INFO:teuthology.orchestra.run.smithi033.stdout: debug mgr = 20 2024-05-08T10:53:52.502 INFO:teuthology.orchestra.run.smithi033.stdout: debug mon = 20 2024-05-08T10:53:52.503 INFO:teuthology.orchestra.run.smithi033.stdout: debug auth = 20 2024-05-08T10:53:52.503 INFO:teuthology.orchestra.run.smithi033.stdout: mon reweight min pgs per osd = 4 2024-05-08T10:53:52.503 INFO:teuthology.orchestra.run.smithi033.stdout: mon reweight min bytes per osd = 10 2024-05-08T10:53:52.503 INFO:teuthology.orchestra.run.smithi033.stdout: mgr/telemetry/nag = false 2024-05-08T10:53:52.503 INFO:teuthology.orchestra.run.smithi033.stdout: debug client = 20 2024-05-08T10:53:52.503 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:53:52.503 INFO:teuthology.orchestra.run.smithi033.stdout:[mon] 2024-05-08T10:53:52.503 INFO:teuthology.orchestra.run.smithi033.stdout: debug ms = 1 2024-05-08T10:53:52.503 INFO:teuthology.orchestra.run.smithi033.stdout: debug mon = 20 2024-05-08T10:53:52.503 INFO:teuthology.orchestra.run.smithi033.stdout: debug paxos = 20 2024-05-08T10:53:52.503 INFO:teuthology.orchestra.run.smithi033.stdout: debug auth = 20 2024-05-08T10:53:52.503 INFO:teuthology.orchestra.run.smithi033.stdout: mon data avail warn = 5 2024-05-08T10:53:52.503 INFO:teuthology.orchestra.run.smithi033.stdout: mon mgr mkfs grace = 240 2024-05-08T10:53:52.503 INFO:teuthology.orchestra.run.smithi033.stdout: mon reweight min pgs per osd = 4 2024-05-08T10:53:52.503 INFO:teuthology.orchestra.run.smithi033.stdout: mon osd reporter subtree level = osd 2024-05-08T10:53:52.504 INFO:teuthology.orchestra.run.smithi033.stdout: mon osd prime pg temp = true 2024-05-08T10:53:52.504 INFO:teuthology.orchestra.run.smithi033.stdout: mon reweight min bytes per osd = 10 2024-05-08T10:53:52.504 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:53:52.504 INFO:teuthology.orchestra.run.smithi033.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-08T10:53:52.504 INFO:teuthology.orchestra.run.smithi033.stdout: auth mon ticket ttl = 660 # 11m 2024-05-08T10:53:52.504 INFO:teuthology.orchestra.run.smithi033.stdout: auth service ticket ttl = 240 # 4m 2024-05-08T10:53:52.504 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:53:52.504 INFO:teuthology.orchestra.run.smithi033.stdout: # don't complain about insecure global_id in the test suite 2024-05-08T10:53:52.504 INFO:teuthology.orchestra.run.smithi033.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-08T10:53:52.504 INFO:teuthology.orchestra.run.smithi033.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-08T10:53:52.504 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:53:52.504 INFO:teuthology.orchestra.run.smithi033.stdout: # 1m isn't quite enough 2024-05-08T10:53:52.504 INFO:teuthology.orchestra.run.smithi033.stdout: mon_down_mkfs_grace = 2m 2024-05-08T10:53:52.504 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:53:52.504 INFO:teuthology.orchestra.run.smithi033.stdout: mon_warn_on_filestore_osds = false 2024-05-08T10:53:52.504 INFO:teuthology.orchestra.run.smithi033.stdout: mon down mkfs grace = 300 2024-05-08T10:53:52.505 INFO:teuthology.orchestra.run.smithi033.stdout: mon op complaint time = 120 2024-05-08T10:53:52.505 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:53:52.505 INFO:teuthology.orchestra.run.smithi033.stdout:[client] 2024-05-08T10:53:52.505 INFO:teuthology.orchestra.run.smithi033.stdout: rgw cache enabled = true 2024-05-08T10:53:52.505 INFO:teuthology.orchestra.run.smithi033.stdout: rgw enable ops log = true 2024-05-08T10:53:52.505 INFO:teuthology.orchestra.run.smithi033.stdout: rgw enable usage log = true 2024-05-08T10:53:52.505 INFO:teuthology.orchestra.run.smithi033.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-08T10:53:52.505 INFO:teuthology.orchestra.run.smithi033.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-08T10:53:52.505 INFO:teuthology.orchestra.run.smithi033.stdout: client mount timeout = 600 2024-05-08T10:53:52.505 INFO:teuthology.orchestra.run.smithi033.stdout: debug client = 20 2024-05-08T10:53:52.505 INFO:teuthology.orchestra.run.smithi033.stdout: debug ms = 1 2024-05-08T10:53:52.505 INFO:teuthology.orchestra.run.smithi033.stdout: pid file = "" 2024-05-08T10:53:52.505 INFO:teuthology.orchestra.run.smithi033.stdout: rados mon op timeout = 900 2024-05-08T10:53:52.505 INFO:teuthology.orchestra.run.smithi033.stdout: rados osd op timeout = 900 2024-05-08T10:53:52.505 INFO:teuthology.orchestra.run.smithi033.stdout:[mon.a] 2024-05-08T10:53:52.506 INFO:teuthology.orchestra.run.smithi033.stdout:[mon.b] 2024-05-08T10:53:52.506 INFO:teuthology.orchestra.run.smithi033.stdout:[mon.c] 2024-05-08T10:53:52.506 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.a] 2024-05-08T10:53:52.506 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.c] 2024-05-08T10:53:52.506 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.b] 2024-05-08T10:53:52.506 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.d] 2024-05-08T10:53:52.506 INFO:teuthology.orchestra.run.smithi033.stdout:[mds] 2024-05-08T10:53:52.506 INFO:teuthology.orchestra.run.smithi033.stdout: debug mds = 20 2024-05-08T10:53:52.506 INFO:teuthology.orchestra.run.smithi033.stdout: debug mds balancer = 20 2024-05-08T10:53:52.506 INFO:teuthology.orchestra.run.smithi033.stdout: debug ms = 1 2024-05-08T10:53:52.506 INFO:teuthology.orchestra.run.smithi033.stdout: mds debug frag = True 2024-05-08T10:53:52.506 INFO:teuthology.orchestra.run.smithi033.stdout: mds debug scatterstat = True 2024-05-08T10:53:52.506 INFO:teuthology.orchestra.run.smithi033.stdout: mds op complaint time = 180 2024-05-08T10:53:52.506 INFO:teuthology.orchestra.run.smithi033.stdout: mds verify scatter = True 2024-05-08T10:53:52.507 INFO:teuthology.orchestra.run.smithi033.stdout: osd op complaint time = 180 2024-05-08T10:53:52.507 INFO:teuthology.orchestra.run.smithi033.stdout: rados mon op timeout = 900 2024-05-08T10:53:52.507 INFO:teuthology.orchestra.run.smithi033.stdout: rados osd op timeout = 900 2024-05-08T10:53:52.507 INFO:teuthology.orchestra.run.smithi174.stdout:[global] 2024-05-08T10:53:52.507 INFO:teuthology.orchestra.run.smithi174.stdout: chdir = "" 2024-05-08T10:53:52.507 INFO:teuthology.orchestra.run.smithi174.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-08T10:53:52.507 INFO:teuthology.orchestra.run.smithi174.stdout: auth supported = cephx 2024-05-08T10:53:52.507 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-08T10:53:52.508 INFO:teuthology.orchestra.run.smithi174.stdout: filestore xattr use omap = true 2024-05-08T10:53:52.508 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-08T10:53:52.508 INFO:teuthology.orchestra.run.smithi174.stdout: mon clock drift allowed = 1.000 2024-05-08T10:53:52.508 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-08T10:53:52.508 INFO:teuthology.orchestra.run.smithi174.stdout: osd crush chooseleaf type = 0 2024-05-08T10:53:52.508 INFO:teuthology.orchestra.run.smithi174.stdout: auth debug = true 2024-05-08T10:53:52.508 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-08T10:53:52.508 INFO:teuthology.orchestra.run.smithi174.stdout: ms die on old message = true 2024-05-08T10:53:52.508 INFO:teuthology.orchestra.run.smithi174.stdout: ms die on bug = true 2024-05-08T10:53:52.508 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-08T10:53:52.508 INFO:teuthology.orchestra.run.smithi174.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-08T10:53:52.508 INFO:teuthology.orchestra.run.smithi174.stdout: mon pg warn max object skew = 0 2024-05-08T10:53:52.508 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-08T10:53:52.508 INFO:teuthology.orchestra.run.smithi174.stdout: # disable pg_autoscaler by default for new pools 2024-05-08T10:53:52.508 INFO:teuthology.orchestra.run.smithi174.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-08T10:53:52.508 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-08T10:53:52.509 INFO:teuthology.orchestra.run.smithi174.stdout: osd pool default size = 2 2024-05-08T10:53:52.509 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-08T10:53:52.509 INFO:teuthology.orchestra.run.smithi174.stdout: mon osd allow primary affinity = true 2024-05-08T10:53:52.509 INFO:teuthology.orchestra.run.smithi174.stdout: mon osd allow pg remap = true 2024-05-08T10:53:52.509 INFO:teuthology.orchestra.run.smithi174.stdout: mon warn on legacy crush tunables = false 2024-05-08T10:53:52.509 INFO:teuthology.orchestra.run.smithi174.stdout: mon warn on crush straw calc version zero = false 2024-05-08T10:53:52.509 INFO:teuthology.orchestra.run.smithi174.stdout: mon warn on no sortbitwise = false 2024-05-08T10:53:52.509 INFO:teuthology.orchestra.run.smithi174.stdout: mon warn on osd down out interval zero = false 2024-05-08T10:53:52.509 INFO:teuthology.orchestra.run.smithi174.stdout: mon warn on too few osds = false 2024-05-08T10:53:52.509 INFO:teuthology.orchestra.run.smithi174.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-08T10:53:52.509 INFO:teuthology.orchestra.run.smithi174.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-08T10:53:52.509 INFO:teuthology.orchestra.run.smithi174.stdout: mon_allow_pool_size_one = true 2024-05-08T10:53:52.509 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-08T10:53:52.509 INFO:teuthology.orchestra.run.smithi174.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-08T10:53:52.510 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-08T10:53:52.510 INFO:teuthology.orchestra.run.smithi174.stdout: osd default data pool replay window = 5 2024-05-08T10:53:52.510 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-08T10:53:52.510 INFO:teuthology.orchestra.run.smithi174.stdout: mon allow pool delete = true 2024-05-08T10:53:52.510 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-08T10:53:52.510 INFO:teuthology.orchestra.run.smithi174.stdout: mon cluster log file level = debug 2024-05-08T10:53:52.510 INFO:teuthology.orchestra.run.smithi174.stdout: debug asserts on shutdown = true 2024-05-08T10:53:52.510 INFO:teuthology.orchestra.run.smithi174.stdout: mon health detail to clog = false 2024-05-08T10:53:52.510 INFO:teuthology.orchestra.run.smithi174.stdout: mon host = "172.21.15.33,172.21.15.174,[v2:172.21.15.174:3301,v1:172.21.15.174:6790]" 2024-05-08T10:53:52.510 INFO:teuthology.orchestra.run.smithi174.stdout: ms die on skipped message = False 2024-05-08T10:53:52.510 INFO:teuthology.orchestra.run.smithi174.stdout: fsid = 963217b2-c375-4f5a-95cf-88e199dd38ff 2024-05-08T10:53:52.510 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-08T10:53:52.510 INFO:teuthology.orchestra.run.smithi174.stdout:[osd] 2024-05-08T10:53:52.511 INFO:teuthology.orchestra.run.smithi174.stdout: osd journal size = 100 2024-05-08T10:53:52.511 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-08T10:53:52.511 INFO:teuthology.orchestra.run.smithi174.stdout: osd scrub load threshold = 5.0 2024-05-08T10:53:52.511 INFO:teuthology.orchestra.run.smithi174.stdout: osd scrub max interval = 600 2024-05-08T10:53:52.511 INFO:teuthology.orchestra.run.smithi174.stdout: osd mclock profile = high_recovery_ops 2024-05-08T10:53:52.511 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-08T10:53:52.511 INFO:teuthology.orchestra.run.smithi174.stdout: osd recover clone overlap = true 2024-05-08T10:53:52.511 INFO:teuthology.orchestra.run.smithi174.stdout: osd recovery max chunk = 1048576 2024-05-08T10:53:52.511 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-08T10:53:52.511 INFO:teuthology.orchestra.run.smithi174.stdout: osd debug shutdown = true 2024-05-08T10:53:52.511 INFO:teuthology.orchestra.run.smithi174.stdout: osd debug op order = true 2024-05-08T10:53:52.511 INFO:teuthology.orchestra.run.smithi174.stdout: osd debug verify stray on activate = true 2024-05-08T10:53:52.511 INFO:teuthology.orchestra.run.smithi174.stdout: osd debug trim objects = true 2024-05-08T10:53:52.511 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-08T10:53:52.511 INFO:teuthology.orchestra.run.smithi174.stdout: osd open classes on start = true 2024-05-08T10:53:52.512 INFO:teuthology.orchestra.run.smithi174.stdout: osd debug pg log writeout = true 2024-05-08T10:53:52.512 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-08T10:53:52.512 INFO:teuthology.orchestra.run.smithi174.stdout: osd deep scrub update digest min age = 30 2024-05-08T10:53:52.512 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-08T10:53:52.512 INFO:teuthology.orchestra.run.smithi174.stdout: osd map max advance = 10 2024-05-08T10:53:52.512 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-08T10:53:52.512 INFO:teuthology.orchestra.run.smithi174.stdout: journal zero on create = true 2024-05-08T10:53:52.512 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-08T10:53:52.512 INFO:teuthology.orchestra.run.smithi174.stdout: filestore ondisk finisher threads = 3 2024-05-08T10:53:52.512 INFO:teuthology.orchestra.run.smithi174.stdout: filestore apply finisher threads = 3 2024-05-08T10:53:52.512 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-08T10:53:52.512 INFO:teuthology.orchestra.run.smithi174.stdout: bdev debug aio = true 2024-05-08T10:53:52.512 INFO:teuthology.orchestra.run.smithi174.stdout: osd debug misdirected ops = true 2024-05-08T10:53:52.512 INFO:teuthology.orchestra.run.smithi174.stdout: bdev async discard = True 2024-05-08T10:53:52.513 INFO:teuthology.orchestra.run.smithi174.stdout: bdev enable discard = True 2024-05-08T10:53:52.513 INFO:teuthology.orchestra.run.smithi174.stdout: bluestore allocator = bitmap 2024-05-08T10:53:52.513 INFO:teuthology.orchestra.run.smithi174.stdout: bluestore block size = 96636764160 2024-05-08T10:53:52.513 INFO:teuthology.orchestra.run.smithi174.stdout: bluestore fsck on mount = True 2024-05-08T10:53:52.513 INFO:teuthology.orchestra.run.smithi174.stdout: debug bluefs = 1/20 2024-05-08T10:53:52.513 INFO:teuthology.orchestra.run.smithi174.stdout: debug bluestore = 1/20 2024-05-08T10:53:52.513 INFO:teuthology.orchestra.run.smithi174.stdout: debug ms = 1 2024-05-08T10:53:52.513 INFO:teuthology.orchestra.run.smithi174.stdout: debug osd = 20 2024-05-08T10:53:52.513 INFO:teuthology.orchestra.run.smithi174.stdout: debug rocksdb = 4/10 2024-05-08T10:53:52.513 INFO:teuthology.orchestra.run.smithi174.stdout: mon osd backfillfull_ratio = 0.85 2024-05-08T10:53:52.513 INFO:teuthology.orchestra.run.smithi174.stdout: mon osd full ratio = 0.9 2024-05-08T10:53:52.513 INFO:teuthology.orchestra.run.smithi174.stdout: mon osd nearfull ratio = 0.8 2024-05-08T10:53:52.513 INFO:teuthology.orchestra.run.smithi174.stdout: osd failsafe full ratio = 0.95 2024-05-08T10:53:52.513 INFO:teuthology.orchestra.run.smithi174.stdout: osd objectstore = bluestore 2024-05-08T10:53:52.513 INFO:teuthology.orchestra.run.smithi174.stdout: osd op complaint time = 180 2024-05-08T10:53:52.514 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-08T10:53:52.514 INFO:teuthology.orchestra.run.smithi174.stdout:[mgr] 2024-05-08T10:53:52.514 INFO:teuthology.orchestra.run.smithi174.stdout: debug ms = 1 2024-05-08T10:53:52.514 INFO:teuthology.orchestra.run.smithi174.stdout: debug mgr = 20 2024-05-08T10:53:52.514 INFO:teuthology.orchestra.run.smithi174.stdout: debug mon = 20 2024-05-08T10:53:52.514 INFO:teuthology.orchestra.run.smithi174.stdout: debug auth = 20 2024-05-08T10:53:52.514 INFO:teuthology.orchestra.run.smithi174.stdout: mon reweight min pgs per osd = 4 2024-05-08T10:53:52.514 INFO:teuthology.orchestra.run.smithi174.stdout: mon reweight min bytes per osd = 10 2024-05-08T10:53:52.514 INFO:teuthology.orchestra.run.smithi174.stdout: mgr/telemetry/nag = false 2024-05-08T10:53:52.514 INFO:teuthology.orchestra.run.smithi174.stdout: debug client = 20 2024-05-08T10:53:52.514 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-08T10:53:52.514 INFO:teuthology.orchestra.run.smithi174.stdout:[mon] 2024-05-08T10:53:52.514 INFO:teuthology.orchestra.run.smithi174.stdout: debug ms = 1 2024-05-08T10:53:52.514 INFO:teuthology.orchestra.run.smithi174.stdout: debug mon = 20 2024-05-08T10:53:52.515 INFO:teuthology.orchestra.run.smithi174.stdout: debug paxos = 20 2024-05-08T10:53:52.515 INFO:teuthology.orchestra.run.smithi174.stdout: debug auth = 20 2024-05-08T10:53:52.515 INFO:teuthology.orchestra.run.smithi174.stdout: mon data avail warn = 5 2024-05-08T10:53:52.515 INFO:teuthology.orchestra.run.smithi174.stdout: mon mgr mkfs grace = 240 2024-05-08T10:53:52.515 INFO:teuthology.orchestra.run.smithi174.stdout: mon reweight min pgs per osd = 4 2024-05-08T10:53:52.515 INFO:teuthology.orchestra.run.smithi174.stdout: mon osd reporter subtree level = osd 2024-05-08T10:53:52.515 INFO:teuthology.orchestra.run.smithi174.stdout: mon osd prime pg temp = true 2024-05-08T10:53:52.515 INFO:teuthology.orchestra.run.smithi174.stdout: mon reweight min bytes per osd = 10 2024-05-08T10:53:52.515 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-08T10:53:52.515 INFO:teuthology.orchestra.run.smithi174.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-08T10:53:52.515 INFO:teuthology.orchestra.run.smithi174.stdout: auth mon ticket ttl = 660 # 11m 2024-05-08T10:53:52.515 INFO:teuthology.orchestra.run.smithi174.stdout: auth service ticket ttl = 240 # 4m 2024-05-08T10:53:52.515 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-08T10:53:52.515 INFO:teuthology.orchestra.run.smithi174.stdout: # don't complain about insecure global_id in the test suite 2024-05-08T10:53:52.515 INFO:teuthology.orchestra.run.smithi174.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-08T10:53:52.516 INFO:teuthology.orchestra.run.smithi174.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-08T10:53:52.516 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-08T10:53:52.516 INFO:teuthology.orchestra.run.smithi174.stdout: # 1m isn't quite enough 2024-05-08T10:53:52.516 INFO:teuthology.orchestra.run.smithi174.stdout: mon_down_mkfs_grace = 2m 2024-05-08T10:53:52.516 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-08T10:53:52.516 INFO:teuthology.orchestra.run.smithi174.stdout: mon_warn_on_filestore_osds = false 2024-05-08T10:53:52.516 INFO:teuthology.orchestra.run.smithi174.stdout: mon down mkfs grace = 300 2024-05-08T10:53:52.516 INFO:teuthology.orchestra.run.smithi174.stdout: mon op complaint time = 120 2024-05-08T10:53:52.516 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-08T10:53:52.516 INFO:teuthology.orchestra.run.smithi174.stdout:[client] 2024-05-08T10:53:52.516 INFO:teuthology.orchestra.run.smithi174.stdout: rgw cache enabled = true 2024-05-08T10:53:52.516 INFO:teuthology.orchestra.run.smithi174.stdout: rgw enable ops log = true 2024-05-08T10:53:52.516 INFO:teuthology.orchestra.run.smithi174.stdout: rgw enable usage log = true 2024-05-08T10:53:52.516 INFO:teuthology.orchestra.run.smithi174.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-08T10:53:52.516 INFO:teuthology.orchestra.run.smithi174.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-08T10:53:52.517 INFO:teuthology.orchestra.run.smithi174.stdout: client mount timeout = 600 2024-05-08T10:53:52.517 INFO:teuthology.orchestra.run.smithi174.stdout: debug client = 20 2024-05-08T10:53:52.517 INFO:teuthology.orchestra.run.smithi174.stdout: debug ms = 1 2024-05-08T10:53:52.517 INFO:teuthology.orchestra.run.smithi174.stdout: pid file = "" 2024-05-08T10:53:52.517 INFO:teuthology.orchestra.run.smithi174.stdout: rados mon op timeout = 900 2024-05-08T10:53:52.517 INFO:teuthology.orchestra.run.smithi174.stdout: rados osd op timeout = 900 2024-05-08T10:53:52.517 INFO:teuthology.orchestra.run.smithi174.stdout:[mon.a] 2024-05-08T10:53:52.517 INFO:teuthology.orchestra.run.smithi174.stdout:[mon.b] 2024-05-08T10:53:52.517 INFO:teuthology.orchestra.run.smithi174.stdout:[mon.c] 2024-05-08T10:53:52.517 INFO:teuthology.orchestra.run.smithi174.stdout:[mds.a] 2024-05-08T10:53:52.517 INFO:teuthology.orchestra.run.smithi174.stdout:[mds.c] 2024-05-08T10:53:52.517 INFO:teuthology.orchestra.run.smithi174.stdout:[mds.b] 2024-05-08T10:53:52.518 INFO:teuthology.orchestra.run.smithi174.stdout:[mds.d] 2024-05-08T10:53:52.518 INFO:teuthology.orchestra.run.smithi174.stdout:[mds] 2024-05-08T10:53:52.518 INFO:teuthology.orchestra.run.smithi174.stdout: debug mds = 20 2024-05-08T10:53:52.518 INFO:teuthology.orchestra.run.smithi174.stdout: debug mds balancer = 20 2024-05-08T10:53:52.518 INFO:teuthology.orchestra.run.smithi174.stdout: debug ms = 1 2024-05-08T10:53:52.519 INFO:teuthology.orchestra.run.smithi174.stdout: mds debug frag = True 2024-05-08T10:53:52.519 INFO:teuthology.orchestra.run.smithi174.stdout: mds debug scatterstat = True 2024-05-08T10:53:52.519 INFO:teuthology.orchestra.run.smithi174.stdout: mds op complaint time = 180 2024-05-08T10:53:52.519 INFO:teuthology.orchestra.run.smithi174.stdout: mds verify scatter = True 2024-05-08T10:53:52.519 INFO:teuthology.orchestra.run.smithi174.stdout: osd op complaint time = 180 2024-05-08T10:53:52.519 INFO:teuthology.orchestra.run.smithi174.stdout: rados mon op timeout = 900 2024-05-08T10:53:52.519 INFO:teuthology.orchestra.run.smithi174.stdout: rados osd op timeout = 900 2024-05-08T10:53:52.520 INFO:tasks.ceph:Creating admin key on mon.a... 2024-05-08T10:53:52.520 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-05-08T10:53:52.615 INFO:tasks.ceph:Copying monmap to all nodes... 2024-05-08T10:53:52.615 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-05-08T10:53:52.616 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-05-08T10:53:52.632 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-05-08T10:53:52.632 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-05-08T10:53:52.688 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi033.front.sepia.ceph.com 2024-05-08T10:53:52.688 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-05-08T10:53:52.688 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-08T10:53:52.688 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-08T10:53:52.763 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-05-08T10:53:52.764 DEBUG:teuthology.orchestra.run.smithi033:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-08T10:53:52.819 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi174.front.sepia.ceph.com 2024-05-08T10:53:52.819 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-05-08T10:53:52.820 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-08T10:53:52.820 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-08T10:53:52.856 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-05-08T10:53:52.856 DEBUG:teuthology.orchestra.run.smithi174:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-08T10:53:52.912 INFO:tasks.ceph:Setting up mon nodes... 2024-05-08T10:53:52.912 INFO:tasks.ceph:Setting up mgr nodes... 2024-05-08T10:53:52.912 DEBUG:teuthology.orchestra.run.smithi033:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-05-08T10:53:52.965 INFO:teuthology.orchestra.run.smithi033.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-05-08T10:53:52.967 DEBUG:teuthology.orchestra.run.smithi174:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-05-08T10:53:53.027 INFO:teuthology.orchestra.run.smithi174.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-05-08T10:53:53.030 INFO:tasks.ceph:Setting up mds nodes... 2024-05-08T10:53:53.030 DEBUG:teuthology.orchestra.run.smithi033:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-05-08T10:53:53.083 INFO:teuthology.orchestra.run.smithi033.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-05-08T10:53:53.086 DEBUG:teuthology.orchestra.run.smithi033:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-05-08T10:53:53.111 DEBUG:teuthology.orchestra.run.smithi033:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-05-08T10:53:53.204 INFO:teuthology.orchestra.run.smithi033.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-05-08T10:53:53.207 DEBUG:teuthology.orchestra.run.smithi033:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-05-08T10:53:53.232 DEBUG:teuthology.orchestra.run.smithi174:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-05-08T10:53:53.283 INFO:teuthology.orchestra.run.smithi174.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-05-08T10:53:53.285 DEBUG:teuthology.orchestra.run.smithi174:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-05-08T10:53:53.310 DEBUG:teuthology.orchestra.run.smithi174:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-05-08T10:53:53.400 INFO:teuthology.orchestra.run.smithi174.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-05-08T10:53:53.403 DEBUG:teuthology.orchestra.run.smithi174:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-05-08T10:53:53.427 INFO:tasks.ceph_client:Setting up client nodes... 2024-05-08T10:53:53.427 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-05-08T10:53:53.469 INFO:teuthology.orchestra.run.smithi033.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-05-08T10:53:53.482 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-05-08T10:53:53.564 INFO:teuthology.orchestra.run.smithi033.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-05-08T10:53:53.577 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-05-08T10:53:53.618 INFO:teuthology.orchestra.run.smithi174.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-05-08T10:53:53.631 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-05-08T10:53:53.711 INFO:teuthology.orchestra.run.smithi174.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-05-08T10:53:53.724 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-05-08T10:53:53.724 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi033.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi174.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-08T10:53:53.724 DEBUG:teuthology.orchestra.run.smithi033:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-05-08T10:53:53.750 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-08T10:53:53.750 INFO:tasks.ceph:role: osd.0 2024-05-08T10:53:53.750 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi033.front.sepia.ceph.com 2024-05-08T10:53:53.750 DEBUG:teuthology.orchestra.run.smithi033:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-08T10:53:53.822 INFO:teuthology.orchestra.run.smithi033.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-08T10:53:53.823 INFO:teuthology.orchestra.run.smithi033.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-08T10:53:53.823 INFO:teuthology.orchestra.run.smithi033.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-08T10:53:53.823 INFO:teuthology.orchestra.run.smithi033.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-08T10:53:53.823 INFO:teuthology.orchestra.run.smithi033.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-08T10:53:53.823 INFO:teuthology.orchestra.run.smithi033.stdout: = sunit=0 swidth=0 blks 2024-05-08T10:53:53.823 INFO:teuthology.orchestra.run.smithi033.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-08T10:53:53.823 INFO:teuthology.orchestra.run.smithi033.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-08T10:53:53.823 INFO:teuthology.orchestra.run.smithi033.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-08T10:53:53.823 INFO:teuthology.orchestra.run.smithi033.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-08T10:53:54.327 INFO:teuthology.orchestra.run.smithi033.stdout:Discarding blocks...Done. 2024-05-08T10:53:54.330 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi033.front.sepia.ceph.com -o noatime 2024-05-08T10:53:54.330 DEBUG:teuthology.orchestra.run.smithi033:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-05-08T10:53:54.476 DEBUG:teuthology.orchestra.run.smithi033:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-05-08T10:53:54.510 DEBUG:teuthology.orchestra.run.smithi033:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-05-08T10:53:54.576 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-08T10:53:54.576 INFO:tasks.ceph:role: osd.1 2024-05-08T10:53:54.576 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi033.front.sepia.ceph.com 2024-05-08T10:53:54.576 DEBUG:teuthology.orchestra.run.smithi033:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-08T10:53:54.650 INFO:teuthology.orchestra.run.smithi033.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-08T10:53:54.651 INFO:teuthology.orchestra.run.smithi033.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-08T10:53:54.651 INFO:teuthology.orchestra.run.smithi033.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-08T10:53:54.651 INFO:teuthology.orchestra.run.smithi033.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-08T10:53:54.651 INFO:teuthology.orchestra.run.smithi033.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-08T10:53:54.651 INFO:teuthology.orchestra.run.smithi033.stdout: = sunit=0 swidth=0 blks 2024-05-08T10:53:54.651 INFO:teuthology.orchestra.run.smithi033.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-08T10:53:54.651 INFO:teuthology.orchestra.run.smithi033.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-08T10:53:54.651 INFO:teuthology.orchestra.run.smithi033.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-08T10:53:54.651 INFO:teuthology.orchestra.run.smithi033.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-08T10:53:55.092 INFO:teuthology.orchestra.run.smithi033.stdout:Discarding blocks...Done. 2024-05-08T10:53:55.095 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi033.front.sepia.ceph.com -o noatime 2024-05-08T10:53:55.095 DEBUG:teuthology.orchestra.run.smithi033:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-05-08T10:53:55.185 DEBUG:teuthology.orchestra.run.smithi033:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-05-08T10:53:55.214 DEBUG:teuthology.orchestra.run.smithi033:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-05-08T10:53:55.281 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-08T10:53:55.281 INFO:tasks.ceph:role: osd.2 2024-05-08T10:53:55.281 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi033.front.sepia.ceph.com 2024-05-08T10:53:55.281 DEBUG:teuthology.orchestra.run.smithi033:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-08T10:53:55.356 INFO:teuthology.orchestra.run.smithi033.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-08T10:53:55.356 INFO:teuthology.orchestra.run.smithi033.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-08T10:53:55.356 INFO:teuthology.orchestra.run.smithi033.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-08T10:53:55.356 INFO:teuthology.orchestra.run.smithi033.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-08T10:53:55.356 INFO:teuthology.orchestra.run.smithi033.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-08T10:53:55.356 INFO:teuthology.orchestra.run.smithi033.stdout: = sunit=0 swidth=0 blks 2024-05-08T10:53:55.356 INFO:teuthology.orchestra.run.smithi033.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-08T10:53:55.357 INFO:teuthology.orchestra.run.smithi033.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-08T10:53:55.357 INFO:teuthology.orchestra.run.smithi033.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-08T10:53:55.357 INFO:teuthology.orchestra.run.smithi033.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-08T10:53:55.839 INFO:teuthology.orchestra.run.smithi033.stdout:Discarding blocks...Done. 2024-05-08T10:53:55.841 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi033.front.sepia.ceph.com -o noatime 2024-05-08T10:53:55.841 DEBUG:teuthology.orchestra.run.smithi033:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-05-08T10:53:55.969 DEBUG:teuthology.orchestra.run.smithi033:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-05-08T10:53:56.000 DEBUG:teuthology.orchestra.run.smithi033:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-05-08T10:53:56.067 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-08T10:53:56.068 INFO:tasks.ceph:role: osd.3 2024-05-08T10:53:56.068 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi033.front.sepia.ceph.com 2024-05-08T10:53:56.068 DEBUG:teuthology.orchestra.run.smithi033:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-08T10:53:56.142 INFO:teuthology.orchestra.run.smithi033.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-08T10:53:56.142 INFO:teuthology.orchestra.run.smithi033.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-08T10:53:56.142 INFO:teuthology.orchestra.run.smithi033.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-08T10:53:56.142 INFO:teuthology.orchestra.run.smithi033.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-08T10:53:56.142 INFO:teuthology.orchestra.run.smithi033.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-08T10:53:56.142 INFO:teuthology.orchestra.run.smithi033.stdout: = sunit=0 swidth=0 blks 2024-05-08T10:53:56.142 INFO:teuthology.orchestra.run.smithi033.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-08T10:53:56.143 INFO:teuthology.orchestra.run.smithi033.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-08T10:53:56.143 INFO:teuthology.orchestra.run.smithi033.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-08T10:53:56.143 INFO:teuthology.orchestra.run.smithi033.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-08T10:53:56.658 INFO:teuthology.orchestra.run.smithi033.stdout:Discarding blocks...Done. 2024-05-08T10:53:56.661 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi033.front.sepia.ceph.com -o noatime 2024-05-08T10:53:56.661 DEBUG:teuthology.orchestra.run.smithi033:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-05-08T10:53:56.789 DEBUG:teuthology.orchestra.run.smithi033:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-05-08T10:53:56.825 DEBUG:teuthology.orchestra.run.smithi033:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-08T10:53:56.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:53:56.927+0000 7f70afe14640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-05-08T10:53:56.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:53:56.927+0000 7f70afe14640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-05-08T10:53:56.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:53:56.927+0000 7f70afe14640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-08T10:53:56.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:53:56.927+0000 7f70afe14640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-08T10:53:56.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:53:56.927+0000 7f70afe14640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-08T10:53:56.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:53:56.927+0000 7f70afe14640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-05-08T10:53:59.777 DEBUG:teuthology.orchestra.run.smithi033:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-05-08T10:53:59.808 DEBUG:teuthology.orchestra.run.smithi033:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-08T10:53:59.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:53:59.903+0000 7ff0600fd640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-05-08T10:53:59.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:53:59.904+0000 7ff0600fd640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-05-08T10:53:59.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:53:59.904+0000 7ff0600fd640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-08T10:53:59.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:53:59.904+0000 7ff0600fd640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-08T10:53:59.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:53:59.904+0000 7ff0600fd640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-08T10:53:59.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:53:59.905+0000 7ff0600fd640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-05-08T10:54:02.760 DEBUG:teuthology.orchestra.run.smithi033:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-05-08T10:54:02.791 DEBUG:teuthology.orchestra.run.smithi033:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-08T10:54:02.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:02.887+0000 7f74d5fcb640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-05-08T10:54:02.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:02.887+0000 7f74d5fcb640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-05-08T10:54:02.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:02.887+0000 7f74d5fcb640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-08T10:54:02.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:02.887+0000 7f74d5fcb640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-08T10:54:02.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:02.887+0000 7f74d5fcb640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-08T10:54:02.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:02.888+0000 7f74d5fcb640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-05-08T10:54:05.731 DEBUG:teuthology.orchestra.run.smithi033:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-05-08T10:54:05.761 DEBUG:teuthology.orchestra.run.smithi033:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-08T10:54:05.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:05.855+0000 7fa68d212640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-05-08T10:54:05.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:05.856+0000 7fa68d212640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-05-08T10:54:05.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:05.856+0000 7fa68d212640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-08T10:54:05.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:05.856+0000 7fa68d212640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-08T10:54:05.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:05.856+0000 7fa68d212640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-08T10:54:05.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:05.856+0000 7fa68d212640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-05-08T10:54:08.711 DEBUG:teuthology.orchestra.run.smithi033:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-05-08T10:54:08.742 DEBUG:teuthology.orchestra.run.smithi174:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-05-08T10:54:08.772 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-08T10:54:08.773 INFO:tasks.ceph:role: osd.4 2024-05-08T10:54:08.773 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi174.front.sepia.ceph.com 2024-05-08T10:54:08.773 DEBUG:teuthology.orchestra.run.smithi174:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-08T10:54:08.849 INFO:teuthology.orchestra.run.smithi174.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-08T10:54:08.849 INFO:teuthology.orchestra.run.smithi174.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-08T10:54:08.850 INFO:teuthology.orchestra.run.smithi174.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-08T10:54:08.850 INFO:teuthology.orchestra.run.smithi174.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-08T10:54:08.850 INFO:teuthology.orchestra.run.smithi174.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-08T10:54:08.850 INFO:teuthology.orchestra.run.smithi174.stdout: = sunit=0 swidth=0 blks 2024-05-08T10:54:08.850 INFO:teuthology.orchestra.run.smithi174.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-08T10:54:08.850 INFO:teuthology.orchestra.run.smithi174.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-08T10:54:08.850 INFO:teuthology.orchestra.run.smithi174.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-08T10:54:08.850 INFO:teuthology.orchestra.run.smithi174.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-08T10:54:09.373 INFO:teuthology.orchestra.run.smithi174.stdout:Discarding blocks...Done. 2024-05-08T10:54:09.375 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi174.front.sepia.ceph.com -o noatime 2024-05-08T10:54:09.375 DEBUG:teuthology.orchestra.run.smithi174:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-05-08T10:54:09.510 DEBUG:teuthology.orchestra.run.smithi174:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-05-08T10:54:09.548 DEBUG:teuthology.orchestra.run.smithi174:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-05-08T10:54:09.616 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-08T10:54:09.616 INFO:tasks.ceph:role: osd.5 2024-05-08T10:54:09.617 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi174.front.sepia.ceph.com 2024-05-08T10:54:09.617 DEBUG:teuthology.orchestra.run.smithi174:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-08T10:54:09.691 INFO:teuthology.orchestra.run.smithi174.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-08T10:54:09.691 INFO:teuthology.orchestra.run.smithi174.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-08T10:54:09.691 INFO:teuthology.orchestra.run.smithi174.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-08T10:54:09.691 INFO:teuthology.orchestra.run.smithi174.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-08T10:54:09.691 INFO:teuthology.orchestra.run.smithi174.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-08T10:54:09.691 INFO:teuthology.orchestra.run.smithi174.stdout: = sunit=0 swidth=0 blks 2024-05-08T10:54:09.691 INFO:teuthology.orchestra.run.smithi174.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-08T10:54:09.691 INFO:teuthology.orchestra.run.smithi174.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-08T10:54:09.691 INFO:teuthology.orchestra.run.smithi174.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-08T10:54:09.691 INFO:teuthology.orchestra.run.smithi174.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-08T10:54:10.134 INFO:teuthology.orchestra.run.smithi174.stdout:Discarding blocks...Done. 2024-05-08T10:54:10.136 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi174.front.sepia.ceph.com -o noatime 2024-05-08T10:54:10.137 DEBUG:teuthology.orchestra.run.smithi174:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-05-08T10:54:10.223 DEBUG:teuthology.orchestra.run.smithi174:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-05-08T10:54:10.254 DEBUG:teuthology.orchestra.run.smithi174:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-05-08T10:54:10.319 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-08T10:54:10.320 INFO:tasks.ceph:role: osd.6 2024-05-08T10:54:10.320 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi174.front.sepia.ceph.com 2024-05-08T10:54:10.320 DEBUG:teuthology.orchestra.run.smithi174:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-08T10:54:10.393 INFO:teuthology.orchestra.run.smithi174.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-08T10:54:10.393 INFO:teuthology.orchestra.run.smithi174.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-08T10:54:10.393 INFO:teuthology.orchestra.run.smithi174.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-08T10:54:10.393 INFO:teuthology.orchestra.run.smithi174.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-08T10:54:10.393 INFO:teuthology.orchestra.run.smithi174.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-08T10:54:10.393 INFO:teuthology.orchestra.run.smithi174.stdout: = sunit=0 swidth=0 blks 2024-05-08T10:54:10.393 INFO:teuthology.orchestra.run.smithi174.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-08T10:54:10.393 INFO:teuthology.orchestra.run.smithi174.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-08T10:54:10.393 INFO:teuthology.orchestra.run.smithi174.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-08T10:54:10.393 INFO:teuthology.orchestra.run.smithi174.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-08T10:54:10.875 INFO:teuthology.orchestra.run.smithi174.stdout:Discarding blocks...Done. 2024-05-08T10:54:10.877 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi174.front.sepia.ceph.com -o noatime 2024-05-08T10:54:10.877 DEBUG:teuthology.orchestra.run.smithi174:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-05-08T10:54:11.003 DEBUG:teuthology.orchestra.run.smithi174:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-05-08T10:54:11.036 DEBUG:teuthology.orchestra.run.smithi174:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-05-08T10:54:11.105 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-08T10:54:11.105 INFO:tasks.ceph:role: osd.7 2024-05-08T10:54:11.105 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi174.front.sepia.ceph.com 2024-05-08T10:54:11.105 DEBUG:teuthology.orchestra.run.smithi174:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-08T10:54:11.179 INFO:teuthology.orchestra.run.smithi174.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-08T10:54:11.179 INFO:teuthology.orchestra.run.smithi174.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-08T10:54:11.179 INFO:teuthology.orchestra.run.smithi174.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-08T10:54:11.179 INFO:teuthology.orchestra.run.smithi174.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-08T10:54:11.180 INFO:teuthology.orchestra.run.smithi174.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-08T10:54:11.180 INFO:teuthology.orchestra.run.smithi174.stdout: = sunit=0 swidth=0 blks 2024-05-08T10:54:11.180 INFO:teuthology.orchestra.run.smithi174.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-08T10:54:11.180 INFO:teuthology.orchestra.run.smithi174.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-08T10:54:11.180 INFO:teuthology.orchestra.run.smithi174.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-08T10:54:11.180 INFO:teuthology.orchestra.run.smithi174.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-08T10:54:11.699 INFO:teuthology.orchestra.run.smithi174.stdout:Discarding blocks...Done. 2024-05-08T10:54:11.701 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi174.front.sepia.ceph.com -o noatime 2024-05-08T10:54:11.702 DEBUG:teuthology.orchestra.run.smithi174:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-05-08T10:54:11.821 DEBUG:teuthology.orchestra.run.smithi174:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-05-08T10:54:11.856 DEBUG:teuthology.orchestra.run.smithi174:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-08T10:54:11.955 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:11.957+0000 7f1773c14640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-05-08T10:54:11.955 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:11.957+0000 7f1773c14640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-05-08T10:54:11.955 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:11.957+0000 7f1773c14640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-08T10:54:11.955 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:11.957+0000 7f1773c14640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-08T10:54:11.955 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:11.957+0000 7f1773c14640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-08T10:54:11.955 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:11.958+0000 7f1773c14640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-05-08T10:54:14.807 DEBUG:teuthology.orchestra.run.smithi174:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-05-08T10:54:14.836 DEBUG:teuthology.orchestra.run.smithi174:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-08T10:54:14.928 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:14.930+0000 7f1aa260f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-05-08T10:54:14.928 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:14.930+0000 7f1aa260f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-05-08T10:54:14.928 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:14.930+0000 7f1aa260f640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-08T10:54:14.928 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:14.930+0000 7f1aa260f640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-08T10:54:14.928 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:14.930+0000 7f1aa260f640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-08T10:54:14.929 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:14.931+0000 7f1aa260f640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-05-08T10:54:17.778 DEBUG:teuthology.orchestra.run.smithi174:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-05-08T10:54:17.807 DEBUG:teuthology.orchestra.run.smithi174:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-08T10:54:17.897 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:17.900+0000 7f60ace1c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-05-08T10:54:17.898 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:17.900+0000 7f60ace1c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-05-08T10:54:17.898 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:17.900+0000 7f60ace1c640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-08T10:54:17.898 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:17.900+0000 7f60ace1c640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-08T10:54:17.898 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:17.900+0000 7f60ace1c640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-08T10:54:17.898 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:17.901+0000 7f60ace1c640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-05-08T10:54:20.522 DEBUG:teuthology.orchestra.run.smithi033:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T10:54:20.525 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T10:54:20.752 DEBUG:teuthology.orchestra.run.smithi174:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-05-08T10:54:20.781 DEBUG:teuthology.orchestra.run.smithi174:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-08T10:54:20.873 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:20.875+0000 7f9377629640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-05-08T10:54:20.873 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:20.875+0000 7f9377629640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-05-08T10:54:20.874 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:20.875+0000 7f9377629640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-08T10:54:20.874 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:20.875+0000 7f9377629640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-08T10:54:20.874 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:20.875+0000 7f9377629640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-08T10:54:20.874 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:20.876+0000 7f9377629640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-05-08T10:54:23.724 DEBUG:teuthology.orchestra.run.smithi174:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-05-08T10:54:23.753 INFO:tasks.ceph:Reading keys from all nodes... 2024-05-08T10:54:23.753 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-05-08T10:54:23.753 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-05-08T10:54:23.785 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-05-08T10:54:23.785 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-05-08T10:54:23.855 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-05-08T10:54:23.856 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-05-08T10:54:23.925 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-05-08T10:54:23.925 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-05-08T10:54:23.994 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-05-08T10:54:23.994 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-05-08T10:54:24.062 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-05-08T10:54:24.063 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-05-08T10:54:24.131 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-05-08T10:54:24.131 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-05-08T10:54:24.200 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-05-08T10:54:24.200 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-05-08T10:54:24.230 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-05-08T10:54:24.230 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-05-08T10:54:24.299 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-05-08T10:54:24.299 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-05-08T10:54:24.369 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-05-08T10:54:24.369 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-05-08T10:54:24.437 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-05-08T10:54:24.437 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-05-08T10:54:24.504 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-05-08T10:54:24.504 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-05-08T10:54:24.570 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-05-08T10:54:24.570 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-05-08T10:54:24.636 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-05-08T10:54:24.636 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-05-08T10:54:24.656 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-05-08T10:54:24.656 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-05-08T10:54:24.715 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-05-08T10:54:24.715 DEBUG:teuthology.orchestra.run.smithi174:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-05-08T10:54:24.731 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-05-08T10:54:24.732 DEBUG:teuthology.orchestra.run.smithi174:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-05-08T10:54:24.787 INFO:tasks.ceph:Adding keys to all mons... 2024-05-08T10:54:24.788 DEBUG:teuthology.orchestra.run.smithi033:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-08T10:54:24.790 DEBUG:teuthology.orchestra.run.smithi174:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-08T10:54:24.831 INFO:teuthology.orchestra.run.smithi033.stdout:[mgr.y] 2024-05-08T10:54:24.831 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQDAWTtmc8PFORAA84kNwkvIcE5DmqOKvpGojg== 2024-05-08T10:54:24.831 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.a] 2024-05-08T10:54:24.831 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQDBWTtmU0E6BRAAFsRsuDdZjjCxeaun9EpRlA== 2024-05-08T10:54:24.831 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.c] 2024-05-08T10:54:24.831 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQDBWTtmsDBtDBAAP4Wz2KJ7fCd9WIFIk06UrA== 2024-05-08T10:54:24.831 INFO:teuthology.orchestra.run.smithi033.stdout:[osd.0] 2024-05-08T10:54:24.831 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQDEWTtmQPBSNxAAnmVcHPihLUOtOT4r8UqKqQ== 2024-05-08T10:54:24.831 INFO:teuthology.orchestra.run.smithi033.stdout:[osd.1] 2024-05-08T10:54:24.831 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQDHWTtmIuDyNRAArrG1HNx+wlmRBYvOQx4vpw== 2024-05-08T10:54:24.831 INFO:teuthology.orchestra.run.smithi033.stdout:[osd.2] 2024-05-08T10:54:24.832 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQDKWTtm4W30NBAAb95EzPGdgoesfgZpE9DJaw== 2024-05-08T10:54:24.832 INFO:teuthology.orchestra.run.smithi033.stdout:[osd.3] 2024-05-08T10:54:24.832 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQDNWTtmjdAWMxAAbPC3I56lJhEDO9uxaS8+FA== 2024-05-08T10:54:24.832 INFO:teuthology.orchestra.run.smithi033.stdout:[mgr.x] 2024-05-08T10:54:24.832 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQDBWTtm5DToARAAvHm4BJV1uz8JEKIo7xoD0Q== 2024-05-08T10:54:24.832 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.b] 2024-05-08T10:54:24.832 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQDBWTtmS2ocERAAwRKHaD6QSPDvBNJFhBf0YQ== 2024-05-08T10:54:24.832 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.d] 2024-05-08T10:54:24.832 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQDBWTtmk28gGBAAyBZ10bIoEErKJVeUHc04Lg== 2024-05-08T10:54:24.832 INFO:teuthology.orchestra.run.smithi033.stdout:[osd.4] 2024-05-08T10:54:24.832 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQDTWTtmTmYmORAA/ExqBl0CoJ6WdnNc0Jx0Ng== 2024-05-08T10:54:24.832 INFO:teuthology.orchestra.run.smithi033.stdout:[osd.5] 2024-05-08T10:54:24.832 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQDWWTtmEFiKNxAAS3CQKAyy2rGPrA3+zamIFw== 2024-05-08T10:54:24.832 INFO:teuthology.orchestra.run.smithi033.stdout:[osd.6] 2024-05-08T10:54:24.832 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQDZWTtm/pK8NRAAJ4+22Z9NloXMdCL+uE418g== 2024-05-08T10:54:24.832 INFO:teuthology.orchestra.run.smithi033.stdout:[osd.7] 2024-05-08T10:54:24.833 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQDcWTtmnCE8NBAADmB7+kl6I4TxB5dpm7ufUQ== 2024-05-08T10:54:24.833 INFO:teuthology.orchestra.run.smithi033.stdout:[client.0] 2024-05-08T10:54:24.833 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQDBWTtmiYY5HBAAoTHjrWKd55wAZZl3OfJ2Zw== 2024-05-08T10:54:24.833 INFO:teuthology.orchestra.run.smithi033.stdout:[client.2] 2024-05-08T10:54:24.833 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQDBWTtmAOznIRAAwAfCUH9u7STb8gvz/wdX7Q== 2024-05-08T10:54:24.833 INFO:teuthology.orchestra.run.smithi033.stdout:[client.1] 2024-05-08T10:54:24.833 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQDBWTtmsDgjJRAA8LxKf4N/ODeb/GIsspIKUA== 2024-05-08T10:54:24.833 INFO:teuthology.orchestra.run.smithi033.stdout:[client.3] 2024-05-08T10:54:24.833 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQDBWTtmZearKhAACOAvZn/Be+A7no4jW/jFvg== 2024-05-08T10:54:24.851 INFO:teuthology.orchestra.run.smithi174.stdout:[mgr.y] 2024-05-08T10:54:24.851 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQDAWTtmc8PFORAA84kNwkvIcE5DmqOKvpGojg== 2024-05-08T10:54:24.851 INFO:teuthology.orchestra.run.smithi174.stdout:[mds.a] 2024-05-08T10:54:24.852 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQDBWTtmU0E6BRAAFsRsuDdZjjCxeaun9EpRlA== 2024-05-08T10:54:24.852 INFO:teuthology.orchestra.run.smithi174.stdout:[mds.c] 2024-05-08T10:54:24.852 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQDBWTtmsDBtDBAAP4Wz2KJ7fCd9WIFIk06UrA== 2024-05-08T10:54:24.852 INFO:teuthology.orchestra.run.smithi174.stdout:[osd.0] 2024-05-08T10:54:24.852 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQDEWTtmQPBSNxAAnmVcHPihLUOtOT4r8UqKqQ== 2024-05-08T10:54:24.852 INFO:teuthology.orchestra.run.smithi174.stdout:[osd.1] 2024-05-08T10:54:24.852 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQDHWTtmIuDyNRAArrG1HNx+wlmRBYvOQx4vpw== 2024-05-08T10:54:24.852 INFO:teuthology.orchestra.run.smithi174.stdout:[osd.2] 2024-05-08T10:54:24.852 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQDKWTtm4W30NBAAb95EzPGdgoesfgZpE9DJaw== 2024-05-08T10:54:24.852 INFO:teuthology.orchestra.run.smithi174.stdout:[osd.3] 2024-05-08T10:54:24.852 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQDNWTtmjdAWMxAAbPC3I56lJhEDO9uxaS8+FA== 2024-05-08T10:54:24.852 INFO:teuthology.orchestra.run.smithi174.stdout:[mgr.x] 2024-05-08T10:54:24.852 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQDBWTtm5DToARAAvHm4BJV1uz8JEKIo7xoD0Q== 2024-05-08T10:54:24.852 INFO:teuthology.orchestra.run.smithi174.stdout:[mds.b] 2024-05-08T10:54:24.853 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQDBWTtmS2ocERAAwRKHaD6QSPDvBNJFhBf0YQ== 2024-05-08T10:54:24.853 INFO:teuthology.orchestra.run.smithi174.stdout:[mds.d] 2024-05-08T10:54:24.853 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQDBWTtmk28gGBAAyBZ10bIoEErKJVeUHc04Lg== 2024-05-08T10:54:24.853 INFO:teuthology.orchestra.run.smithi174.stdout:[osd.4] 2024-05-08T10:54:24.853 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQDTWTtmTmYmORAA/ExqBl0CoJ6WdnNc0Jx0Ng== 2024-05-08T10:54:24.853 INFO:teuthology.orchestra.run.smithi174.stdout:[osd.5] 2024-05-08T10:54:24.853 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQDWWTtmEFiKNxAAS3CQKAyy2rGPrA3+zamIFw== 2024-05-08T10:54:24.853 INFO:teuthology.orchestra.run.smithi174.stdout:[osd.6] 2024-05-08T10:54:24.853 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQDZWTtm/pK8NRAAJ4+22Z9NloXMdCL+uE418g== 2024-05-08T10:54:24.853 INFO:teuthology.orchestra.run.smithi174.stdout:[osd.7] 2024-05-08T10:54:24.853 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQDcWTtmnCE8NBAADmB7+kl6I4TxB5dpm7ufUQ== 2024-05-08T10:54:24.853 INFO:teuthology.orchestra.run.smithi174.stdout:[client.0] 2024-05-08T10:54:24.853 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQDBWTtmiYY5HBAAoTHjrWKd55wAZZl3OfJ2Zw== 2024-05-08T10:54:24.853 INFO:teuthology.orchestra.run.smithi174.stdout:[client.2] 2024-05-08T10:54:24.853 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQDBWTtmAOznIRAAwAfCUH9u7STb8gvz/wdX7Q== 2024-05-08T10:54:24.854 INFO:teuthology.orchestra.run.smithi174.stdout:[client.1] 2024-05-08T10:54:24.854 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQDBWTtmsDgjJRAA8LxKf4N/ODeb/GIsspIKUA== 2024-05-08T10:54:24.854 INFO:teuthology.orchestra.run.smithi174.stdout:[client.3] 2024-05-08T10:54:24.854 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQDBWTtmZearKhAACOAvZn/Be+A7no4jW/jFvg== 2024-05-08T10:54:24.855 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-08T10:54:24.877 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-08T10:54:24.945 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-08T10:54:24.948 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-08T10:54:25.003 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-08T10:54:25.005 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-08T10:54:25.059 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T10:54:25.061 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T10:54:25.112 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T10:54:25.115 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T10:54:25.165 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T10:54:25.167 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T10:54:25.218 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T10:54:25.220 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T10:54:25.270 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-08T10:54:25.272 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-08T10:54:25.323 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-08T10:54:25.325 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-08T10:54:25.379 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-08T10:54:25.381 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-08T10:54:25.436 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T10:54:25.438 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T10:54:25.489 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T10:54:25.491 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T10:54:25.542 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T10:54:25.545 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T10:54:25.596 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T10:54:25.598 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T10:54:25.649 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-08T10:54:25.651 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-08T10:54:25.705 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-08T10:54:25.707 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-08T10:54:25.761 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-08T10:54:25.764 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-08T10:54:25.817 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-08T10:54:25.819 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-08T10:54:25.872 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-05-08T10:54:25.873 DEBUG:teuthology.orchestra.run.smithi033:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-05-08T10:54:25.898 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-08T10:54:25.995 DEBUG:teuthology.orchestra.run.smithi033:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-05-08T10:54:26.020 DEBUG:teuthology.orchestra.run.smithi174:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-05-08T10:54:26.046 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-08T10:54:26.142 DEBUG:teuthology.orchestra.run.smithi174:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-05-08T10:54:26.167 DEBUG:teuthology.orchestra.run.smithi174:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-05-08T10:54:26.232 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-08T10:54:26.326 DEBUG:teuthology.orchestra.run.smithi174:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-05-08T10:54:26.350 DEBUG:teuthology.orchestra.run.smithi033:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-08T10:54:26.353 DEBUG:teuthology.orchestra.run.smithi174:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-08T10:54:26.406 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-05-08T10:54:26.406 INFO:tasks.ceph.mon.a:Restarting daemon 2024-05-08T10:54:26.406 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-05-08T10:54:26.409 INFO:tasks.ceph.mon.a:Started 2024-05-08T10:54:26.409 INFO:tasks.ceph.mon.b:Restarting daemon 2024-05-08T10:54:26.409 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-05-08T10:54:26.448 INFO:tasks.ceph.mon.b:Started 2024-05-08T10:54:26.448 INFO:tasks.ceph.mon.c:Restarting daemon 2024-05-08T10:54:26.448 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-05-08T10:54:26.450 INFO:tasks.ceph.mon.c:Started 2024-05-08T10:54:26.450 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-05-08T10:54:26.450 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-05-08T10:54:26.450 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-05-08T10:54:26.454 INFO:tasks.ceph.mgr.y:Started 2024-05-08T10:54:26.454 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-05-08T10:54:26.455 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-05-08T10:54:26.456 INFO:tasks.ceph.mgr.x:Started 2024-05-08T10:54:26.456 INFO:tasks.ceph:Setting crush tunables to default 2024-05-08T10:54:26.457 DEBUG:teuthology.orchestra.run.smithi033:> sudo ceph --cluster ceph osd crush tunables default 2024-05-08T10:54:26.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:26.563+0000 7fcc548e1640 1 Processor -- start 2024-05-08T10:54:26.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:26.563+0000 7fcc548e1640 1 -- start start 2024-05-08T10:54:26.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:26.564+0000 7fcc548e1640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fcc5006f0b0 0x7fcc50166580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:26.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:26.564+0000 7fcc548e1640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc5015c160 con 0x7fcc5006b2b0 2024-05-08T10:54:26.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:26.564+0000 7fcc548e1640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc5015c440 con 0x7fcc500afe80 2024-05-08T10:54:26.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:26.564+0000 7fcc548e1640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc500b0260 con 0x7fcc5006f0b0 2024-05-08T10:54:26.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:26.564+0000 7fcc4ed9d640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fcc5006f0b0 0x7fcc50166580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:26.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:26.564+0000 7fcc47fff640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fcc5006b2b0 0x7fcc5006e9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:35282/0 (socket says 172.21.15.33:35282) 2024-05-08T10:54:26.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:26.564+0000 7fcc4ed9d640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fcc5006f0b0 0x7fcc50166580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60348/0 (socket says 172.21.15.33:60348) 2024-05-08T10:54:26.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:26.564+0000 7fcc47fff640 1 -- 172.21.15.33:0/4190850023 learned_addr learned my addr 172.21.15.33:0/4190850023 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-05-08T10:54:26.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:26.564+0000 7fcc4ed9d640 1 -- 172.21.15.33:0/4190850023 >> v2:172.21.15.33:3300/0 conn(0x7fcc5006f0b0 msgr2=0x7fcc50166580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-05-08T10:54:26.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:26.564+0000 7fcc4ed9d640 1 -- 172.21.15.33:0/4190850023 >> v2:172.21.15.33:3300/0 conn(0x7fcc5006f0b0 msgr2=0x7fcc50166580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T10:54:26.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:26.564+0000 7fcc4ed9d640 1 --2- 172.21.15.33:0/4190850023 >> v2:172.21.15.33:3300/0 conn(0x7fcc5006f0b0 0x7fcc50166580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T10:54:26.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:26.564+0000 7fcc4ed9d640 1 --2- 172.21.15.33:0/4190850023 >> v2:172.21.15.33:3300/0 conn(0x7fcc5006f0b0 0x7fcc50166580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T10:54:26.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:26.726+0000 7fcc4dd9b640 1 -- 172.21.15.33:0/4190850023 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3751716382 0 0) 0x7fcc5015c160 con 0x7fcc5006b2b0 2024-05-08T10:54:26.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:26.726+0000 7fcc4dd9b640 1 -- 172.21.15.33:0/4190850023 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc3c003520 con 0x7fcc5006b2b0 2024-05-08T10:54:26.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:26.727+0000 7fcc4dd9b640 1 -- 172.21.15.33:0/4190850023 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2914783093 0 0) 0x7fcc3c003520 con 0x7fcc5006b2b0 2024-05-08T10:54:26.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:26.727+0000 7fcc4dd9b640 1 -- 172.21.15.33:0/4190850023 >> v2:172.21.15.33:3300/0 conn(0x7fcc5006f0b0 msgr2=0x7fcc50166580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T10:54:26.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:26.727+0000 7fcc4dd9b640 1 --2- 172.21.15.33:0/4190850023 >> v2:172.21.15.33:3300/0 conn(0x7fcc5006f0b0 0x7fcc50166580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:26.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:26.727+0000 7fcc4dd9b640 1 -- 172.21.15.33:0/4190850023 >> v1:172.21.15.174:6789/0 conn(0x7fcc500afe80 legacy=0x7fcc5006aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:26.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:26.727+0000 7fcc4dd9b640 1 -- 172.21.15.33:0/4190850023 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc5015c720 con 0x7fcc5006b2b0 2024-05-08T10:54:26.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:26.727+0000 7fcc4dd9b640 1 -- 172.21.15.33:0/4190850023 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2948294915 0 0) 0x7fcc38001670 con 0x7fcc5006b2b0 2024-05-08T10:54:26.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:26.727+0000 7fcc4dd9b640 1 -- 172.21.15.33:0/4190850023 >> v1:172.21.15.33:6789/0 conn(0x7fcc5006b2b0 legacy=0x7fcc5006e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:26.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:26.727+0000 7fcc4dd9b640 1 --2- 172.21.15.33:0/4190850023 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcc3c0039b0 0x7fcc3c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:26.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:26.727+0000 7fcc4dd9b640 1 --2- 172.21.15.33:0/4190850023 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc3c004800 0x7fcc3c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:26.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:26.727+0000 7fcc4dd9b640 1 --2- 172.21.15.33:0/4190850023 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcc3c0051c0 0x7fcc3c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:26.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:26.728+0000 7fcc4dd9b640 1 -- 172.21.15.33:0/4190850023 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc3c00c090 con 0x7fcc3c004800 2024-05-08T10:54:26.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:26.728+0000 7fcc4dd9b640 1 -- 172.21.15.33:0/4190850023 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc3c00c240 con 0x7fcc3c0039b0 2024-05-08T10:54:26.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:26.728+0000 7fcc4dd9b640 1 -- 172.21.15.33:0/4190850023 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc3c00c440 con 0x7fcc3c0051c0 2024-05-08T10:54:26.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:26.728+0000 7fcc47fff640 1 --2- 172.21.15.33:0/4190850023 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc3c004800 0x7fcc3c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:26.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:26.728+0000 7fcc4e59c640 1 --2- 172.21.15.33:0/4190850023 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcc3c0039b0 0x7fcc3c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:26.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:26.728+0000 7fcc4ed9d640 1 --2- 172.21.15.33:0/4190850023 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcc3c0051c0 0x7fcc3c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:26.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:26.728+0000 7fcc47fff640 1 -- 172.21.15.33:0/4190850023 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcc3c0051c0 msgr2=0x7fcc3c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:54:26.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:26.728+0000 7fcc47fff640 1 --2- 172.21.15.33:0/4190850023 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcc3c0051c0 0x7fcc3c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:26.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:26.728+0000 7fcc47fff640 1 -- 172.21.15.33:0/4190850023 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcc3c0039b0 msgr2=0x7fcc3c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:54:26.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:26.728+0000 7fcc47fff640 1 --2- 172.21.15.33:0/4190850023 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcc3c0039b0 0x7fcc3c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:26.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:26.728+0000 7fcc47fff640 1 -- 172.21.15.33:0/4190850023 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc5015c720 con 0x7fcc3c004800 2024-05-08T10:54:26.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:26.728+0000 7fcc4ed9d640 1 -- 172.21.15.33:0/4190850023 reap_dead start 2024-05-08T10:54:26.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:26.729+0000 7fcc47fff640 1 --2- 172.21.15.33:0/4190850023 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc3c004800 0x7fcc3c004c80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fcc3800c340 tx=0x7fcc3c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcddcf0d591807a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:54:26.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:26.729+0000 7fcc4dd9b640 1 -- 172.21.15.33:0/4190850023 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc38036070 con 0x7fcc3c004800 2024-05-08T10:54:26.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:26.729+0000 7fcc4dd9b640 1 -- 172.21.15.33:0/4190850023 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc38005af0 con 0x7fcc3c004800 2024-05-08T10:54:26.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:26.729+0000 7fcc4dd9b640 1 -- 172.21.15.33:0/4190850023 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc38007dd0 con 0x7fcc3c004800 2024-05-08T10:54:26.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:26.730+0000 7fcc548e1640 1 -- 172.21.15.33:0/4190850023 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc3c004800 msgr2=0x7fcc3c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:26.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:26.730+0000 7fcc548e1640 1 --2- 172.21.15.33:0/4190850023 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc3c004800 0x7fcc3c004c80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fcc3800c340 tx=0x7fcc3c005830 comp rx=0 tx=0).stop 2024-05-08T10:54:26.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:26.730+0000 7fcc548e1640 1 -- 172.21.15.33:0/4190850023 shutdown_connections 2024-05-08T10:54:26.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:26.730+0000 7fcc548e1640 1 --2- 172.21.15.33:0/4190850023 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc3c004800 0x7fcc3c004c80 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:26.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:26.730+0000 7fcc548e1640 1 -- 172.21.15.33:0/4190850023 >> 172.21.15.33:0/4190850023 conn(0x7fcc5006bcb0 msgr2=0x7fcc5006c090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:54:26.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:26.730+0000 7fcc548e1640 1 -- 172.21.15.33:0/4190850023 shutdown_connections 2024-05-08T10:54:26.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:26.730+0000 7fcc548e1640 1 -- 172.21.15.33:0/4190850023 wait complete. 2024-05-08T10:54:26.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:26.731+0000 7fcc548e1640 1 Processor -- start 2024-05-08T10:54:26.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:26.731+0000 7fcc548e1640 1 -- start start 2024-05-08T10:54:26.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:26.732+0000 7fcc548e1640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcc3c004800 0x7fcc500b53c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:26.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:26.732+0000 7fcc548e1640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc501511f0 0x7fcc500b3880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:26.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:26.732+0000 7fcc548e1640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcc50151670 0x7fcc500d0570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:26.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:26.732+0000 7fcc548e1640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc5006e9a0 con 0x7fcc501511f0 2024-05-08T10:54:26.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:26.732+0000 7fcc548e1640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc5015cce0 con 0x7fcc50151670 2024-05-08T10:54:26.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:26.732+0000 7fcc548e1640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc5006eb20 con 0x7fcc3c004800 2024-05-08T10:54:26.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:26.732+0000 7fcc47fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc501511f0 0x7fcc500b3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:26.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:26.732+0000 7fcc47fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc501511f0 0x7fcc500b3880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60382/0 (socket says 172.21.15.33:60382) 2024-05-08T10:54:26.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:26.732+0000 7fcc47fff640 1 -- 172.21.15.33:0/3983871724 learned_addr learned my addr 172.21.15.33:0/3983871724 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:54:26.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:26.732+0000 7fcc4e59c640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcc3c004800 0x7fcc500b53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:26.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:26.732+0000 7fcc4ed9d640 1 --2- 172.21.15.33:0/3983871724 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcc50151670 0x7fcc500d0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:26.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:26.733+0000 7fcc47fff640 1 -- 172.21.15.33:0/3983871724 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcc3c004800 msgr2=0x7fcc500b53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:26.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:26.733+0000 7fcc47fff640 1 --2- 172.21.15.33:0/3983871724 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcc3c004800 0x7fcc500b53c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:26.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:26.733+0000 7fcc47fff640 1 -- 172.21.15.33:0/3983871724 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcc50151670 msgr2=0x7fcc500d0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:26.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:26.733+0000 7fcc47fff640 1 --2- 172.21.15.33:0/3983871724 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcc50151670 0x7fcc500d0570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:26.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:26.733+0000 7fcc47fff640 1 -- 172.21.15.33:0/3983871724 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc500b4320 con 0x7fcc501511f0 2024-05-08T10:54:26.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:26.733+0000 7fcc47fff640 1 --2- 172.21.15.33:0/3983871724 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc501511f0 0x7fcc500b3880 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fcc38034040 tx=0x7fcc38000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:54:26.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:26.733+0000 7fcc46ffd640 1 -- 172.21.15.33:0/3983871724 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc38041020 con 0x7fcc501511f0 2024-05-08T10:54:26.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:26.733+0000 7fcc46ffd640 1 -- 172.21.15.33:0/3983871724 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc38007070 con 0x7fcc501511f0 2024-05-08T10:54:26.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:26.733+0000 7fcc46ffd640 1 -- 172.21.15.33:0/3983871724 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc38036030 con 0x7fcc501511f0 2024-05-08T10:54:26.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:26.733+0000 7fcc548e1640 1 -- 172.21.15.33:0/3983871724 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc500b4600 con 0x7fcc501511f0 2024-05-08T10:54:26.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:26.734+0000 7fcc548e1640 1 -- 172.21.15.33:0/3983871724 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc500b4bc0 con 0x7fcc501511f0 2024-05-08T10:54:26.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:26.734+0000 7fcc46ffd640 1 -- 172.21.15.33:0/3983871724 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fcc38044020 con 0x7fcc501511f0 2024-05-08T10:54:26.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:26.734+0000 7fcc46ffd640 1 -- 172.21.15.33:0/3983871724 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fcc3803d9b0 con 0x7fcc501511f0 2024-05-08T10:54:26.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:26.735+0000 7fcc548e1640 1 -- 172.21.15.33:0/3983871724 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc50069d20 con 0x7fcc501511f0 2024-05-08T10:54:26.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:26.737+0000 7fcc46ffd640 1 -- 172.21.15.33:0/3983871724 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fcc3804b030 con 0x7fcc501511f0 2024-05-08T10:54:26.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:26.805+0000 7fcc548e1640 1 -- 172.21.15.33:0/3983871724 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fcc5006c410 con 0x7fcc501511f0 2024-05-08T10:54:26.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:26.806+0000 7fcc46ffd640 1 -- 172.21.15.33:0/3983871724 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fcc3803d430 con 0x7fcc501511f0 2024-05-08T10:54:26.803 INFO:teuthology.orchestra.run.smithi033.stderr:adjusted tunables profile to default 2024-05-08T10:54:26.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:26.807+0000 7fcc548e1640 1 -- 172.21.15.33:0/3983871724 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc501511f0 msgr2=0x7fcc500b3880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:26.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:26.807+0000 7fcc548e1640 1 --2- 172.21.15.33:0/3983871724 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc501511f0 0x7fcc500b3880 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fcc38034040 tx=0x7fcc38000fe0 comp rx=0 tx=0).stop 2024-05-08T10:54:26.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:26.807+0000 7fcc548e1640 1 -- 172.21.15.33:0/3983871724 shutdown_connections 2024-05-08T10:54:26.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:26.807+0000 7fcc548e1640 1 --2- 172.21.15.33:0/3983871724 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcc50151670 0x7fcc500d0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:26.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:26.807+0000 7fcc548e1640 1 --2- 172.21.15.33:0/3983871724 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc501511f0 0x7fcc500b3880 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:26.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:26.807+0000 7fcc548e1640 1 --2- 172.21.15.33:0/3983871724 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcc3c004800 0x7fcc500b53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:26.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:26.807+0000 7fcc548e1640 1 -- 172.21.15.33:0/3983871724 >> 172.21.15.33:0/3983871724 conn(0x7fcc5006bcb0 msgr2=0x7fcc500b0680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:54:26.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:26.807+0000 7fcc548e1640 1 -- 172.21.15.33:0/3983871724 shutdown_connections 2024-05-08T10:54:26.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:26.807+0000 7fcc548e1640 1 -- 172.21.15.33:0/3983871724 wait complete. 2024-05-08T10:54:26.815 INFO:tasks.ceph:check_enable_crimson: False 2024-05-08T10:54:26.815 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-05-08T10:54:26.816 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-05-08T10:54:26.816 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-05-08T10:54:26.842 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-05-08T10:54:26.842 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-05-08T10:54:26.844 INFO:tasks.ceph.mgr.y.smithi033.stderr:2024-05-08T10:54:26.847+0000 7f908ba15040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-08T10:54:26.849 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-08T10:54:26.852+0000 7fe860991040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-08T10:54:26.870 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-05-08T10:54:26.870 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-05-08T10:54:26.937 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-05-08T10:54:26.937 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-05-08T10:54:27.003 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-08T10:54:27.006+0000 7fe860991040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-08T10:54:27.004 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-05-08T10:54:27.004 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-05-08T10:54:27.007 INFO:tasks.ceph.mgr.y.smithi033.stderr:2024-05-08T10:54:27.011+0000 7f908ba15040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-08T10:54:27.028 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-05-08T10:54:27.028 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-05-08T10:54:27.059 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-08T10:54:27.062+0000 7fe860991040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-08T10:54:27.064 INFO:tasks.ceph.mgr.y.smithi033.stderr:2024-05-08T10:54:27.067+0000 7f908ba15040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-08T10:54:27.083 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-05-08T10:54:27.083 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-05-08T10:54:27.147 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-05-08T10:54:27.147 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-05-08T10:54:27.212 DEBUG:teuthology.orchestra.run.smithi174:> sudo ceph --cluster ceph osd new c5da4fb5-d4f2-4982-a804-2aa92fe77731 0 2024-05-08T10:54:27.319 INFO:tasks.ceph.mgr.y.smithi033.stderr:2024-05-08T10:54:27.322+0000 7f908ba15040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-08T10:54:27.321 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-08T10:54:27.324+0000 7fe860991040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-08T10:54:27.352 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.354+0000 7ff21bd5e640 1 Processor -- start 2024-05-08T10:54:27.352 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.355+0000 7ff21bd5e640 1 -- start start 2024-05-08T10:54:27.353 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.355+0000 7ff21bd5e640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff2140af6a0 0x7ff2140afb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:27.353 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.355+0000 7ff21bd5e640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff2140ce770 0x7ff2140cebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:27.354 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.355+0000 7ff21bd5e640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff21406ef10 con 0x7ff21415a980 2024-05-08T10:54:27.354 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.355+0000 7ff21bd5e640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2140cf120 con 0x7ff2140af6a0 2024-05-08T10:54:27.354 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.355+0000 7ff21bd5e640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2140cdf10 con 0x7ff2140ce770 2024-05-08T10:54:27.354 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.356+0000 7ff219afa640 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7ff21415a980 0x7ff21406d2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:57624/0 (socket says 172.21.15.174:57624) 2024-05-08T10:54:27.354 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.356+0000 7ff219afa640 1 -- 172.21.15.174:0/4245014076 learned_addr learned my addr 172.21.15.174:0/4245014076 (peer_addr_for_me v1:172.21.15.174:0/0) 2024-05-08T10:54:27.354 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.356+0000 7ff21a2fb640 1 --2- 172.21.15.174:0/4245014076 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff2140ce770 0x7ff2140cebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:27.354 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.356+0000 7ff2192f9640 1 --2- 172.21.15.174:0/4245014076 >> v2:172.21.15.33:3300/0 conn(0x7ff2140af6a0 0x7ff2140afb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:27.354 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.356+0000 7ff218af8640 1 -- 172.21.15.174:0/4245014076 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1669942026 0 0) 0x7ff210001110 con 0x7ff21415a980 2024-05-08T10:54:27.354 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.356+0000 7ff21a2fb640 1 -- 172.21.15.174:0/4245014076 >> v2:172.21.15.33:3300/0 conn(0x7ff2140af6a0 msgr2=0x7ff2140afb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:54:27.354 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.356+0000 7ff21a2fb640 1 --2- 172.21.15.174:0/4245014076 >> v2:172.21.15.33:3300/0 conn(0x7ff2140af6a0 0x7ff2140afb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:27.354 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.356+0000 7ff21a2fb640 1 -- 172.21.15.174:0/4245014076 >> v1:172.21.15.174:6789/0 conn(0x7ff21415a980 legacy=0x7ff21406d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:27.354 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.356+0000 7ff21a2fb640 1 -- 172.21.15.174:0/4245014076 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff21406f190 con 0x7ff2140ce770 2024-05-08T10:54:27.356 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.357+0000 7ff21a2fb640 1 --2- 172.21.15.174:0/4245014076 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff2140ce770 0x7ff2140cebe0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff20c009d90 tx=0x7ff20c02a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9626808a1aea2b73 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:54:27.356 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.357+0000 7ff218af8640 1 -- 172.21.15.174:0/4245014076 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff20c031600 con 0x7ff2140ce770 2024-05-08T10:54:27.356 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.357+0000 7ff218af8640 1 -- 172.21.15.174:0/4245014076 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff20c0317a0 con 0x7ff2140ce770 2024-05-08T10:54:27.356 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.357+0000 7ff218af8640 1 -- 172.21.15.174:0/4245014076 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff20c031b70 con 0x7ff2140ce770 2024-05-08T10:54:27.356 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.357+0000 7ff21bd5e640 1 -- 172.21.15.174:0/4245014076 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff2140ce770 msgr2=0x7ff2140cebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:27.356 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.357+0000 7ff21bd5e640 1 --2- 172.21.15.174:0/4245014076 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff2140ce770 0x7ff2140cebe0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff20c009d90 tx=0x7ff20c02a5d0 comp rx=0 tx=0).stop 2024-05-08T10:54:27.356 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.357+0000 7ff21bd5e640 1 -- 172.21.15.174:0/4245014076 shutdown_connections 2024-05-08T10:54:27.357 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.357+0000 7ff21bd5e640 1 --2- 172.21.15.174:0/4245014076 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff2140ce770 0x7ff2140cebe0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:27.357 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.357+0000 7ff21bd5e640 1 --2- 172.21.15.174:0/4245014076 >> v2:172.21.15.33:3300/0 conn(0x7ff2140af6a0 0x7ff2140afb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:27.357 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.357+0000 7ff21bd5e640 1 -- 172.21.15.174:0/4245014076 >> 172.21.15.174:0/4245014076 conn(0x7ff21406bcb0 msgr2=0x7ff21406c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:54:27.357 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.358+0000 7ff21bd5e640 1 -- 172.21.15.174:0/4245014076 shutdown_connections 2024-05-08T10:54:27.357 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.358+0000 7ff21bd5e640 1 -- 172.21.15.174:0/4245014076 wait complete. 2024-05-08T10:54:27.357 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.359+0000 7ff21bd5e640 1 Processor -- start 2024-05-08T10:54:27.357 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.359+0000 7ff21bd5e640 1 -- start start 2024-05-08T10:54:27.359 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.359+0000 7ff21bd5e640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff2140af6a0 0x7ff2141eeb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:27.359 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.359+0000 7ff21bd5e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff2140ce770 0x7ff2140b0a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:27.359 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.359+0000 7ff21bd5e640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff21415a980 0x7ff2140b0f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:27.359 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.359+0000 7ff21bd5e640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff21415ad60 con 0x7ff2140ce770 2024-05-08T10:54:27.359 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.359+0000 7ff21bd5e640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff214071e40 con 0x7ff2140af6a0 2024-05-08T10:54:27.359 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.359+0000 7ff21bd5e640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff21406d9d0 con 0x7ff21415a980 2024-05-08T10:54:27.359 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.360+0000 7ff219afa640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff2140af6a0 0x7ff2141eeb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:27.360 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.360+0000 7ff219afa640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff2140af6a0 0x7ff2141eeb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:35628/0 (socket says 172.21.15.174:35628) 2024-05-08T10:54:27.360 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.360+0000 7ff219afa640 1 -- 172.21.15.174:0/1231772337 learned_addr learned my addr 172.21.15.174:0/1231772337 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-05-08T10:54:27.360 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.360+0000 7ff21a2fb640 1 --2- 172.21.15.174:0/1231772337 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff21415a980 0x7ff2140b0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:27.360 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.360+0000 7ff2192f9640 1 --2- 172.21.15.174:0/1231772337 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff2140ce770 0x7ff2140b0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:27.360 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.360+0000 7ff219afa640 1 -- 172.21.15.174:0/1231772337 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff21415a980 msgr2=0x7ff2140b0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:27.360 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.360+0000 7ff219afa640 1 --2- 172.21.15.174:0/1231772337 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff21415a980 0x7ff2140b0f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:27.360 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.360+0000 7ff219afa640 1 -- 172.21.15.174:0/1231772337 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff2140ce770 msgr2=0x7ff2140b0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:27.360 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.360+0000 7ff219afa640 1 --2- 172.21.15.174:0/1231772337 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff2140ce770 0x7ff2140b0a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:27.360 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.360+0000 7ff219afa640 1 -- 172.21.15.174:0/1231772337 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2141f21f0 con 0x7ff2140af6a0 2024-05-08T10:54:27.360 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.360+0000 7ff219afa640 1 --2- 172.21.15.174:0/1231772337 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff2140af6a0 0x7ff2141eeb40 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff21000c460 tx=0x7ff21000c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:54:27.360 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.360+0000 7ff2067fc640 1 -- 172.21.15.174:0/1231772337 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff210018070 con 0x7ff2140af6a0 2024-05-08T10:54:27.360 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.360+0000 7ff2067fc640 1 -- 172.21.15.174:0/1231772337 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff210007500 con 0x7ff2140af6a0 2024-05-08T10:54:27.360 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.360+0000 7ff21bd5e640 1 -- 172.21.15.174:0/1231772337 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2141f4cc0 con 0x7ff2140af6a0 2024-05-08T10:54:27.360 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.360+0000 7ff2067fc640 1 -- 172.21.15.174:0/1231772337 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff210004a20 con 0x7ff2140af6a0 2024-05-08T10:54:27.361 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.360+0000 7ff21bd5e640 1 -- 172.21.15.174:0/1231772337 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2141f57a0 con 0x7ff2140af6a0 2024-05-08T10:54:27.361 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.360+0000 7ff2067fc640 1 -- 172.21.15.174:0/1231772337 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7ff21001b070 con 0x7ff2140af6a0 2024-05-08T10:54:27.361 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.360+0000 7ff2067fc640 1 -- 172.21.15.174:0/1231772337 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7ff210012740 con 0x7ff2140af6a0 2024-05-08T10:54:27.361 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.361+0000 7ff21bd5e640 1 -- 172.21.15.174:0/1231772337 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff214069d20 con 0x7ff2140af6a0 2024-05-08T10:54:27.362 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.365+0000 7ff2067fc640 1 -- 172.21.15.174:0/1231772337 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7ff21406ef10 con 0x7ff2140af6a0 2024-05-08T10:54:27.367 INFO:tasks.ceph.mgr.y.smithi033.stderr:2024-05-08T10:54:27.370+0000 7f908ba15040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-08T10:54:27.371 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-08T10:54:27.374+0000 7fe860991040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-08T10:54:27.435 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.437+0000 7ff21bd5e640 1 -- 172.21.15.174:0/1231772337 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c5da4fb5-d4f2-4982-a804-2aa92fe77731", "id": 0} v 0) v1 -- 0x7ff21415b4e0 con 0x7ff2140af6a0 2024-05-08T10:54:27.438 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.441+0000 7ff2067fc640 1 -- 172.21.15.174:0/1231772337 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c5da4fb5-d4f2-4982-a804-2aa92fe77731", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff210005d60 con 0x7ff2140af6a0 2024-05-08T10:54:27.438 INFO:teuthology.orchestra.run.smithi174.stdout:0 2024-05-08T10:54:27.439 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.442+0000 7ff21bd5e640 1 -- 172.21.15.174:0/1231772337 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff2140af6a0 msgr2=0x7ff2141eeb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:27.439 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.442+0000 7ff21bd5e640 1 --2- 172.21.15.174:0/1231772337 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff2140af6a0 0x7ff2141eeb40 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff21000c460 tx=0x7ff21000c920 comp rx=0 tx=0).stop 2024-05-08T10:54:27.439 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.442+0000 7ff21bd5e640 1 -- 172.21.15.174:0/1231772337 shutdown_connections 2024-05-08T10:54:27.439 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.442+0000 7ff21bd5e640 1 --2- 172.21.15.174:0/1231772337 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff21415a980 0x7ff2140b0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:27.440 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.442+0000 7ff21bd5e640 1 --2- 172.21.15.174:0/1231772337 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff2140ce770 0x7ff2140b0a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:27.440 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.442+0000 7ff21bd5e640 1 --2- 172.21.15.174:0/1231772337 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff2140af6a0 0x7ff2141eeb40 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:27.440 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.442+0000 7ff21bd5e640 1 -- 172.21.15.174:0/1231772337 >> 172.21.15.174:0/1231772337 conn(0x7ff21406bcb0 msgr2=0x7ff2140cd0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:54:27.440 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.442+0000 7ff21bd5e640 1 -- 172.21.15.174:0/1231772337 shutdown_connections 2024-05-08T10:54:27.440 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.442+0000 7ff21bd5e640 1 -- 172.21.15.174:0/1231772337 wait complete. 2024-05-08T10:54:27.449 DEBUG:teuthology.orchestra.run.smithi174:> sudo ceph --cluster ceph osd new f8fdd8db-c2a3-4d28-81f3-b30f44bea7c7 1 2024-05-08T10:54:27.548 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.551+0000 7f63c9716640 1 Processor -- start 2024-05-08T10:54:27.548 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.551+0000 7f63c9716640 1 -- start start 2024-05-08T10:54:27.550 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.552+0000 7f63c9716640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f63c40d21c0 0x7f63c40d25a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:27.550 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.552+0000 7f63c9716640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f63c40b7720 0x7f63c40b7b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:27.550 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.552+0000 7f63c9716640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63c40d2ae0 con 0x7f63c40d18b0 2024-05-08T10:54:27.550 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.552+0000 7f63c9716640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63c40b7290 con 0x7f63c40b7720 2024-05-08T10:54:27.551 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.552+0000 7f63c9716640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63c40cfa30 con 0x7f63c40d21c0 2024-05-08T10:54:27.551 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.552+0000 7f63c2ffd640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f63c40d21c0 0x7f63c40d25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:27.551 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.552+0000 7f63c27fc640 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f63c40d18b0 0x7f63c40cf1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:57640/0 (socket says 172.21.15.174:57640) 2024-05-08T10:54:27.551 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.552+0000 7f63c27fc640 1 -- 172.21.15.174:0/4038288931 learned_addr learned my addr 172.21.15.174:0/4038288931 (peer_addr_for_me v1:172.21.15.174:0/0) 2024-05-08T10:54:27.551 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.552+0000 7f63c37fe640 1 --2- 172.21.15.174:0/4038288931 >> v2:172.21.15.33:3300/0 conn(0x7f63c40b7720 0x7f63c40b7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:27.551 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.552+0000 7f63c1ffb640 1 -- 172.21.15.174:0/4038288931 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 866424247 0 0) 0x7f63c40d2ae0 con 0x7f63c40d18b0 2024-05-08T10:54:27.551 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.552+0000 7f63c1ffb640 1 -- 172.21.15.174:0/4038288931 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63ac003520 con 0x7f63c40d18b0 2024-05-08T10:54:27.551 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.552+0000 7f63c2ffd640 1 -- 172.21.15.174:0/4038288931 >> v2:172.21.15.33:3300/0 conn(0x7f63c40b7720 msgr2=0x7f63c40b7b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:54:27.551 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.552+0000 7f63c2ffd640 1 --2- 172.21.15.174:0/4038288931 >> v2:172.21.15.33:3300/0 conn(0x7f63c40b7720 0x7f63c40b7b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:27.551 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.552+0000 7f63c2ffd640 1 -- 172.21.15.174:0/4038288931 >> v1:172.21.15.174:6789/0 conn(0x7f63c40d18b0 legacy=0x7f63c40cf1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:27.551 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.552+0000 7f63c2ffd640 1 -- 172.21.15.174:0/4038288931 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63c40b6c40 con 0x7f63c40d21c0 2024-05-08T10:54:27.551 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.553+0000 7f63c2ffd640 1 --2- 172.21.15.174:0/4038288931 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f63c40d21c0 0x7f63c40d25a0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f63b40097a0 tx=0x7f63b402a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb5f88358c5493f2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:54:27.551 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.553+0000 7f63c1ffb640 1 -- 172.21.15.174:0/4038288931 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63b4037070 con 0x7f63c40d21c0 2024-05-08T10:54:27.551 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.553+0000 7f63c1ffb640 1 -- 172.21.15.174:0/4038288931 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63b4032440 con 0x7f63c40d21c0 2024-05-08T10:54:27.551 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.553+0000 7f63c1ffb640 1 -- 172.21.15.174:0/4038288931 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63b4032810 con 0x7f63c40d21c0 2024-05-08T10:54:27.552 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.554+0000 7f63c9716640 1 -- 172.21.15.174:0/4038288931 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f63c40d21c0 msgr2=0x7f63c40d25a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:27.553 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.554+0000 7f63c9716640 1 --2- 172.21.15.174:0/4038288931 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f63c40d21c0 0x7f63c40d25a0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f63b40097a0 tx=0x7f63b402a210 comp rx=0 tx=0).stop 2024-05-08T10:54:27.553 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.554+0000 7f63c9716640 1 -- 172.21.15.174:0/4038288931 shutdown_connections 2024-05-08T10:54:27.553 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.554+0000 7f63c9716640 1 --2- 172.21.15.174:0/4038288931 >> v2:172.21.15.33:3300/0 conn(0x7f63c40b7720 0x7f63c40b7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:27.553 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.554+0000 7f63c9716640 1 --2- 172.21.15.174:0/4038288931 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f63c40d21c0 0x7f63c40d25a0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:27.553 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.554+0000 7f63c9716640 1 -- 172.21.15.174:0/4038288931 >> 172.21.15.174:0/4038288931 conn(0x7f63c40d3be0 msgr2=0x7f63c40d3ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:54:27.553 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.554+0000 7f63c9716640 1 -- 172.21.15.174:0/4038288931 shutdown_connections 2024-05-08T10:54:27.553 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.554+0000 7f63c9716640 1 -- 172.21.15.174:0/4038288931 wait complete. 2024-05-08T10:54:27.553 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.555+0000 7f63c9716640 1 Processor -- start 2024-05-08T10:54:27.553 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.555+0000 7f63c9716640 1 -- start start 2024-05-08T10:54:27.555 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.556+0000 7f63c9716640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f63c40b7720 0x7f63c40d0d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:27.556 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.556+0000 7f63c9716640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f63c40d18b0 0x7f63c41f78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:27.556 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.556+0000 7f63c9716640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f63c40d21c0 0x7f63c41520d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:27.556 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.556+0000 7f63c9716640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63c40b80d0 con 0x7f63c40b7720 2024-05-08T10:54:27.556 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.556+0000 7f63c9716640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63c415e340 con 0x7f63c40d21c0 2024-05-08T10:54:27.556 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.556+0000 7f63c9716640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63c40b8250 con 0x7f63c40d18b0 2024-05-08T10:54:27.556 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.556+0000 7f63c27fc640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f63c40d18b0 0x7f63c41f78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:27.556 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.556+0000 7f63c37fe640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f63c40d21c0 0x7f63c41520d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:27.556 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.556+0000 7f63c27fc640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f63c40d18b0 0x7f63c41f78a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.174:46128/0 (socket says 172.21.15.174:46128) 2024-05-08T10:54:27.556 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.556+0000 7f63c27fc640 1 -- 172.21.15.174:0/1675141891 learned_addr learned my addr 172.21.15.174:0/1675141891 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-05-08T10:54:27.556 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.556+0000 7f63c2ffd640 1 --2- 172.21.15.174:0/1675141891 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f63c40b7720 0x7f63c40d0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:27.556 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.556+0000 7f63c2ffd640 1 -- 172.21.15.174:0/1675141891 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f63c40d18b0 msgr2=0x7f63c41f78a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:27.556 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.556+0000 7f63c2ffd640 1 --2- 172.21.15.174:0/1675141891 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f63c40d18b0 0x7f63c41f78a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:27.556 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.556+0000 7f63c2ffd640 1 -- 172.21.15.174:0/1675141891 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f63c40d21c0 msgr2=0x7f63c41520d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:27.556 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.556+0000 7f63c2ffd640 1 --2- 172.21.15.174:0/1675141891 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f63c40d21c0 0x7f63c41520d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:27.557 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.556+0000 7f63c2ffd640 1 -- 172.21.15.174:0/1675141891 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63c40d13c0 con 0x7f63c40b7720 2024-05-08T10:54:27.557 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.556+0000 7f63c27fc640 1 --2- 172.21.15.174:0/1675141891 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f63c40d18b0 0x7f63c41f78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T10:54:27.557 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.556+0000 7f63c37fe640 1 --2- 172.21.15.174:0/1675141891 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f63c40d21c0 0x7f63c41520d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T10:54:27.557 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.557+0000 7f63c2ffd640 1 --2- 172.21.15.174:0/1675141891 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f63c40b7720 0x7f63c40d0d30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f63b4031000 tx=0x7f63b40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:54:27.557 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.557+0000 7f63ab7fe640 1 -- 172.21.15.174:0/1675141891 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63b4041030 con 0x7f63c40b7720 2024-05-08T10:54:27.557 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.557+0000 7f63ab7fe640 1 -- 172.21.15.174:0/1675141891 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63b403d4e0 con 0x7f63c40b7720 2024-05-08T10:54:27.557 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.557+0000 7f63c9716640 1 -- 172.21.15.174:0/1675141891 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63c4158a30 con 0x7f63c40b7720 2024-05-08T10:54:27.557 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.557+0000 7f63ab7fe640 1 -- 172.21.15.174:0/1675141891 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63b4037040 con 0x7f63c40b7720 2024-05-08T10:54:27.557 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.557+0000 7f63c9716640 1 -- 172.21.15.174:0/1675141891 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63c4158ff0 con 0x7f63c40b7720 2024-05-08T10:54:27.557 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.557+0000 7f63ab7fe640 1 -- 172.21.15.174:0/1675141891 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f63b403d8b0 con 0x7f63c40b7720 2024-05-08T10:54:27.557 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.557+0000 7f63ab7fe640 1 -- 172.21.15.174:0/1675141891 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f63b40468f0 con 0x7f63c40b7720 2024-05-08T10:54:27.557 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.558+0000 7f63c9716640 1 -- 172.21.15.174:0/1675141891 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63c4069d20 con 0x7f63c40b7720 2024-05-08T10:54:27.558 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.560+0000 7f63ab7fe640 1 -- 172.21.15.174:0/1675141891 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f63b404b020 con 0x7f63c40b7720 2024-05-08T10:54:27.629 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.632+0000 7f63c9716640 1 -- 172.21.15.174:0/1675141891 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f8fdd8db-c2a3-4d28-81f3-b30f44bea7c7", "id": 1} v 0) v1 -- 0x7f63c40b6240 con 0x7f63c40b7720 2024-05-08T10:54:27.631 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.634+0000 7f63ab7fe640 1 -- 172.21.15.174:0/1675141891 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f8fdd8db-c2a3-4d28-81f3-b30f44bea7c7", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f63b403dc40 con 0x7f63c40b7720 2024-05-08T10:54:27.631 INFO:teuthology.orchestra.run.smithi174.stdout:1 2024-05-08T10:54:27.632 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.635+0000 7f63c9716640 1 -- 172.21.15.174:0/1675141891 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f63c40b7720 msgr2=0x7f63c40d0d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:27.633 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.635+0000 7f63c9716640 1 --2- 172.21.15.174:0/1675141891 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f63c40b7720 0x7f63c40d0d30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f63b4031000 tx=0x7f63b40046c0 comp rx=0 tx=0).stop 2024-05-08T10:54:27.633 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.635+0000 7f63c9716640 1 -- 172.21.15.174:0/1675141891 shutdown_connections 2024-05-08T10:54:27.633 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.635+0000 7f63c9716640 1 --2- 172.21.15.174:0/1675141891 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f63c40d21c0 0x7f63c41520d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:27.633 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.635+0000 7f63c9716640 1 --2- 172.21.15.174:0/1675141891 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f63c40d18b0 0x7f63c41f78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:27.633 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.635+0000 7f63c9716640 1 --2- 172.21.15.174:0/1675141891 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f63c40b7720 0x7f63c40d0d30 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:27.633 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.635+0000 7f63c9716640 1 -- 172.21.15.174:0/1675141891 >> 172.21.15.174:0/1675141891 conn(0x7f63c40d3be0 msgr2=0x7f63c415bf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:54:27.633 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.635+0000 7f63c9716640 1 -- 172.21.15.174:0/1675141891 shutdown_connections 2024-05-08T10:54:27.633 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.635+0000 7f63c9716640 1 -- 172.21.15.174:0/1675141891 wait complete. 2024-05-08T10:54:27.643 DEBUG:teuthology.orchestra.run.smithi174:> sudo ceph --cluster ceph osd new 87d465f3-b40f-48dd-bae2-4c67904d4828 2 2024-05-08T10:54:27.744 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.746+0000 7f608cc45640 1 Processor -- start 2024-05-08T10:54:27.744 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.747+0000 7f608cc45640 1 -- start start 2024-05-08T10:54:27.745 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.747+0000 7f608cc45640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6088161340 0x7f608806cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:27.745 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.747+0000 7f608cc45640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60880ce120 con 0x7f6088070cd0 2024-05-08T10:54:27.745 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.748+0000 7f608cc45640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60880ce400 con 0x7f60880adfe0 2024-05-08T10:54:27.746 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.748+0000 7f608cc45640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6088066d20 con 0x7f6088161340 2024-05-08T10:54:27.746 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.748+0000 7f6086d9d640 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f60880adfe0 0x7f60880ceee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:57644/0 (socket says 172.21.15.174:57644) 2024-05-08T10:54:27.746 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.748+0000 7f608659c640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6088161340 0x7f608806cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:27.746 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.748+0000 7f6086d9d640 1 -- 172.21.15.174:0/2057078765 learned_addr learned my addr 172.21.15.174:0/2057078765 (peer_addr_for_me v1:172.21.15.174:0/0) 2024-05-08T10:54:27.746 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.748+0000 7f608559a640 1 -- 172.21.15.174:0/2057078765 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3295329255 0 0) 0x7f60880ce400 con 0x7f60880adfe0 2024-05-08T10:54:27.746 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.748+0000 7f608559a640 1 -- 172.21.15.174:0/2057078765 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6070003520 con 0x7f60880adfe0 2024-05-08T10:54:27.746 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.748+0000 7f608659c640 1 -- 172.21.15.174:0/2057078765 >> v1:172.21.15.174:6789/0 conn(0x7f60880adfe0 legacy=0x7f60880ceee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:27.746 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.748+0000 7f608659c640 1 -- 172.21.15.174:0/2057078765 >> v1:172.21.15.33:6789/0 conn(0x7f6088070cd0 legacy=0x7f60880ad8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:27.746 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.748+0000 7f608659c640 1 -- 172.21.15.174:0/2057078765 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60880ce6e0 con 0x7f6088161340 2024-05-08T10:54:27.747 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.749+0000 7f608659c640 1 --2- 172.21.15.174:0/2057078765 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6088161340 0x7f608806cd30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f60780097d0 tx=0x7f607802a2a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93aeaf8f14574f5d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:54:27.748 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.749+0000 7f608559a640 1 -- 172.21.15.174:0/2057078765 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6078037070 con 0x7f6088161340 2024-05-08T10:54:27.748 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.749+0000 7f608559a640 1 -- 172.21.15.174:0/2057078765 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6078032440 con 0x7f6088161340 2024-05-08T10:54:27.748 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.749+0000 7f608559a640 1 -- 172.21.15.174:0/2057078765 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6078032810 con 0x7f6088161340 2024-05-08T10:54:27.748 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.749+0000 7f608cc45640 1 -- 172.21.15.174:0/2057078765 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6088161340 msgr2=0x7f608806cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:27.748 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.749+0000 7f608cc45640 1 --2- 172.21.15.174:0/2057078765 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6088161340 0x7f608806cd30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f60780097d0 tx=0x7f607802a2a0 comp rx=0 tx=0).stop 2024-05-08T10:54:27.748 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.750+0000 7f608cc45640 1 -- 172.21.15.174:0/2057078765 shutdown_connections 2024-05-08T10:54:27.748 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.750+0000 7f608cc45640 1 --2- 172.21.15.174:0/2057078765 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6088161340 0x7f608806cd30 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:27.748 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.750+0000 7f608cc45640 1 -- 172.21.15.174:0/2057078765 >> 172.21.15.174:0/2057078765 conn(0x7f60880cffd0 msgr2=0x7f60880d03e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:54:27.748 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.750+0000 7f608cc45640 1 -- 172.21.15.174:0/2057078765 shutdown_connections 2024-05-08T10:54:27.748 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.750+0000 7f608cc45640 1 -- 172.21.15.174:0/2057078765 wait complete. 2024-05-08T10:54:27.751 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.751+0000 7f608cc45640 1 Processor -- start 2024-05-08T10:54:27.751 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.751+0000 7f608cc45640 1 -- start start 2024-05-08T10:54:27.751 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.752+0000 7f608cc45640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6088070cd0 0x7f608809b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:27.751 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.752+0000 7f608cc45640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f60880adfe0 0x7f60881407c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:27.751 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.752+0000 7f608cc45640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6088161340 0x7f6088153810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:27.751 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.752+0000 7f608cc45640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60880cded0 con 0x7f6088161340 2024-05-08T10:54:27.751 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.752+0000 7f608cc45640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6088161720 con 0x7f60880adfe0 2024-05-08T10:54:27.751 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.752+0000 7f608cc45640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f608806d270 con 0x7f6088070cd0 2024-05-08T10:54:27.751 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.752+0000 7f608659c640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6088070cd0 0x7f608809b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:27.751 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.752+0000 7f608659c640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6088070cd0 0x7f608809b470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.174:46148/0 (socket says 172.21.15.174:46148) 2024-05-08T10:54:27.751 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.752+0000 7f608659c640 1 -- 172.21.15.174:0/3070711638 learned_addr learned my addr 172.21.15.174:0/3070711638 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-05-08T10:54:27.752 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.752+0000 7f6085d9b640 1 --2- 172.21.15.174:0/3070711638 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f60880adfe0 0x7f60881407c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:27.752 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.752+0000 7f6086d9d640 1 --2- 172.21.15.174:0/3070711638 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6088161340 0x7f6088153810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:27.752 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.752+0000 7f6085d9b640 1 -- 172.21.15.174:0/3070711638 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6088070cd0 msgr2=0x7f608809b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:27.752 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.752+0000 7f6085d9b640 1 --2- 172.21.15.174:0/3070711638 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6088070cd0 0x7f608809b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:27.752 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.752+0000 7f6085d9b640 1 -- 172.21.15.174:0/3070711638 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6088161340 msgr2=0x7f6088153810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:27.752 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.752+0000 7f6085d9b640 1 --2- 172.21.15.174:0/3070711638 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6088161340 0x7f6088153810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:27.752 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.752+0000 7f6085d9b640 1 -- 172.21.15.174:0/3070711638 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6088156a40 con 0x7f60880adfe0 2024-05-08T10:54:27.752 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.752+0000 7f608659c640 1 --2- 172.21.15.174:0/3070711638 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6088070cd0 0x7f608809b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T10:54:27.752 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.752+0000 7f6085d9b640 1 --2- 172.21.15.174:0/3070711638 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f60880adfe0 0x7f60881407c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f607c00c310 tx=0x7f607c00c7d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:54:27.752 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.753+0000 7f6076ffd640 1 -- 172.21.15.174:0/3070711638 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f607c0052d0 con 0x7f60880adfe0 2024-05-08T10:54:27.752 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.753+0000 7f6076ffd640 1 -- 172.21.15.174:0/3070711638 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f607c005490 con 0x7f60880adfe0 2024-05-08T10:54:27.752 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.753+0000 7f608cc45640 1 -- 172.21.15.174:0/3070711638 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f608815e6a0 con 0x7f60880adfe0 2024-05-08T10:54:27.752 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.753+0000 7f6076ffd640 1 -- 172.21.15.174:0/3070711638 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f607c007260 con 0x7f60880adfe0 2024-05-08T10:54:27.752 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.753+0000 7f608cc45640 1 -- 172.21.15.174:0/3070711638 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f608815ec60 con 0x7f60880adfe0 2024-05-08T10:54:27.752 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.753+0000 7f6076ffd640 1 -- 172.21.15.174:0/3070711638 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f607c007400 con 0x7f60880adfe0 2024-05-08T10:54:27.753 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.753+0000 7f6076ffd640 1 -- 172.21.15.174:0/3070711638 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f607c011590 con 0x7f60880adfe0 2024-05-08T10:54:27.753 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.754+0000 7f608cc45640 1 -- 172.21.15.174:0/3070711638 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6088069d20 con 0x7f60880adfe0 2024-05-08T10:54:27.753 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.756+0000 7f6076ffd640 1 -- 172.21.15.174:0/3070711638 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f607c003650 con 0x7f60880adfe0 2024-05-08T10:54:27.825 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.828+0000 7f608cc45640 1 -- 172.21.15.174:0/3070711638 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd new", "uuid": "87d465f3-b40f-48dd-bae2-4c67904d4828", "id": 2} v 0) v1 -- 0x7f6088066b00 con 0x7f60880adfe0 2024-05-08T10:54:27.830 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.834+0000 7f6076ffd640 1 -- 172.21.15.174:0/3070711638 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "87d465f3-b40f-48dd-bae2-4c67904d4828", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f607c003b60 con 0x7f60880adfe0 2024-05-08T10:54:27.831 INFO:teuthology.orchestra.run.smithi174.stdout:2 2024-05-08T10:54:27.832 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.834+0000 7f608cc45640 1 -- 172.21.15.174:0/3070711638 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f60880adfe0 msgr2=0x7f60881407c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:27.832 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.834+0000 7f608cc45640 1 --2- 172.21.15.174:0/3070711638 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f60880adfe0 0x7f60881407c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f607c00c310 tx=0x7f607c00c7d0 comp rx=0 tx=0).stop 2024-05-08T10:54:27.832 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.834+0000 7f608cc45640 1 -- 172.21.15.174:0/3070711638 shutdown_connections 2024-05-08T10:54:27.832 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.834+0000 7f608cc45640 1 --2- 172.21.15.174:0/3070711638 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6088161340 0x7f6088153810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:27.832 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.834+0000 7f608cc45640 1 --2- 172.21.15.174:0/3070711638 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f60880adfe0 0x7f60881407c0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:27.832 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.834+0000 7f608cc45640 1 --2- 172.21.15.174:0/3070711638 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6088070cd0 0x7f608809b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:27.832 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.834+0000 7f608cc45640 1 -- 172.21.15.174:0/3070711638 >> 172.21.15.174:0/3070711638 conn(0x7f60880cffd0 msgr2=0x7f60880b3810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:54:27.832 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.834+0000 7f608cc45640 1 -- 172.21.15.174:0/3070711638 shutdown_connections 2024-05-08T10:54:27.832 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.834+0000 7f608cc45640 1 -- 172.21.15.174:0/3070711638 wait complete. 2024-05-08T10:54:27.842 DEBUG:teuthology.orchestra.run.smithi174:> sudo ceph --cluster ceph osd new 79450edf-9637-4181-9372-e1cd5e91e73e 3 2024-05-08T10:54:27.943 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.946+0000 7ffa8d79e640 1 Processor -- start 2024-05-08T10:54:27.944 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.946+0000 7ffa8d79e640 1 -- start start 2024-05-08T10:54:27.945 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.947+0000 7ffa8d79e640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffa8815dd90 0x7ffa880ce670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:27.945 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.947+0000 7ffa8d79e640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ffa880cebb0 0x7ffa8806ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:27.946 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.947+0000 7ffa8d79e640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ffa8806b150 0x7ffa880cd140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:27.946 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.947+0000 7ffa8d79e640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa880d03a0 con 0x7ffa880cebb0 2024-05-08T10:54:27.946 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.947+0000 7ffa8d79e640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa880cf340 con 0x7ffa8806b150 2024-05-08T10:54:27.946 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.947+0000 7ffa8d79e640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa880ad840 con 0x7ffa8815dd90 2024-05-08T10:54:27.946 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.947+0000 7ffa87fff640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffa8815dd90 0x7ffa880ce670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:27.946 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.947+0000 7ffa87fff640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffa8815dd90 0x7ffa880ce670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.174:46152/0 (socket says 172.21.15.174:46152) 2024-05-08T10:54:27.946 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.947+0000 7ffa87fff640 1 -- 172.21.15.174:0/928694332 learned_addr learned my addr 172.21.15.174:0/928694332 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-05-08T10:54:27.946 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.947+0000 7ffa8cf9d640 1 --2- 172.21.15.174:0/928694332 >> v2:172.21.15.174:3300/0 conn(0x7ffa8806b150 0x7ffa880cd140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:27.946 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.947+0000 7ffa877fe640 1 --2- 172.21.15.174:0/928694332 >> v2:172.21.15.33:3300/0 conn(0x7ffa880cebb0 0x7ffa8806ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:27.946 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.948+0000 7ffa8cf9d640 1 -- 172.21.15.174:0/928694332 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffa8815dd90 msgr2=0x7ffa880ce670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:54:27.946 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.948+0000 7ffa8cf9d640 1 --2- 172.21.15.174:0/928694332 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffa8815dd90 0x7ffa880ce670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:27.946 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.948+0000 7ffa8cf9d640 1 -- 172.21.15.174:0/928694332 >> v2:172.21.15.33:3300/0 conn(0x7ffa880cebb0 msgr2=0x7ffa8806ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:54:27.946 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.948+0000 7ffa8cf9d640 1 --2- 172.21.15.174:0/928694332 >> v2:172.21.15.33:3300/0 conn(0x7ffa880cebb0 0x7ffa8806ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:27.946 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.948+0000 7ffa8cf9d640 1 -- 172.21.15.174:0/928694332 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa880cf5e0 con 0x7ffa8806b150 2024-05-08T10:54:27.947 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.948+0000 7ffa87fff640 1 --2- 172.21.15.174:0/928694332 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffa8815dd90 0x7ffa880ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T10:54:27.947 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.948+0000 7ffa8cf9d640 1 --2- 172.21.15.174:0/928694332 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffa8806b150 0x7ffa880cd140 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ffa880b0310 tx=0x7ffa8002a5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d1634e0e57a962f6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:54:27.947 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.948+0000 7ffa86ffd640 1 -- 172.21.15.174:0/928694332 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa80031600 con 0x7ffa8806b150 2024-05-08T10:54:27.947 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.948+0000 7ffa86ffd640 1 -- 172.21.15.174:0/928694332 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa800317a0 con 0x7ffa8806b150 2024-05-08T10:54:27.947 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.948+0000 7ffa86ffd640 1 -- 172.21.15.174:0/928694332 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa80031b70 con 0x7ffa8806b150 2024-05-08T10:54:27.948 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.949+0000 7ffa8d79e640 1 -- 172.21.15.174:0/928694332 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffa8806b150 msgr2=0x7ffa880cd140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:27.948 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.949+0000 7ffa8d79e640 1 --2- 172.21.15.174:0/928694332 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffa8806b150 0x7ffa880cd140 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ffa880b0310 tx=0x7ffa8002a5d0 comp rx=0 tx=0).stop 2024-05-08T10:54:27.948 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.949+0000 7ffa8d79e640 1 -- 172.21.15.174:0/928694332 shutdown_connections 2024-05-08T10:54:27.948 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.949+0000 7ffa8d79e640 1 --2- 172.21.15.174:0/928694332 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffa8806b150 0x7ffa880cd140 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:27.948 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.949+0000 7ffa8d79e640 1 --2- 172.21.15.174:0/928694332 >> v2:172.21.15.33:3300/0 conn(0x7ffa880cebb0 0x7ffa8806ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:27.948 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.949+0000 7ffa8d79e640 1 --2- 172.21.15.174:0/928694332 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffa8815dd90 0x7ffa880ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:27.948 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.949+0000 7ffa8d79e640 1 -- 172.21.15.174:0/928694332 >> 172.21.15.174:0/928694332 conn(0x7ffa880b2480 msgr2=0x7ffa880b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:54:27.948 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.949+0000 7ffa8d79e640 1 -- 172.21.15.174:0/928694332 shutdown_connections 2024-05-08T10:54:27.948 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.949+0000 7ffa8d79e640 1 -- 172.21.15.174:0/928694332 wait complete. 2024-05-08T10:54:27.949 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.950+0000 7ffa8d79e640 1 Processor -- start 2024-05-08T10:54:27.949 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.951+0000 7ffa8d79e640 1 -- start start 2024-05-08T10:54:27.951 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.951+0000 7ffa8d79e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffa8806b150 0x7ffa8814f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:27.951 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.951+0000 7ffa8d79e640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffa880cebb0 0x7ffa881f6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:27.951 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.951+0000 7ffa8d79e640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffa8815dd90 0x7ffa881f70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:27.951 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.951+0000 7ffa8d79e640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa880cfe80 con 0x7ffa8806b150 2024-05-08T10:54:27.951 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.951+0000 7ffa8d79e640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa880cfba0 con 0x7ffa8815dd90 2024-05-08T10:54:27.951 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.951+0000 7ffa8d79e640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa8815e170 con 0x7ffa880cebb0 2024-05-08T10:54:27.951 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.952+0000 7ffa8cf9d640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffa8815dd90 0x7ffa881f70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:27.951 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.952+0000 7ffa877fe640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffa880cebb0 0x7ffa881f6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:27.951 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.952+0000 7ffa8cf9d640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffa8815dd90 0x7ffa881f70d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:35658/0 (socket says 172.21.15.174:35658) 2024-05-08T10:54:27.951 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.952+0000 7ffa8cf9d640 1 -- 172.21.15.174:0/324513257 learned_addr learned my addr 172.21.15.174:0/324513257 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-05-08T10:54:27.952 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.952+0000 7ffa87fff640 1 --2- 172.21.15.174:0/324513257 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffa8806b150 0x7ffa8814f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:27.952 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.952+0000 7ffa8cf9d640 1 -- 172.21.15.174:0/324513257 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffa880cebb0 msgr2=0x7ffa881f6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:27.952 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.952+0000 7ffa8cf9d640 1 --2- 172.21.15.174:0/324513257 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffa880cebb0 0x7ffa881f6b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:27.952 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.952+0000 7ffa8cf9d640 1 -- 172.21.15.174:0/324513257 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffa8806b150 msgr2=0x7ffa8814f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:27.952 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.952+0000 7ffa8cf9d640 1 --2- 172.21.15.174:0/324513257 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffa8806b150 0x7ffa8814f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:27.952 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.952+0000 7ffa8cf9d640 1 -- 172.21.15.174:0/324513257 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa8814fcc0 con 0x7ffa8815dd90 2024-05-08T10:54:27.952 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.952+0000 7ffa87fff640 1 --2- 172.21.15.174:0/324513257 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffa8806b150 0x7ffa8814f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T10:54:27.952 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.952+0000 7ffa8cf9d640 1 --2- 172.21.15.174:0/324513257 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffa8815dd90 0x7ffa881f70d0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ffa8002abc0 tx=0x7ffa80004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:54:27.952 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.952+0000 7ffa84ff9640 1 -- 172.21.15.174:0/324513257 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa80040070 con 0x7ffa8815dd90 2024-05-08T10:54:27.952 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.952+0000 7ffa84ff9640 1 -- 172.21.15.174:0/324513257 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa8003c830 con 0x7ffa8815dd90 2024-05-08T10:54:27.952 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.952+0000 7ffa84ff9640 1 -- 172.21.15.174:0/324513257 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa8003cbe0 con 0x7ffa8815dd90 2024-05-08T10:54:27.952 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.952+0000 7ffa8d79e640 1 -- 172.21.15.174:0/324513257 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa881610e0 con 0x7ffa8815dd90 2024-05-08T10:54:27.952 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.952+0000 7ffa8d79e640 1 -- 172.21.15.174:0/324513257 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa881f7a50 con 0x7ffa8815dd90 2024-05-08T10:54:27.952 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.952+0000 7ffa84ff9640 1 -- 172.21.15.174:0/324513257 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7ffa80039040 con 0x7ffa8815dd90 2024-05-08T10:54:27.952 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.953+0000 7ffa84ff9640 1 -- 172.21.15.174:0/324513257 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7ffa80031730 con 0x7ffa8815dd90 2024-05-08T10:54:27.953 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.953+0000 7ffa8d79e640 1 -- 172.21.15.174:0/324513257 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa8804efc0 con 0x7ffa8815dd90 2024-05-08T10:54:27.953 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:27.955+0000 7ffa84ff9640 1 -- 172.21.15.174:0/324513257 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7ffa881610e0 con 0x7ffa8815dd90 2024-05-08T10:54:28.023 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.026+0000 7ffa8d79e640 1 -- 172.21.15.174:0/324513257 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd new", "uuid": "79450edf-9637-4181-9372-e1cd5e91e73e", "id": 3} v 0) v1 -- 0x7ffa88074520 con 0x7ffa8815dd90 2024-05-08T10:54:28.028 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.031+0000 7ffa84ff9640 1 -- 172.21.15.174:0/324513257 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "79450edf-9637-4181-9372-e1cd5e91e73e", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7ffa8814fcc0 con 0x7ffa8815dd90 2024-05-08T10:54:28.029 INFO:teuthology.orchestra.run.smithi174.stdout:3 2024-05-08T10:54:28.030 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.032+0000 7ffa8d79e640 1 -- 172.21.15.174:0/324513257 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffa8815dd90 msgr2=0x7ffa881f70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:28.030 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.032+0000 7ffa8d79e640 1 --2- 172.21.15.174:0/324513257 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffa8815dd90 0x7ffa881f70d0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ffa8002abc0 tx=0x7ffa80004a40 comp rx=0 tx=0).stop 2024-05-08T10:54:28.030 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.032+0000 7ffa8d79e640 1 -- 172.21.15.174:0/324513257 shutdown_connections 2024-05-08T10:54:28.030 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.032+0000 7ffa8d79e640 1 --2- 172.21.15.174:0/324513257 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffa8815dd90 0x7ffa881f70d0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:28.030 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.032+0000 7ffa8d79e640 1 --2- 172.21.15.174:0/324513257 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffa880cebb0 0x7ffa881f6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:28.030 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.032+0000 7ffa8d79e640 1 --2- 172.21.15.174:0/324513257 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffa8806b150 0x7ffa8814f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:28.030 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.032+0000 7ffa8d79e640 1 -- 172.21.15.174:0/324513257 >> 172.21.15.174:0/324513257 conn(0x7ffa880b2480 msgr2=0x7ffa880b1c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:54:28.030 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.033+0000 7ffa8d79e640 1 -- 172.21.15.174:0/324513257 shutdown_connections 2024-05-08T10:54:28.031 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.033+0000 7ffa8d79e640 1 -- 172.21.15.174:0/324513257 wait complete. 2024-05-08T10:54:28.042 DEBUG:teuthology.orchestra.run.smithi174:> sudo ceph --cluster ceph osd new bd0debfa-e559-4b1e-920d-6b2639c7085e 4 2024-05-08T10:54:28.130 INFO:tasks.ceph.mgr.y.smithi033.stderr:2024-05-08T10:54:28.132+0000 7f908ba15040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-08T10:54:28.137 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-08T10:54:28.141+0000 7fe860991040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-08T10:54:28.141 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.144+0000 7f268685d640 1 Processor -- start 2024-05-08T10:54:28.141 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.144+0000 7f268685d640 1 -- start start 2024-05-08T10:54:28.142 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.144+0000 7f268685d640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f268015e110 0x7f26800d2220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:28.142 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.144+0000 7f268685d640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26800b31a0 con 0x7f26800d2760 2024-05-08T10:54:28.142 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.144+0000 7f268685d640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26800b3480 con 0x7f268015dd30 2024-05-08T10:54:28.142 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.144+0000 7f268685d640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26800d2ba0 con 0x7f268015e110 2024-05-08T10:54:28.142 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.145+0000 7f267f7fe640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f268015e110 0x7f26800d2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:28.142 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.145+0000 7f267f7fe640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f268015e110 0x7f26800d2220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.174:46170/0 (socket says 172.21.15.174:46170) 2024-05-08T10:54:28.143 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.145+0000 7f267f7fe640 1 -- 172.21.15.174:0/2108447648 learned_addr learned my addr 172.21.15.174:0/2108447648 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-05-08T10:54:28.143 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.145+0000 7f267ffff640 1 --1- 172.21.15.174:0/2108447648 >> v1:172.21.15.174:6789/0 conn(0x7f268015dd30 0x7f26800cf160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:57654/0 (socket says 172.21.15.174:57654) 2024-05-08T10:54:28.143 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.145+0000 7f267f7fe640 1 -- 172.21.15.174:0/2108447648 >> v1:172.21.15.174:6789/0 conn(0x7f268015dd30 legacy=0x7f26800cf160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:28.143 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.145+0000 7f267f7fe640 1 -- 172.21.15.174:0/2108447648 >> v1:172.21.15.33:6789/0 conn(0x7f26800d2760 legacy=0x7f26800b3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:28.143 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.145+0000 7f267f7fe640 1 -- 172.21.15.174:0/2108447648 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26800b3760 con 0x7f268015e110 2024-05-08T10:54:28.144 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.146+0000 7f267f7fe640 1 --2- 172.21.15.174:0/2108447648 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f268015e110 0x7f26800d2220 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f26740098a0 tx=0x7f267402a2e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e2740404539aef93 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:54:28.144 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.146+0000 7f267effd640 1 -- 172.21.15.174:0/2108447648 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2674037070 con 0x7f268015e110 2024-05-08T10:54:28.144 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.146+0000 7f267effd640 1 -- 172.21.15.174:0/2108447648 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2674032640 con 0x7f268015e110 2024-05-08T10:54:28.144 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.146+0000 7f267effd640 1 -- 172.21.15.174:0/2108447648 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2674032a10 con 0x7f268015e110 2024-05-08T10:54:28.144 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.146+0000 7f268685d640 1 -- 172.21.15.174:0/2108447648 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f268015e110 msgr2=0x7f26800d2220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:28.144 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.146+0000 7f268685d640 1 --2- 172.21.15.174:0/2108447648 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f268015e110 0x7f26800d2220 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f26740098a0 tx=0x7f267402a2e0 comp rx=0 tx=0).stop 2024-05-08T10:54:28.145 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.146+0000 7f268685d640 1 -- 172.21.15.174:0/2108447648 shutdown_connections 2024-05-08T10:54:28.145 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.146+0000 7f268685d640 1 --2- 172.21.15.174:0/2108447648 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f268015e110 0x7f26800d2220 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:28.145 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.146+0000 7f268685d640 1 -- 172.21.15.174:0/2108447648 >> 172.21.15.174:0/2108447648 conn(0x7f268009cf10 msgr2=0x7f26800d3c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:54:28.145 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.147+0000 7f268685d640 1 -- 172.21.15.174:0/2108447648 shutdown_connections 2024-05-08T10:54:28.145 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.147+0000 7f268685d640 1 -- 172.21.15.174:0/2108447648 wait complete. 2024-05-08T10:54:28.147 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.148+0000 7f268685d640 1 Processor -- start 2024-05-08T10:54:28.147 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.148+0000 7f268685d640 1 -- start start 2024-05-08T10:54:28.147 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.149+0000 7f268685d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26800d2760 0x7f2680155bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:28.147 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.149+0000 7f268685d640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f268015dd30 0x7f26800a1520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:28.147 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.149+0000 7f268685d640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f268015e110 0x7f26800b7720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:28.148 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.149+0000 7f268685d640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26800d1d60 con 0x7f26800d2760 2024-05-08T10:54:28.148 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.149+0000 7f268685d640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26800d1be0 con 0x7f268015e110 2024-05-08T10:54:28.148 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.149+0000 7f268685d640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26800cf870 con 0x7f268015dd30 2024-05-08T10:54:28.148 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.149+0000 7f267f7fe640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f268015dd30 0x7f26800a1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:28.148 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.149+0000 7f267f7fe640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f268015dd30 0x7f26800a1520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.174:46172/0 (socket says 172.21.15.174:46172) 2024-05-08T10:54:28.148 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.149+0000 7f267f7fe640 1 -- 172.21.15.174:0/1808925957 learned_addr learned my addr 172.21.15.174:0/1808925957 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-05-08T10:54:28.148 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.149+0000 7f2684dfa640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f268015e110 0x7f26800b7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:28.148 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.149+0000 7f267ffff640 1 --2- 172.21.15.174:0/1808925957 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26800d2760 0x7f2680155bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:28.148 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.149+0000 7f267f7fe640 1 -- 172.21.15.174:0/1808925957 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f268015e110 msgr2=0x7f26800b7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:28.148 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.149+0000 7f267f7fe640 1 --2- 172.21.15.174:0/1808925957 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f268015e110 0x7f26800b7720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:28.148 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.149+0000 7f267f7fe640 1 -- 172.21.15.174:0/1808925957 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26800d2760 msgr2=0x7f2680155bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:28.148 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.149+0000 7f267f7fe640 1 --2- 172.21.15.174:0/1808925957 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26800d2760 0x7f2680155bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:28.148 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.149+0000 7f267f7fe640 1 -- 172.21.15.174:0/1808925957 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26800caf20 con 0x7f268015dd30 2024-05-08T10:54:28.148 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.149+0000 7f267f7fe640 1 --2- 172.21.15.174:0/1808925957 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f268015dd30 0x7f26800a1520 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2674000c00 tx=0x7f26740046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:54:28.148 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.149+0000 7f267cff9640 1 -- 172.21.15.174:0/1808925957 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2674037040 con 0x7f268015dd30 2024-05-08T10:54:28.149 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.149+0000 7f267cff9640 1 -- 172.21.15.174:0/1808925957 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2674042070 con 0x7f268015dd30 2024-05-08T10:54:28.149 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.149+0000 7f268685d640 1 -- 172.21.15.174:0/1808925957 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2680156220 con 0x7f268015dd30 2024-05-08T10:54:28.149 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.149+0000 7f267cff9640 1 -- 172.21.15.174:0/1808925957 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2674030bd0 con 0x7f268015dd30 2024-05-08T10:54:28.149 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.149+0000 7f268685d640 1 -- 172.21.15.174:0/1808925957 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26800cb4a0 con 0x7f268015dd30 2024-05-08T10:54:28.149 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.150+0000 7f267cff9640 1 -- 172.21.15.174:0/1808925957 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f2674032500 con 0x7f268015dd30 2024-05-08T10:54:28.149 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.150+0000 7f267cff9640 1 -- 172.21.15.174:0/1808925957 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f2674047dc0 con 0x7f268015dd30 2024-05-08T10:54:28.149 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.150+0000 7f268685d640 1 -- 172.21.15.174:0/1808925957 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2680069d20 con 0x7f268015dd30 2024-05-08T10:54:28.149 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.152+0000 7f267cff9640 1 -- 172.21.15.174:0/1808925957 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f2674030d70 con 0x7f268015dd30 2024-05-08T10:54:28.221 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.224+0000 7f268685d640 1 -- 172.21.15.174:0/1808925957 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd new", "uuid": "bd0debfa-e559-4b1e-920d-6b2639c7085e", "id": 4} v 0) v1 -- 0x7f26800ca480 con 0x7f268015dd30 2024-05-08T10:54:28.221 INFO:tasks.ceph.mgr.y.smithi033.stderr:2024-05-08T10:54:28.224+0000 7f908ba15040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-08T10:54:28.224 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.227+0000 7f267cff9640 1 -- 172.21.15.174:0/1808925957 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "bd0debfa-e559-4b1e-920d-6b2639c7085e", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2674047530 con 0x7f268015dd30 2024-05-08T10:54:28.224 INFO:teuthology.orchestra.run.smithi174.stdout:4 2024-05-08T10:54:28.225 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.228+0000 7f268685d640 1 -- 172.21.15.174:0/1808925957 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f268015dd30 msgr2=0x7f26800a1520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:28.225 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.228+0000 7f268685d640 1 --2- 172.21.15.174:0/1808925957 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f268015dd30 0x7f26800a1520 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2674000c00 tx=0x7f26740046c0 comp rx=0 tx=0).stop 2024-05-08T10:54:28.225 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.228+0000 7f268685d640 1 -- 172.21.15.174:0/1808925957 shutdown_connections 2024-05-08T10:54:28.225 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.228+0000 7f268685d640 1 --2- 172.21.15.174:0/1808925957 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f268015e110 0x7f26800b7720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:28.225 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.228+0000 7f268685d640 1 --2- 172.21.15.174:0/1808925957 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f268015dd30 0x7f26800a1520 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:28.225 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.228+0000 7f268685d640 1 --2- 172.21.15.174:0/1808925957 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26800d2760 0x7f2680155bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:28.225 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.228+0000 7f268685d640 1 -- 172.21.15.174:0/1808925957 >> 172.21.15.174:0/1808925957 conn(0x7f268009cf10 msgr2=0x7f26800d0520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:54:28.226 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.228+0000 7f268685d640 1 -- 172.21.15.174:0/1808925957 shutdown_connections 2024-05-08T10:54:28.226 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.228+0000 7f268685d640 1 -- 172.21.15.174:0/1808925957 wait complete. 2024-05-08T10:54:28.228 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-08T10:54:28.231+0000 7fe860991040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-08T10:54:28.235 DEBUG:teuthology.orchestra.run.smithi174:> sudo ceph --cluster ceph osd new ff0f51c0-672b-448f-9de1-b9305ce8c00d 5 2024-05-08T10:54:28.266 INFO:tasks.ceph.mgr.y.smithi033.stderr:2024-05-08T10:54:28.269+0000 7f908ba15040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-08T10:54:28.274 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-08T10:54:28.277+0000 7fe860991040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-08T10:54:28.336 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.339+0000 7f2325922640 1 Processor -- start 2024-05-08T10:54:28.336 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.339+0000 7f2325922640 1 -- start start 2024-05-08T10:54:28.338 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.339+0000 7f2325922640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f23200d21c0 0x7f23200d25a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:28.338 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.339+0000 7f2325922640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f23200d18b0 0x7f23200cf1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:28.338 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.339+0000 7f2325922640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23200d2ae0 con 0x7f23200d0540 2024-05-08T10:54:28.338 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.339+0000 7f2325922640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23200b7290 con 0x7f23200d18b0 2024-05-08T10:54:28.338 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.339+0000 7f2325922640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23200cfa30 con 0x7f23200d21c0 2024-05-08T10:54:28.338 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.339+0000 7f231effd640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f23200d21c0 0x7f23200d25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:28.338 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.340+0000 7f231effd640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f23200d21c0 0x7f23200d25a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.174:46174/0 (socket says 172.21.15.174:46174) 2024-05-08T10:54:28.338 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.340+0000 7f231effd640 1 -- 172.21.15.174:0/1580593053 learned_addr learned my addr 172.21.15.174:0/1580593053 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-05-08T10:54:28.338 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.340+0000 7f231e7fc640 1 --2- 172.21.15.174:0/1580593053 >> v2:172.21.15.33:3300/0 conn(0x7f23200d18b0 0x7f23200cf1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:28.338 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.340+0000 7f231effd640 1 -- 172.21.15.174:0/1580593053 >> v2:172.21.15.33:3300/0 conn(0x7f23200d18b0 msgr2=0x7f23200cf1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:54:28.338 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.340+0000 7f231effd640 1 --2- 172.21.15.174:0/1580593053 >> v2:172.21.15.33:3300/0 conn(0x7f23200d18b0 0x7f23200cf1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:28.339 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.340+0000 7f231effd640 1 -- 172.21.15.174:0/1580593053 >> v1:172.21.15.33:6789/0 conn(0x7f23200d0540 legacy=0x7f23200d09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:28.339 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.340+0000 7f231effd640 1 -- 172.21.15.174:0/1580593053 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23200b6c40 con 0x7f23200d21c0 2024-05-08T10:54:28.339 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.340+0000 7f231effd640 1 --2- 172.21.15.174:0/1580593053 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f23200d21c0 0x7f23200d25a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f2310009870 tx=0x7f231002a300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e84854b1a8431035 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:54:28.339 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.341+0000 7f231dffb640 1 -- 172.21.15.174:0/1580593053 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2310037070 con 0x7f23200d21c0 2024-05-08T10:54:28.339 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.341+0000 7f231dffb640 1 -- 172.21.15.174:0/1580593053 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f231002ae50 con 0x7f23200d21c0 2024-05-08T10:54:28.339 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.341+0000 7f231dffb640 1 -- 172.21.15.174:0/1580593053 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2310032860 con 0x7f23200d21c0 2024-05-08T10:54:28.340 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.341+0000 7f2325922640 1 -- 172.21.15.174:0/1580593053 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f23200d21c0 msgr2=0x7f23200d25a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:28.340 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.341+0000 7f2325922640 1 --2- 172.21.15.174:0/1580593053 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f23200d21c0 0x7f23200d25a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f2310009870 tx=0x7f231002a300 comp rx=0 tx=0).stop 2024-05-08T10:54:28.340 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.341+0000 7f2325922640 1 -- 172.21.15.174:0/1580593053 shutdown_connections 2024-05-08T10:54:28.340 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.341+0000 7f2325922640 1 --2- 172.21.15.174:0/1580593053 >> v2:172.21.15.33:3300/0 conn(0x7f23200d18b0 0x7f23200cf1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:28.340 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.341+0000 7f2325922640 1 --2- 172.21.15.174:0/1580593053 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f23200d21c0 0x7f23200d25a0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:28.340 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.341+0000 7f2325922640 1 -- 172.21.15.174:0/1580593053 >> 172.21.15.174:0/1580593053 conn(0x7f23200d3be0 msgr2=0x7f23200d3ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:54:28.340 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.341+0000 7f2325922640 1 -- 172.21.15.174:0/1580593053 shutdown_connections 2024-05-08T10:54:28.340 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.341+0000 7f2325922640 1 -- 172.21.15.174:0/1580593053 wait complete. 2024-05-08T10:54:28.341 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.343+0000 7f2325922640 1 Processor -- start 2024-05-08T10:54:28.341 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.343+0000 7f2325922640 1 -- start start 2024-05-08T10:54:28.343 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.343+0000 7f2325922640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f23200d0540 0x7f23200a1180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:28.343 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.343+0000 7f2325922640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23200d18b0 0x7f23201587c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:28.343 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.343+0000 7f2325922640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f23200d21c0 0x7f2320159a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:28.343 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.343+0000 7f2325922640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23200cf710 con 0x7f23200d18b0 2024-05-08T10:54:28.343 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.344+0000 7f2325922640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f232015e340 con 0x7f23200d0540 2024-05-08T10:54:28.343 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.344+0000 7f2325922640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23200d10c0 con 0x7f23200d21c0 2024-05-08T10:54:28.343 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.344+0000 7f231effd640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f23200d0540 0x7f23200a1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:28.343 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.344+0000 7f231f7fe640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f23200d21c0 0x7f2320159a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:28.343 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.344+0000 7f231effd640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f23200d0540 0x7f23200a1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:35670/0 (socket says 172.21.15.174:35670) 2024-05-08T10:54:28.344 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.344+0000 7f231effd640 1 -- 172.21.15.174:0/1727608213 learned_addr learned my addr 172.21.15.174:0/1727608213 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-05-08T10:54:28.344 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.344+0000 7f231e7fc640 1 --2- 172.21.15.174:0/1727608213 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23200d18b0 0x7f23201587c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:28.344 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.344+0000 7f231effd640 1 -- 172.21.15.174:0/1727608213 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f23200d21c0 msgr2=0x7f2320159a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:28.344 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.344+0000 7f231effd640 1 --2- 172.21.15.174:0/1727608213 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f23200d21c0 0x7f2320159a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:28.344 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.344+0000 7f231effd640 1 -- 172.21.15.174:0/1727608213 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23200d18b0 msgr2=0x7f23201587c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:28.344 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.344+0000 7f231effd640 1 --2- 172.21.15.174:0/1727608213 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23200d18b0 0x7f23201587c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:28.344 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.344+0000 7f231effd640 1 -- 172.21.15.174:0/1727608213 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23201f44d0 con 0x7f23200d0540 2024-05-08T10:54:28.344 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.344+0000 7f231f7fe640 1 --2- 172.21.15.174:0/1727608213 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f23200d21c0 0x7f2320159a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T10:54:28.344 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.344+0000 7f231effd640 1 --2- 172.21.15.174:0/1727608213 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f23200d0540 0x7f23200a1180 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f2310000c00 tx=0x7f23100046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:54:28.344 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.344+0000 7f2317fff640 1 -- 172.21.15.174:0/1727608213 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2310041070 con 0x7f23200d0540 2024-05-08T10:54:28.344 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.344+0000 7f2317fff640 1 -- 172.21.15.174:0/1727608213 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f231003c660 con 0x7f23200d0540 2024-05-08T10:54:28.344 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.344+0000 7f2325922640 1 -- 172.21.15.174:0/1727608213 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23201590c0 con 0x7f23200d0540 2024-05-08T10:54:28.344 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.344+0000 7f2317fff640 1 -- 172.21.15.174:0/1727608213 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2310037040 con 0x7f23200d0540 2024-05-08T10:54:28.344 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.344+0000 7f2325922640 1 -- 172.21.15.174:0/1727608213 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2320159680 con 0x7f23200d0540 2024-05-08T10:54:28.344 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.345+0000 7f2317fff640 1 -- 172.21.15.174:0/1727608213 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f2310044070 con 0x7f23200d0540 2024-05-08T10:54:28.344 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.345+0000 7f2317fff640 1 -- 172.21.15.174:0/1727608213 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f231003d3f0 con 0x7f23200d0540 2024-05-08T10:54:28.345 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.345+0000 7f2325922640 1 -- 172.21.15.174:0/1727608213 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2320069d20 con 0x7f23200d0540 2024-05-08T10:54:28.345 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.347+0000 7f2317fff640 1 -- 172.21.15.174:0/1727608213 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f2310046450 con 0x7f23200d0540 2024-05-08T10:54:28.418 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.421+0000 7f2325922640 1 -- 172.21.15.174:0/1727608213 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ff0f51c0-672b-448f-9de1-b9305ce8c00d", "id": 5} v 0) v1 -- 0x7f2320074520 con 0x7f23200d0540 2024-05-08T10:54:28.423 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.426+0000 7f2317fff640 1 -- 172.21.15.174:0/1727608213 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ff0f51c0-672b-448f-9de1-b9305ce8c00d", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f231003ca50 con 0x7f23200d0540 2024-05-08T10:54:28.423 INFO:teuthology.orchestra.run.smithi174.stdout:5 2024-05-08T10:54:28.424 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.427+0000 7f2325922640 1 -- 172.21.15.174:0/1727608213 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f23200d0540 msgr2=0x7f23200a1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:28.424 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.427+0000 7f2325922640 1 --2- 172.21.15.174:0/1727608213 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f23200d0540 0x7f23200a1180 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f2310000c00 tx=0x7f23100046c0 comp rx=0 tx=0).stop 2024-05-08T10:54:28.425 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.427+0000 7f2325922640 1 -- 172.21.15.174:0/1727608213 shutdown_connections 2024-05-08T10:54:28.425 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.427+0000 7f2325922640 1 --2- 172.21.15.174:0/1727608213 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f23200d21c0 0x7f2320159a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:28.425 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.427+0000 7f2325922640 1 --2- 172.21.15.174:0/1727608213 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23200d18b0 0x7f23201587c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:28.425 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.427+0000 7f2325922640 1 --2- 172.21.15.174:0/1727608213 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f23200d0540 0x7f23200a1180 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:28.425 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.427+0000 7f2325922640 1 -- 172.21.15.174:0/1727608213 >> 172.21.15.174:0/1727608213 conn(0x7f23200d3be0 msgr2=0x7f23200b9130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:54:28.425 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.427+0000 7f2325922640 1 -- 172.21.15.174:0/1727608213 shutdown_connections 2024-05-08T10:54:28.425 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.427+0000 7f2325922640 1 -- 172.21.15.174:0/1727608213 wait complete. 2024-05-08T10:54:28.435 DEBUG:teuthology.orchestra.run.smithi174:> sudo ceph --cluster ceph osd new 93061f6c-c0ce-47e9-88a0-1151c5ccb4e0 6 2024-05-08T10:54:28.439 INFO:tasks.ceph.mgr.y.smithi033.stderr:2024-05-08T10:54:28.442+0000 7f908ba15040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-08T10:54:28.449 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-08T10:54:28.452+0000 7fe860991040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-08T10:54:28.489 INFO:tasks.ceph.mgr.y.smithi033.stderr:2024-05-08T10:54:28.492+0000 7f908ba15040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-08T10:54:28.509 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-08T10:54:28.512+0000 7fe860991040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-08T10:54:28.544 INFO:tasks.ceph.mgr.y.smithi033.stderr:2024-05-08T10:54:28.547+0000 7f908ba15040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-08T10:54:28.547 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.550+0000 7f03a4eea640 1 Processor -- start 2024-05-08T10:54:28.548 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.551+0000 7f03a4eea640 1 -- start start 2024-05-08T10:54:28.549 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.551+0000 7f03a4eea640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f03a015dee0 0x7f03a00ade40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:28.550 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.551+0000 7f03a4eea640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f03a00ceac0 0x7f03a00cef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:28.550 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.551+0000 7f03a4eea640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03a006cf70 con 0x7f03a00ace50 2024-05-08T10:54:28.550 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.551+0000 7f03a4eea640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03a006d250 con 0x7f03a00ceac0 2024-05-08T10:54:28.550 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.552+0000 7f03a4eea640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03a006d530 con 0x7f03a015dee0 2024-05-08T10:54:28.550 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.552+0000 7f039dd9b640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f03a00ceac0 0x7f03a00cef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:28.550 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.552+0000 7f039dd9b640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f03a00ceac0 0x7f03a00cef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:35678/0 (socket says 172.21.15.174:35678) 2024-05-08T10:54:28.550 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.552+0000 7f039dd9b640 1 -- 172.21.15.174:0/1240648090 learned_addr learned my addr 172.21.15.174:0/1240648090 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-05-08T10:54:28.550 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.552+0000 7f039e59c640 1 --2- 172.21.15.174:0/1240648090 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f03a015dee0 0x7f03a00ade40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:28.550 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.552+0000 7f039ed9d640 1 --1- 172.21.15.174:0/1240648090 >> v1:172.21.15.174:6789/0 conn(0x7f03a00ace50 0x7f03a006b160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:57658/0 (socket says 172.21.15.174:57658) 2024-05-08T10:54:28.550 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.552+0000 7f039dd9b640 1 -- 172.21.15.174:0/1240648090 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f03a015dee0 msgr2=0x7f03a00ade40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:54:28.550 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.552+0000 7f039dd9b640 1 --2- 172.21.15.174:0/1240648090 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f03a015dee0 0x7f03a00ade40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:28.550 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.552+0000 7f039dd9b640 1 -- 172.21.15.174:0/1240648090 >> v1:172.21.15.174:6789/0 conn(0x7f03a00ace50 legacy=0x7f03a006b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:28.550 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.552+0000 7f039dd9b640 1 -- 172.21.15.174:0/1240648090 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03a006ac40 con 0x7f03a00ceac0 2024-05-08T10:54:28.551 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.552+0000 7f039d59a640 1 -- 172.21.15.174:0/1240648090 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3852237945 0 0) 0x7f03a006cf70 con 0x7f03a00ace50 2024-05-08T10:54:28.551 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.552+0000 7f039e59c640 1 --2- 172.21.15.174:0/1240648090 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f03a015dee0 0x7f03a00ade40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T10:54:28.551 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.553+0000 7f039dd9b640 1 --2- 172.21.15.174:0/1240648090 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f03a00ceac0 0x7f03a00cef40 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f0394009850 tx=0x7f039402a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d173d869533df255 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:54:28.552 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.553+0000 7f039d59a640 1 -- 172.21.15.174:0/1240648090 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0394004030 con 0x7f03a00ceac0 2024-05-08T10:54:28.552 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.553+0000 7f039d59a640 1 -- 172.21.15.174:0/1240648090 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03940041d0 con 0x7f03a00ceac0 2024-05-08T10:54:28.552 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.553+0000 7f039d59a640 1 -- 172.21.15.174:0/1240648090 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0394003610 con 0x7f03a00ceac0 2024-05-08T10:54:28.552 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.554+0000 7f03a4eea640 1 -- 172.21.15.174:0/1240648090 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f03a00ceac0 msgr2=0x7f03a00cef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:28.552 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.554+0000 7f03a4eea640 1 --2- 172.21.15.174:0/1240648090 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f03a00ceac0 0x7f03a00cef40 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f0394009850 tx=0x7f039402a230 comp rx=0 tx=0).stop 2024-05-08T10:54:28.552 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.554+0000 7f03a4eea640 1 -- 172.21.15.174:0/1240648090 shutdown_connections 2024-05-08T10:54:28.552 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.554+0000 7f03a4eea640 1 --2- 172.21.15.174:0/1240648090 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f03a00ceac0 0x7f03a00cef40 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:28.553 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.554+0000 7f03a4eea640 1 --2- 172.21.15.174:0/1240648090 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f03a015dee0 0x7f03a00ade40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:28.553 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.554+0000 7f03a4eea640 1 -- 172.21.15.174:0/1240648090 >> 172.21.15.174:0/1240648090 conn(0x7f03a00b1b70 msgr2=0x7f03a00b1f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:54:28.553 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.554+0000 7f03a4eea640 1 -- 172.21.15.174:0/1240648090 shutdown_connections 2024-05-08T10:54:28.553 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.554+0000 7f03a4eea640 1 -- 172.21.15.174:0/1240648090 wait complete. 2024-05-08T10:54:28.553 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.555+0000 7f03a4eea640 1 Processor -- start 2024-05-08T10:54:28.553 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.555+0000 7f03a4eea640 1 -- start start 2024-05-08T10:54:28.555 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.556+0000 7f03a4eea640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f03a00ace50 0x7f03a00c7f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:28.555 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.556+0000 7f03a4eea640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f03a00ceac0 0x7f03a0150410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:28.555 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.556+0000 7f03a4eea640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03a015dee0 0x7f03a00c3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:28.556 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.556+0000 7f03a4eea640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03a006cb90 con 0x7f03a015dee0 2024-05-08T10:54:28.556 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.556+0000 7f03a4eea640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03a015e2c0 con 0x7f03a00ceac0 2024-05-08T10:54:28.556 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.556+0000 7f03a4eea640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03a006cd10 con 0x7f03a00ace50 2024-05-08T10:54:28.556 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.556+0000 7f039e59c640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f03a00ace50 0x7f03a00c7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:28.556 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.556+0000 7f039dd9b640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f03a00ceac0 0x7f03a0150410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:28.556 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.556+0000 7f039dd9b640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f03a00ceac0 0x7f03a0150410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:35692/0 (socket says 172.21.15.174:35692) 2024-05-08T10:54:28.556 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.556+0000 7f039dd9b640 1 -- 172.21.15.174:0/1957823433 learned_addr learned my addr 172.21.15.174:0/1957823433 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-05-08T10:54:28.556 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.556+0000 7f039ed9d640 1 --2- 172.21.15.174:0/1957823433 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03a015dee0 0x7f03a00c3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:28.556 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.556+0000 7f039e59c640 1 -- 172.21.15.174:0/1957823433 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f03a00ceac0 msgr2=0x7f03a0150410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:28.556 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.556+0000 7f039e59c640 1 --2- 172.21.15.174:0/1957823433 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f03a00ceac0 0x7f03a0150410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:28.556 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.556+0000 7f039e59c640 1 -- 172.21.15.174:0/1957823433 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03a015dee0 msgr2=0x7f03a00c3b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:28.556 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.556+0000 7f039e59c640 1 --2- 172.21.15.174:0/1957823433 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03a015dee0 0x7f03a00c3b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:28.556 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.556+0000 7f039e59c640 1 -- 172.21.15.174:0/1957823433 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03a00c8710 con 0x7f03a00ace50 2024-05-08T10:54:28.556 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.556+0000 7f039dd9b640 1 --2- 172.21.15.174:0/1957823433 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f03a00ceac0 0x7f03a0150410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T10:54:28.557 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.556+0000 7f039e59c640 1 --2- 172.21.15.174:0/1957823433 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f03a00ace50 0x7f03a00c7f90 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f039000e8a0 tx=0x7f039000ed60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:54:28.557 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.557+0000 7f038effd640 1 -- 172.21.15.174:0/1957823433 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0390017070 con 0x7f03a00ace50 2024-05-08T10:54:28.557 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.557+0000 7f038effd640 1 -- 172.21.15.174:0/1957823433 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f039000c940 con 0x7f03a00ace50 2024-05-08T10:54:28.557 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.557+0000 7f03a4eea640 1 -- 172.21.15.174:0/1957823433 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03a00c89f0 con 0x7f03a00ace50 2024-05-08T10:54:28.557 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.557+0000 7f038effd640 1 -- 172.21.15.174:0/1957823433 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f039000cd30 con 0x7f03a00ace50 2024-05-08T10:54:28.557 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.557+0000 7f03a4eea640 1 -- 172.21.15.174:0/1957823433 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03a00c8fb0 con 0x7f03a00ace50 2024-05-08T10:54:28.557 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.557+0000 7f038effd640 1 -- 172.21.15.174:0/1957823433 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f039001a070 con 0x7f03a00ace50 2024-05-08T10:54:28.557 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.557+0000 7f038effd640 1 -- 172.21.15.174:0/1957823433 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f0390013470 con 0x7f03a00ace50 2024-05-08T10:54:28.557 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.558+0000 7f03a4eea640 1 -- 172.21.15.174:0/1957823433 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03a0069d20 con 0x7f03a00ace50 2024-05-08T10:54:28.558 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.561+0000 7f038effd640 1 -- 172.21.15.174:0/1957823433 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f0390006480 con 0x7f03a00ace50 2024-05-08T10:54:28.565 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-08T10:54:28.568+0000 7fe860991040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-08T10:54:28.632 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.635+0000 7f03a4eea640 1 -- 172.21.15.174:0/1957823433 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd new", "uuid": "93061f6c-c0ce-47e9-88a0-1151c5ccb4e0", "id": 6} v 0) v1 -- 0x7f03a006bd60 con 0x7f03a00ace50 2024-05-08T10:54:28.637 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.640+0000 7f038effd640 1 -- 172.21.15.174:0/1957823433 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "93061f6c-c0ce-47e9-88a0-1151c5ccb4e0", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0390006660 con 0x7f03a00ace50 2024-05-08T10:54:28.638 INFO:teuthology.orchestra.run.smithi174.stdout:6 2024-05-08T10:54:28.639 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.641+0000 7f03a4eea640 1 -- 172.21.15.174:0/1957823433 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f03a00ace50 msgr2=0x7f03a00c7f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:28.639 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.641+0000 7f03a4eea640 1 --2- 172.21.15.174:0/1957823433 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f03a00ace50 0x7f03a00c7f90 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f039000e8a0 tx=0x7f039000ed60 comp rx=0 tx=0).stop 2024-05-08T10:54:28.639 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.641+0000 7f03a4eea640 1 -- 172.21.15.174:0/1957823433 shutdown_connections 2024-05-08T10:54:28.639 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.641+0000 7f03a4eea640 1 --2- 172.21.15.174:0/1957823433 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03a015dee0 0x7f03a00c3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:28.639 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.641+0000 7f03a4eea640 1 --2- 172.21.15.174:0/1957823433 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f03a00ceac0 0x7f03a0150410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:28.639 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.641+0000 7f03a4eea640 1 --2- 172.21.15.174:0/1957823433 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f03a00ace50 0x7f03a00c7f90 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:28.639 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.641+0000 7f03a4eea640 1 -- 172.21.15.174:0/1957823433 >> 172.21.15.174:0/1957823433 conn(0x7f03a00b1b70 msgr2=0x7f03a006b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:54:28.639 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.641+0000 7f03a4eea640 1 -- 172.21.15.174:0/1957823433 shutdown_connections 2024-05-08T10:54:28.639 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.642+0000 7f03a4eea640 1 -- 172.21.15.174:0/1957823433 wait complete. 2024-05-08T10:54:28.649 DEBUG:teuthology.orchestra.run.smithi174:> sudo ceph --cluster ceph osd new 7be1dcf3-1957-4ec3-bacf-f5f9fff580a2 7 2024-05-08T10:54:28.662 INFO:tasks.ceph.mgr.y.smithi033.stderr:2024-05-08T10:54:28.665+0000 7f908ba15040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-08T10:54:28.683 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-08T10:54:28.686+0000 7fe860991040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-08T10:54:28.749 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.752+0000 7f0842b30640 1 Processor -- start 2024-05-08T10:54:28.749 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.752+0000 7f0842b30640 1 -- start start 2024-05-08T10:54:28.751 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.753+0000 7f0842b30640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f083c15a980 0x7f083c06d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:28.751 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.753+0000 7f0842b30640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f083c06d800 0x7f083c0af6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:28.751 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.753+0000 7f0842b30640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f083c0afbe0 0x7f083c0ce770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:28.751 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.753+0000 7f0842b30640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f083c06ef10 con 0x7f083c15a980 2024-05-08T10:54:28.752 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.753+0000 7f0842b30640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f083c0cdf10 con 0x7f083c0afbe0 2024-05-08T10:54:28.752 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.753+0000 7f0842b30640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f083c06f190 con 0x7f083c06d800 2024-05-08T10:54:28.752 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.753+0000 7f08410cd640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f083c0afbe0 0x7f083c0ce770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:28.752 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.753+0000 7f083bfff640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f083c06d800 0x7f083c0af6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:28.752 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.753+0000 7f08410cd640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f083c0afbe0 0x7f083c0ce770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:35706/0 (socket says 172.21.15.174:35706) 2024-05-08T10:54:28.752 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.753+0000 7f08410cd640 1 -- 172.21.15.174:0/3805863072 learned_addr learned my addr 172.21.15.174:0/3805863072 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-05-08T10:54:28.752 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.753+0000 7f08408cc640 1 --2- 172.21.15.174:0/3805863072 >> v2:172.21.15.33:3300/0 conn(0x7f083c15a980 0x7f083c06d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:28.752 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.753+0000 7f083bfff640 1 -- 172.21.15.174:0/3805863072 >> v2:172.21.15.174:3300/0 conn(0x7f083c0afbe0 msgr2=0x7f083c0ce770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:54:28.752 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.753+0000 7f083bfff640 1 --2- 172.21.15.174:0/3805863072 >> v2:172.21.15.174:3300/0 conn(0x7f083c0afbe0 0x7f083c0ce770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:28.752 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.753+0000 7f083bfff640 1 -- 172.21.15.174:0/3805863072 >> v2:172.21.15.33:3300/0 conn(0x7f083c15a980 msgr2=0x7f083c06d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:54:28.752 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.753+0000 7f083bfff640 1 --2- 172.21.15.174:0/3805863072 >> v2:172.21.15.33:3300/0 conn(0x7f083c15a980 0x7f083c06d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:28.752 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.753+0000 7f083bfff640 1 -- 172.21.15.174:0/3805863072 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f083c15bba0 con 0x7f083c06d800 2024-05-08T10:54:28.752 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.753+0000 7f08410cd640 1 --2- 172.21.15.174:0/3805863072 >> v2:172.21.15.174:3300/0 conn(0x7f083c0afbe0 0x7f083c0ce770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T10:54:28.752 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.753+0000 7f08408cc640 1 --2- 172.21.15.174:0/3805863072 >> v2:172.21.15.33:3300/0 conn(0x7f083c15a980 0x7f083c06d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:54:28.753 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.754+0000 7f083bfff640 1 --2- 172.21.15.174:0/3805863072 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f083c06d800 0x7f083c0af6a0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f083c0b35e0 tx=0x7f082802a080 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc81fde98285b724 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:54:28.753 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.754+0000 7f083b7fe640 1 -- 172.21.15.174:0/3805863072 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0828037070 con 0x7f083c06d800 2024-05-08T10:54:28.753 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.754+0000 7f083b7fe640 1 -- 172.21.15.174:0/3805863072 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f082802add0 con 0x7f083c06d800 2024-05-08T10:54:28.753 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.754+0000 7f083b7fe640 1 -- 172.21.15.174:0/3805863072 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0828032660 con 0x7f083c06d800 2024-05-08T10:54:28.756 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.755+0000 7f0842b30640 1 -- 172.21.15.174:0/3805863072 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f083c06d800 msgr2=0x7f083c0af6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:28.756 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.755+0000 7f0842b30640 1 --2- 172.21.15.174:0/3805863072 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f083c06d800 0x7f083c0af6a0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f083c0b35e0 tx=0x7f082802a080 comp rx=0 tx=0).stop 2024-05-08T10:54:28.756 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.755+0000 7f0842b30640 1 -- 172.21.15.174:0/3805863072 shutdown_connections 2024-05-08T10:54:28.756 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.755+0000 7f0842b30640 1 --2- 172.21.15.174:0/3805863072 >> v2:172.21.15.174:3300/0 conn(0x7f083c0afbe0 0x7f083c0ce770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:28.756 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.755+0000 7f0842b30640 1 --2- 172.21.15.174:0/3805863072 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f083c06d800 0x7f083c0af6a0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:28.756 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.755+0000 7f0842b30640 1 --2- 172.21.15.174:0/3805863072 >> v2:172.21.15.33:3300/0 conn(0x7f083c15a980 0x7f083c06d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:28.756 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.755+0000 7f0842b30640 1 -- 172.21.15.174:0/3805863072 >> 172.21.15.174:0/3805863072 conn(0x7f083c06bcb0 msgr2=0x7f083c06c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:54:28.756 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.755+0000 7f0842b30640 1 -- 172.21.15.174:0/3805863072 shutdown_connections 2024-05-08T10:54:28.756 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.755+0000 7f0842b30640 1 -- 172.21.15.174:0/3805863072 wait complete. 2024-05-08T10:54:28.756 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.756+0000 7f0842b30640 1 Processor -- start 2024-05-08T10:54:28.756 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.756+0000 7f0842b30640 1 -- start start 2024-05-08T10:54:28.756 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.757+0000 7f0842b30640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f083c06d800 0x7f083c0aedb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:28.756 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.757+0000 7f0842b30640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f083c0afbe0 0x7f083c14f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:28.757 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.757+0000 7f0842b30640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f083c15a980 0x7f083c0abc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:28.757 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.757+0000 7f0842b30640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f083c0cecb0 con 0x7f083c06d800 2024-05-08T10:54:28.757 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.757+0000 7f0842b30640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f083c15ad60 con 0x7f083c0afbe0 2024-05-08T10:54:28.757 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.757+0000 7f0842b30640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f083c0cee30 con 0x7f083c15a980 2024-05-08T10:54:28.757 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.757+0000 7f083bfff640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f083c0afbe0 0x7f083c14f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:28.757 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.757+0000 7f08410cd640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f083c15a980 0x7f083c0abc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:28.757 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.757+0000 7f083bfff640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f083c0afbe0 0x7f083c14f1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:35720/0 (socket says 172.21.15.174:35720) 2024-05-08T10:54:28.757 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.757+0000 7f083bfff640 1 -- 172.21.15.174:0/3939368324 learned_addr learned my addr 172.21.15.174:0/3939368324 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-05-08T10:54:28.757 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.757+0000 7f08408cc640 1 --2- 172.21.15.174:0/3939368324 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f083c06d800 0x7f083c0aedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:28.757 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.757+0000 7f08410cd640 1 -- 172.21.15.174:0/3939368324 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f083c0afbe0 msgr2=0x7f083c14f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:28.757 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.757+0000 7f08410cd640 1 --2- 172.21.15.174:0/3939368324 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f083c0afbe0 0x7f083c14f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:28.757 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.757+0000 7f08410cd640 1 -- 172.21.15.174:0/3939368324 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f083c06d800 msgr2=0x7f083c0aedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:28.757 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.757+0000 7f08410cd640 1 --2- 172.21.15.174:0/3939368324 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f083c06d800 0x7f083c0aedb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:28.757 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.757+0000 7f08410cd640 1 -- 172.21.15.174:0/3939368324 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f083c14f720 con 0x7f083c15a980 2024-05-08T10:54:28.758 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.757+0000 7f083bfff640 1 --2- 172.21.15.174:0/3939368324 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f083c0afbe0 0x7f083c14f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T10:54:28.758 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.758+0000 7f08410cd640 1 --2- 172.21.15.174:0/3939368324 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f083c15a980 0x7f083c0abc10 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f0834009e50 tx=0x7f083400c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:54:28.758 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.758+0000 7f08397fa640 1 -- 172.21.15.174:0/3939368324 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f083400cb80 con 0x7f083c15a980 2024-05-08T10:54:28.758 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.758+0000 7f08397fa640 1 -- 172.21.15.174:0/3939368324 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f083400cd40 con 0x7f083c15a980 2024-05-08T10:54:28.758 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.758+0000 7f08397fa640 1 -- 172.21.15.174:0/3939368324 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0834003bd0 con 0x7f083c15a980 2024-05-08T10:54:28.758 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.758+0000 7f0842b30640 1 -- 172.21.15.174:0/3939368324 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f083c1f2f90 con 0x7f083c15a980 2024-05-08T10:54:28.758 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.758+0000 7f0842b30640 1 -- 172.21.15.174:0/3939368324 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f083c1f3550 con 0x7f083c15a980 2024-05-08T10:54:28.758 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.758+0000 7f08397fa640 1 -- 172.21.15.174:0/3939368324 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f083401b030 con 0x7f083c15a980 2024-05-08T10:54:28.758 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.758+0000 7f08397fa640 1 -- 172.21.15.174:0/3939368324 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f083401dd40 con 0x7f083c15a980 2024-05-08T10:54:28.758 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.759+0000 7f0842b30640 1 -- 172.21.15.174:0/3939368324 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f083c0cca70 con 0x7f083c15a980 2024-05-08T10:54:28.758 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.761+0000 7f08397fa640 1 -- 172.21.15.174:0/3939368324 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f083c0cca70 con 0x7f083c15a980 2024-05-08T10:54:28.829 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.832+0000 7f0842b30640 1 -- 172.21.15.174:0/3939368324 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd new", "uuid": "7be1dcf3-1957-4ec3-bacf-f5f9fff580a2", "id": 7} v 0) v1 -- 0x7f083c069d20 con 0x7f083c15a980 2024-05-08T10:54:28.836 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.839+0000 7f08397fa640 1 -- 172.21.15.174:0/3939368324 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7be1dcf3-1957-4ec3-bacf-f5f9fff580a2", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0834022020 con 0x7f083c15a980 2024-05-08T10:54:28.836 INFO:teuthology.orchestra.run.smithi174.stdout:7 2024-05-08T10:54:28.838 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.840+0000 7f0842b30640 1 -- 172.21.15.174:0/3939368324 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f083c15a980 msgr2=0x7f083c0abc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:28.838 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.840+0000 7f0842b30640 1 --2- 172.21.15.174:0/3939368324 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f083c15a980 0x7f083c0abc10 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f0834009e50 tx=0x7f083400c490 comp rx=0 tx=0).stop 2024-05-08T10:54:28.838 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.840+0000 7f0842b30640 1 -- 172.21.15.174:0/3939368324 shutdown_connections 2024-05-08T10:54:28.838 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.840+0000 7f0842b30640 1 --2- 172.21.15.174:0/3939368324 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f083c15a980 0x7f083c0abc10 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:28.838 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.840+0000 7f0842b30640 1 --2- 172.21.15.174:0/3939368324 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f083c0afbe0 0x7f083c14f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:28.838 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.840+0000 7f0842b30640 1 --2- 172.21.15.174:0/3939368324 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f083c06d800 0x7f083c0aedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:28.838 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.840+0000 7f0842b30640 1 -- 172.21.15.174:0/3939368324 >> 172.21.15.174:0/3939368324 conn(0x7f083c06bcb0 msgr2=0x7f083c0b0e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:54:28.838 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.840+0000 7f0842b30640 1 -- 172.21.15.174:0/3939368324 shutdown_connections 2024-05-08T10:54:28.838 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:54:28.840+0000 7f0842b30640 1 -- 172.21.15.174:0/3939368324 wait complete. 2024-05-08T10:54:28.848 INFO:tasks.ceph.osd.0:Restarting daemon 2024-05-08T10:54:28.848 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-05-08T10:54:28.850 INFO:tasks.ceph.osd.0:Started 2024-05-08T10:54:28.851 INFO:tasks.ceph.osd.1:Restarting daemon 2024-05-08T10:54:28.851 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-05-08T10:54:28.853 INFO:tasks.ceph.osd.1:Started 2024-05-08T10:54:28.853 INFO:tasks.ceph.osd.2:Restarting daemon 2024-05-08T10:54:28.853 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-05-08T10:54:28.855 INFO:tasks.ceph.osd.2:Started 2024-05-08T10:54:28.855 INFO:tasks.ceph.osd.3:Restarting daemon 2024-05-08T10:54:28.855 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-05-08T10:54:28.859 INFO:tasks.ceph.osd.3:Started 2024-05-08T10:54:28.859 INFO:tasks.ceph.osd.4:Restarting daemon 2024-05-08T10:54:28.859 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-05-08T10:54:28.890 INFO:tasks.ceph.osd.4:Started 2024-05-08T10:54:28.890 INFO:tasks.ceph.osd.5:Restarting daemon 2024-05-08T10:54:28.891 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-05-08T10:54:28.892 INFO:tasks.ceph.osd.5:Started 2024-05-08T10:54:28.893 INFO:tasks.ceph.osd.6:Restarting daemon 2024-05-08T10:54:28.893 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-05-08T10:54:28.895 INFO:tasks.ceph.osd.6:Started 2024-05-08T10:54:28.895 INFO:tasks.ceph.osd.7:Restarting daemon 2024-05-08T10:54:28.895 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-05-08T10:54:28.897 INFO:tasks.ceph.osd.7:Started 2024-05-08T10:54:28.897 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T10:54:29.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:29.021+0000 7f414f89a640 1 Processor -- start 2024-05-08T10:54:29.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:29.021+0000 7f414f89a640 1 -- start start 2024-05-08T10:54:29.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:29.022+0000 7f414f89a640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f41480714d0 0x7f41480b4520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:29.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:29.022+0000 7f414f89a640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f41480718b0 0x7f414806e590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:29.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:29.022+0000 7f414f89a640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f414806ead0 0x7f414815c040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:29.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:29.022+0000 7f414f89a640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41480b37f0 con 0x7f414806ead0 2024-05-08T10:54:29.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:29.022+0000 7f414f89a640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f414815bde0 con 0x7f41480714d0 2024-05-08T10:54:29.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:29.022+0000 7f414f89a640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f414806f100 con 0x7f41480718b0 2024-05-08T10:54:29.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:29.022+0000 7f414de37640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f414806ead0 0x7f414815c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:29.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:29.022+0000 7f414de37640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f414806ead0 0x7f414815c040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60428/0 (socket says 172.21.15.33:60428) 2024-05-08T10:54:29.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:29.022+0000 7f414d636640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f41480714d0 0x7f41480b4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:29.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:29.022+0000 7f414ce35640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f41480718b0 0x7f414806e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:29.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:29.023+0000 7f414de37640 1 -- 172.21.15.33:0/3838610507 learned_addr learned my addr 172.21.15.33:0/3838610507 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:54:29.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:29.023+0000 7f414de37640 1 -- 172.21.15.33:0/3838610507 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f41480718b0 msgr2=0x7f414806e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:54:29.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:29.023+0000 7f414de37640 1 --2- 172.21.15.33:0/3838610507 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f41480718b0 0x7f414806e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:29.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:29.023+0000 7f414de37640 1 -- 172.21.15.33:0/3838610507 >> v2:172.21.15.174:3300/0 conn(0x7f41480714d0 msgr2=0x7f41480b4520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:54:29.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:29.023+0000 7f414de37640 1 --2- 172.21.15.33:0/3838610507 >> v2:172.21.15.174:3300/0 conn(0x7f41480714d0 0x7f41480b4520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:29.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:29.023+0000 7f414de37640 1 -- 172.21.15.33:0/3838610507 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41480b3a40 con 0x7f414806ead0 2024-05-08T10:54:29.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:29.023+0000 7f414ce35640 1 --2- 172.21.15.33:0/3838610507 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f41480718b0 0x7f414806e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T10:54:29.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:29.023+0000 7f414d636640 1 --2- 172.21.15.33:0/3838610507 >> v2:172.21.15.174:3300/0 conn(0x7f41480714d0 0x7f41480b4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T10:54:29.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:29.024+0000 7f414de37640 1 --2- 172.21.15.33:0/3838610507 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f414806ead0 0x7f414815c040 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4148071100 tx=0x7f414002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=478957bcf59a639c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:54:29.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:29.024+0000 7f4147fff640 1 -- 172.21.15.33:0/3838610507 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4140037070 con 0x7f414806ead0 2024-05-08T10:54:29.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:29.024+0000 7f4147fff640 1 -- 172.21.15.33:0/3838610507 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4140032440 con 0x7f414806ead0 2024-05-08T10:54:29.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:29.024+0000 7f4147fff640 1 -- 172.21.15.33:0/3838610507 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4140032810 con 0x7f414806ead0 2024-05-08T10:54:29.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:29.024+0000 7f414f89a640 1 -- 172.21.15.33:0/3838610507 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f414806ead0 msgr2=0x7f414815c040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:29.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:29.024+0000 7f414f89a640 1 --2- 172.21.15.33:0/3838610507 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f414806ead0 0x7f414815c040 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4148071100 tx=0x7f414002a140 comp rx=0 tx=0).stop 2024-05-08T10:54:29.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:29.024+0000 7f414f89a640 1 -- 172.21.15.33:0/3838610507 shutdown_connections 2024-05-08T10:54:29.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:29.024+0000 7f414f89a640 1 --2- 172.21.15.33:0/3838610507 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f414806ead0 0x7f414815c040 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:29.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:29.025+0000 7f414f89a640 1 --2- 172.21.15.33:0/3838610507 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f41480718b0 0x7f414806e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:29.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:29.025+0000 7f414f89a640 1 --2- 172.21.15.33:0/3838610507 >> v2:172.21.15.174:3300/0 conn(0x7f41480714d0 0x7f41480b4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:29.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:29.025+0000 7f414f89a640 1 -- 172.21.15.33:0/3838610507 >> 172.21.15.33:0/3838610507 conn(0x7f41480b24f0 msgr2=0x7f41480b2900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:54:29.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:29.025+0000 7f414f89a640 1 -- 172.21.15.33:0/3838610507 shutdown_connections 2024-05-08T10:54:29.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:29.025+0000 7f414f89a640 1 -- 172.21.15.33:0/3838610507 wait complete. 2024-05-08T10:54:29.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:29.026+0000 7f414f89a640 1 Processor -- start 2024-05-08T10:54:29.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:29.026+0000 7f414f89a640 1 -- start start 2024-05-08T10:54:29.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:29.027+0000 7f414f89a640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f414806ead0 0x7f41481f1970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:29.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:29.027+0000 7f414f89a640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f41480714d0 0x7f41480ac590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:29.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:29.027+0000 7f414f89a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41480718b0 0x7f41480cbc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:29.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:29.027+0000 7f414f89a640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4148071d10 con 0x7f41480718b0 2024-05-08T10:54:29.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:29.027+0000 7f414f89a640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41480b4000 con 0x7f41480714d0 2024-05-08T10:54:29.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:29.027+0000 7f414f89a640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41480b0110 con 0x7f414806ead0 2024-05-08T10:54:29.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:29.027+0000 7f414d636640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f414806ead0 0x7f41481f1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:29.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:29.027+0000 7f414de37640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41480718b0 0x7f41480cbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:29.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:29.027+0000 7f414d636640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f414806ead0 0x7f41481f1970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.33:43374/0 (socket says 172.21.15.33:43374) 2024-05-08T10:54:29.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:29.027+0000 7f414d636640 1 -- 172.21.15.33:0/2843714382 learned_addr learned my addr 172.21.15.33:0/2843714382 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:54:29.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:29.027+0000 7f414ce35640 1 --2- 172.21.15.33:0/2843714382 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f41480714d0 0x7f41480ac590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:29.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:29.027+0000 7f414de37640 1 -- 172.21.15.33:0/2843714382 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f414806ead0 msgr2=0x7f41481f1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:29.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:29.027+0000 7f414de37640 1 --2- 172.21.15.33:0/2843714382 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f414806ead0 0x7f41481f1970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:29.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:29.027+0000 7f414de37640 1 -- 172.21.15.33:0/2843714382 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f41480714d0 msgr2=0x7f41480ac590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:29.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:29.027+0000 7f414de37640 1 --2- 172.21.15.33:0/2843714382 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f41480714d0 0x7f41480ac590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:29.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:29.027+0000 7f414de37640 1 -- 172.21.15.33:0/2843714382 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41480a9d20 con 0x7f41480718b0 2024-05-08T10:54:29.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:29.027+0000 7f414d636640 1 --2- 172.21.15.33:0/2843714382 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f414806ead0 0x7f41481f1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T10:54:29.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:29.027+0000 7f414de37640 1 --2- 172.21.15.33:0/2843714382 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41480718b0 0x7f41480cbc10 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f4140031000 tx=0x7f41400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:54:29.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:29.028+0000 7f4145ffb640 1 -- 172.21.15.33:0/2843714382 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4140037040 con 0x7f41480718b0 2024-05-08T10:54:29.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:29.028+0000 7f4145ffb640 1 -- 172.21.15.33:0/2843714382 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4140042070 con 0x7f41480718b0 2024-05-08T10:54:29.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:29.028+0000 7f414f89a640 1 -- 172.21.15.33:0/2843714382 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41480a9fc0 con 0x7f41480718b0 2024-05-08T10:54:29.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:29.028+0000 7f4145ffb640 1 -- 172.21.15.33:0/2843714382 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f414003b890 con 0x7f41480718b0 2024-05-08T10:54:29.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:29.028+0000 7f414f89a640 1 -- 172.21.15.33:0/2843714382 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41480aa580 con 0x7f41480718b0 2024-05-08T10:54:29.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:29.028+0000 7f4145ffb640 1 -- 172.21.15.33:0/2843714382 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f414003ba30 con 0x7f41480718b0 2024-05-08T10:54:29.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:29.028+0000 7f4145ffb640 1 -- 172.21.15.33:0/2843714382 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f4140047b20 con 0x7f41480718b0 2024-05-08T10:54:29.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:29.029+0000 7f414f89a640 1 -- 172.21.15.33:0/2843714382 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4148069d20 con 0x7f41480718b0 2024-05-08T10:54:29.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:29.031+0000 7f4145ffb640 1 -- 172.21.15.33:0/2843714382 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f4140047460 con 0x7f41480718b0 2024-05-08T10:54:29.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:29.094+0000 7f414f89a640 1 -- 172.21.15.33:0/2843714382 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f41480d05b0 con 0x7f41480718b0 2024-05-08T10:54:29.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:29.094+0000 7f4145ffb640 1 -- 172.21.15.33:0/2843714382 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7f4140047640 con 0x7f41480718b0 2024-05-08T10:54:29.091 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:54:29.092 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":10,"fsid":"963217b2-c375-4f5a-95cf-88e199dd38ff","created":"2024-05-08T10:54:26.711528+0000","modified":"2024-05-08T10:54:28.834106+0000","last_up_change":"0.000000","last_in_change":"2024-05-08T10:54:28.834106+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c5da4fb5-d4f2-4982-a804-2aa92fe77731","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f8fdd8db-c2a3-4d28-81f3-b30f44bea7c7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"87d465f3-b40f-48dd-bae2-4c67904d4828","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"79450edf-9637-4181-9372-e1cd5e91e73e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"bd0debfa-e559-4b1e-920d-6b2639c7085e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"ff0f51c0-672b-448f-9de1-b9305ce8c00d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"93061f6c-c0ce-47e9-88a0-1151c5ccb4e0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"7be1dcf3-1957-4ec3-bacf-f5f9fff580a2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T10:54:29.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:29.095+0000 7f414f89a640 1 -- 172.21.15.33:0/2843714382 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41480718b0 msgr2=0x7f41480cbc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:29.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:29.095+0000 7f414f89a640 1 --2- 172.21.15.33:0/2843714382 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41480718b0 0x7f41480cbc10 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f4140031000 tx=0x7f41400046c0 comp rx=0 tx=0).stop 2024-05-08T10:54:29.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:29.095+0000 7f414f89a640 1 -- 172.21.15.33:0/2843714382 shutdown_connections 2024-05-08T10:54:29.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:29.095+0000 7f414f89a640 1 --2- 172.21.15.33:0/2843714382 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41480718b0 0x7f41480cbc10 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:29.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:29.095+0000 7f414f89a640 1 --2- 172.21.15.33:0/2843714382 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f41480714d0 0x7f41480ac590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:29.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:29.095+0000 7f414f89a640 1 --2- 172.21.15.33:0/2843714382 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f414806ead0 0x7f41481f1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:29.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:29.095+0000 7f414f89a640 1 -- 172.21.15.33:0/2843714382 >> 172.21.15.33:0/2843714382 conn(0x7f41480b24f0 msgr2=0x7f41480b4370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:54:29.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:29.095+0000 7f414f89a640 1 -- 172.21.15.33:0/2843714382 shutdown_connections 2024-05-08T10:54:29.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:29.095+0000 7f414f89a640 1 -- 172.21.15.33:0/2843714382 wait complete. 2024-05-08T10:54:29.099 INFO:tasks.ceph.mgr.y.smithi033.stderr:2024-05-08T10:54:29.102+0000 7f908ba15040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-08T10:54:29.099 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-08T10:54:29.102+0000 7fe860991040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-08T10:54:29.103 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-05-08T10:54:29.103 INFO:tasks.ceph:Waiting for OSDs to come up 2024-05-08T10:54:29.359 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-08T10:54:29.361+0000 7fe860991040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-08T10:54:29.368 INFO:tasks.ceph.mgr.y.smithi033.stderr:2024-05-08T10:54:29.372+0000 7f908ba15040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-08T10:54:29.411 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-08T10:54:29.414+0000 7fe860991040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-08T10:54:29.423 INFO:tasks.ceph.mgr.y.smithi033.stderr:2024-05-08T10:54:29.426+0000 7f908ba15040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-08T10:54:29.472 INFO:tasks.ceph.osd.2.smithi033.stderr:2024-05-08T10:54:29.475+0000 7f7d1d030640 -1 Falling back to public interface 2024-05-08T10:54:29.473 INFO:tasks.ceph.osd.3.smithi033.stderr:2024-05-08T10:54:29.475+0000 7f0c87a10640 -1 Falling back to public interface 2024-05-08T10:54:29.473 INFO:tasks.ceph.osd.3.smithi033.stderr:2024-05-08T10:54:29.476+0000 7f0c8646a640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6801/0: (98) Address already in use 2024-05-08T10:54:29.474 INFO:tasks.ceph.osd.2.smithi033.stderr:2024-05-08T10:54:29.477+0000 7f7d1b591640 -1 PosixStack listen unable to listen on v1:0.0.0.0:6812/0: (98) Address already in use 2024-05-08T10:54:29.476 INFO:tasks.ceph.osd.0.smithi033.stderr:2024-05-08T10:54:29.479+0000 7f0cd1a13640 -1 Falling back to public interface 2024-05-08T10:54:29.479 INFO:tasks.ceph.osd.1.smithi033.stderr:2024-05-08T10:54:29.482+0000 7fb26ac12640 -1 Falling back to public interface 2024-05-08T10:54:29.490 INFO:tasks.ceph.osd.4.smithi174.stderr:2024-05-08T10:54:29.493+0000 7f09e900c640 -1 Falling back to public interface 2024-05-08T10:54:29.495 INFO:tasks.ceph.osd.7.smithi174.stderr:2024-05-08T10:54:29.498+0000 7ffbdae14640 -1 Falling back to public interface 2024-05-08T10:54:29.512 INFO:tasks.ceph.osd.6.smithi174.stderr:2024-05-08T10:54:29.515+0000 7f5baaf57640 -1 Falling back to public interface 2024-05-08T10:54:29.523 INFO:tasks.ceph.osd.5.smithi174.stderr:2024-05-08T10:54:29.526+0000 7f5cc49cb640 -1 Falling back to public interface 2024-05-08T10:54:29.529 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-08T10:54:29.532+0000 7fe860991040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-08T10:54:29.548 INFO:tasks.ceph.mgr.y.smithi033.stderr:2024-05-08T10:54:29.552+0000 7f908ba15040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-08T10:54:29.825 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-08T10:54:29.828+0000 7fe860991040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-08T10:54:29.858 INFO:tasks.ceph.mgr.y.smithi033.stderr:2024-05-08T10:54:29.861+0000 7f908ba15040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-08T10:54:29.873 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-08T10:54:29.876+0000 7fe860991040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-08T10:54:29.908 INFO:tasks.ceph.mgr.y.smithi033.stderr:2024-05-08T10:54:29.911+0000 7f908ba15040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-08T10:54:29.909 DEBUG:teuthology.orchestra.run.smithi033:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-08T10:54:30.004 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:30.007+0000 7fb5c4a9a640 1 Processor -- start 2024-05-08T10:54:30.004 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:30.007+0000 7fb5c4a9a640 1 -- start start 2024-05-08T10:54:30.006 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:30.008+0000 7fb5c4a9a640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fb5c015bd40 0x7fb5c00ce770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:30.006 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:30.008+0000 7fb5c4a9a640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb5c00cf180 0x7fb5c0071c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:30.007 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:30.008+0000 7fb5c4a9a640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5c00cf800 con 0x7fb5c0072180 2024-05-08T10:54:30.007 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:30.008+0000 7fb5c4a9a640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5c00cefa0 con 0x7fb5c015bd40 2024-05-08T10:54:30.007 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:30.008+0000 7fb5c4a9a640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c00cfae0 con 0x7fb5c00cf180 2024-05-08T10:54:30.007 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:30.008+0000 7fb5be59c640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fb5c015bd40 0x7fb5c00ce770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:30.007 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:30.008+0000 7fb5be59c640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fb5c015bd40 0x7fb5c00ce770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60450/0 (socket says 172.21.15.33:60450) 2024-05-08T10:54:30.007 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:30.008+0000 7fb5be59c640 1 -- 172.21.15.33:0/934813966 learned_addr learned my addr 172.21.15.33:0/934813966 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:54:30.007 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:30.008+0000 7fb5bed9d640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fb5c0072180 0x7fb5c015f8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:35312/0 (socket says 172.21.15.33:35312) 2024-05-08T10:54:30.007 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:30.008+0000 7fb5bdd9b640 1 --2- 172.21.15.33:0/934813966 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb5c00cf180 0x7fb5c0071c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:30.007 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:30.008+0000 7fb5be59c640 1 -- 172.21.15.33:0/934813966 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb5c00cf180 msgr2=0x7fb5c0071c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:54:30.007 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:30.008+0000 7fb5be59c640 1 --2- 172.21.15.33:0/934813966 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb5c00cf180 0x7fb5c0071c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:30.007 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:30.008+0000 7fb5be59c640 1 -- 172.21.15.33:0/934813966 >> v1:172.21.15.33:6789/0 conn(0x7fb5c0072180 legacy=0x7fb5c015f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:30.007 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:30.008+0000 7fb5be59c640 1 -- 172.21.15.33:0/934813966 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5c00cfdc0 con 0x7fb5c015bd40 2024-05-08T10:54:30.008 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:30.008+0000 7fb5bd59a640 1 -- 172.21.15.33:0/934813966 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 73156073 0 0) 0x7fb5c00cf800 con 0x7fb5c0072180 2024-05-08T10:54:30.008 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:30.008+0000 7fb5bdd9b640 1 --2- 172.21.15.33:0/934813966 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb5c00cf180 0x7fb5c0071c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:54:30.008 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:30.009+0000 7fb5be59c640 1 --2- 172.21.15.33:0/934813966 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5c015bd40 0x7fb5c00ce770 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb5b0009870 tx=0x7fb5b002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9aa838c8c9b1af49 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:54:30.008 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:30.009+0000 7fb5bd59a640 1 -- 172.21.15.33:0/934813966 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5b0037070 con 0x7fb5c015bd40 2024-05-08T10:54:30.008 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:30.009+0000 7fb5bd59a640 1 -- 172.21.15.33:0/934813966 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5b0032440 con 0x7fb5c015bd40 2024-05-08T10:54:30.008 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:30.009+0000 7fb5bd59a640 1 -- 172.21.15.33:0/934813966 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5b0032810 con 0x7fb5c015bd40 2024-05-08T10:54:30.011 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:30.010+0000 7fb5c4a9a640 1 -- 172.21.15.33:0/934813966 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5c015bd40 msgr2=0x7fb5c00ce770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:30.011 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:30.010+0000 7fb5c4a9a640 1 --2- 172.21.15.33:0/934813966 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5c015bd40 0x7fb5c00ce770 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb5b0009870 tx=0x7fb5b002a1c0 comp rx=0 tx=0).stop 2024-05-08T10:54:30.011 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:30.010+0000 7fb5c4a9a640 1 -- 172.21.15.33:0/934813966 shutdown_connections 2024-05-08T10:54:30.011 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:30.010+0000 7fb5c4a9a640 1 --2- 172.21.15.33:0/934813966 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb5c00cf180 0x7fb5c0071c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:30.011 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:30.010+0000 7fb5c4a9a640 1 --2- 172.21.15.33:0/934813966 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5c015bd40 0x7fb5c00ce770 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:30.012 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:30.010+0000 7fb5c4a9a640 1 -- 172.21.15.33:0/934813966 >> 172.21.15.33:0/934813966 conn(0x7fb5c00b25a0 msgr2=0x7fb5c00b2980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:54:30.012 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:30.010+0000 7fb5c4a9a640 1 -- 172.21.15.33:0/934813966 shutdown_connections 2024-05-08T10:54:30.012 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:30.010+0000 7fb5c4a9a640 1 -- 172.21.15.33:0/934813966 wait complete. 2024-05-08T10:54:30.012 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:30.011+0000 7fb5c4a9a640 1 Processor -- start 2024-05-08T10:54:30.012 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:30.012+0000 7fb5c4a9a640 1 -- start start 2024-05-08T10:54:30.012 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:30.012+0000 7fb5c4a9a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5c0072180 0x7fb5c01f1550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:30.012 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:30.012+0000 7fb5c4a9a640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb5c00cf180 0x7fb5c0148230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:30.012 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:30.012+0000 7fb5c4a9a640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb5c015bd40 0x7fb5c01e4550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:30.012 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:30.012+0000 7fb5c4a9a640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c015c120 con 0x7fb5c0072180 2024-05-08T10:54:30.012 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:30.012+0000 7fb5c4a9a640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c00cecb0 con 0x7fb5c015bd40 2024-05-08T10:54:30.012 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:30.012+0000 7fb5c4a9a640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c015c2a0 con 0x7fb5c00cf180 2024-05-08T10:54:30.012 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:30.012+0000 7fb5be59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5c0072180 0x7fb5c01f1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:30.012 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:30.012+0000 7fb5be59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5c0072180 0x7fb5c01f1550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60458/0 (socket says 172.21.15.33:60458) 2024-05-08T10:54:30.012 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:30.012+0000 7fb5be59c640 1 -- 172.21.15.33:0/2992244300 learned_addr learned my addr 172.21.15.33:0/2992244300 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:54:30.013 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:30.012+0000 7fb5bdd9b640 1 --2- 172.21.15.33:0/2992244300 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb5c00cf180 0x7fb5c0148230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:30.013 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:30.013+0000 7fb5bed9d640 1 --2- 172.21.15.33:0/2992244300 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb5c015bd40 0x7fb5c01e4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:30.013 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:30.013+0000 7fb5be59c640 1 -- 172.21.15.33:0/2992244300 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb5c00cf180 msgr2=0x7fb5c0148230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:30.013 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:30.013+0000 7fb5be59c640 1 --2- 172.21.15.33:0/2992244300 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb5c00cf180 0x7fb5c0148230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:30.013 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:30.013+0000 7fb5be59c640 1 -- 172.21.15.33:0/2992244300 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb5c015bd40 msgr2=0x7fb5c01e4550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:30.013 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:30.013+0000 7fb5be59c640 1 --2- 172.21.15.33:0/2992244300 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb5c015bd40 0x7fb5c01e4550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:30.013 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:30.013+0000 7fb5be59c640 1 -- 172.21.15.33:0/2992244300 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5c00a9770 con 0x7fb5c0072180 2024-05-08T10:54:30.013 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:30.013+0000 7fb5be59c640 1 --2- 172.21.15.33:0/2992244300 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5c0072180 0x7fb5c01f1550 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb5b0000c00 tx=0x7fb5b00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:54:30.013 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:30.013+0000 7fb5aeffd640 1 -- 172.21.15.33:0/2992244300 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5b0041070 con 0x7fb5c0072180 2024-05-08T10:54:30.013 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:30.013+0000 7fb5aeffd640 1 -- 172.21.15.33:0/2992244300 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5b003c890 con 0x7fb5c0072180 2024-05-08T10:54:30.013 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:30.013+0000 7fb5c4a9a640 1 -- 172.21.15.33:0/2992244300 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5c0147190 con 0x7fb5c0072180 2024-05-08T10:54:30.013 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:30.013+0000 7fb5aeffd640 1 -- 172.21.15.33:0/2992244300 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5b0037040 con 0x7fb5c0072180 2024-05-08T10:54:30.013 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:30.013+0000 7fb5c4a9a640 1 -- 172.21.15.33:0/2992244300 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5c0147750 con 0x7fb5c0072180 2024-05-08T10:54:30.013 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:30.013+0000 7fb5aeffd640 1 -- 172.21.15.33:0/2992244300 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fb5b0044070 con 0x7fb5c0072180 2024-05-08T10:54:30.013 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:30.013+0000 7fb5aeffd640 1 -- 172.21.15.33:0/2992244300 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fb5b003dac0 con 0x7fb5c0072180 2024-05-08T10:54:30.014 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:30.015+0000 7fb5c4a9a640 1 -- 172.21.15.33:0/2992244300 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5c004f0a0 con 0x7fb5c0072180 2024-05-08T10:54:30.014 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:30.017+0000 7fb5aeffd640 1 -- 172.21.15.33:0/2992244300 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fb5b003dd60 con 0x7fb5c0072180 2024-05-08T10:54:30.030 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-08T10:54:30.033+0000 7fe860991040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-08T10:54:30.077 INFO:tasks.ceph.mgr.y.smithi033.stderr:2024-05-08T10:54:30.079+0000 7f908ba15040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-08T10:54:30.077 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:30.079+0000 7fb5c4a9a640 1 -- 172.21.15.33:0/2992244300 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb5c006b9f0 con 0x7fb5c0072180 2024-05-08T10:54:30.077 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:30.080+0000 7fb5aeffd640 1 -- 172.21.15.33:0/2992244300 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7fb5b003cc80 con 0x7fb5c0072180 2024-05-08T10:54:30.078 INFO:teuthology.misc.health.smithi033.stdout: 2024-05-08T10:54:30.078 INFO:teuthology.misc.health.smithi033.stdout:{"epoch":10,"fsid":"963217b2-c375-4f5a-95cf-88e199dd38ff","created":"2024-05-08T10:54:26.711528+0000","modified":"2024-05-08T10:54:28.834106+0000","last_up_change":"0.000000","last_in_change":"2024-05-08T10:54:28.834106+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c5da4fb5-d4f2-4982-a804-2aa92fe77731","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f8fdd8db-c2a3-4d28-81f3-b30f44bea7c7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"87d465f3-b40f-48dd-bae2-4c67904d4828","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"79450edf-9637-4181-9372-e1cd5e91e73e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"bd0debfa-e559-4b1e-920d-6b2639c7085e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"ff0f51c0-672b-448f-9de1-b9305ce8c00d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"93061f6c-c0ce-47e9-88a0-1151c5ccb4e0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"7be1dcf3-1957-4ec3-bacf-f5f9fff580a2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T10:54:30.079 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:30.081+0000 7fb5c4a9a640 1 -- 172.21.15.33:0/2992244300 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5c0072180 msgr2=0x7fb5c01f1550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:30.079 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:30.081+0000 7fb5c4a9a640 1 --2- 172.21.15.33:0/2992244300 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5c0072180 0x7fb5c01f1550 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb5b0000c00 tx=0x7fb5b00046c0 comp rx=0 tx=0).stop 2024-05-08T10:54:30.079 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:30.081+0000 7fb5c4a9a640 1 -- 172.21.15.33:0/2992244300 shutdown_connections 2024-05-08T10:54:30.079 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:30.081+0000 7fb5c4a9a640 1 --2- 172.21.15.33:0/2992244300 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb5c015bd40 0x7fb5c01e4550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:30.080 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:30.081+0000 7fb5c4a9a640 1 --2- 172.21.15.33:0/2992244300 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb5c00cf180 0x7fb5c0148230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:30.081 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:30.081+0000 7fb5c4a9a640 1 --2- 172.21.15.33:0/2992244300 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5c0072180 0x7fb5c01f1550 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:30.082 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:30.081+0000 7fb5c4a9a640 1 -- 172.21.15.33:0/2992244300 >> 172.21.15.33:0/2992244300 conn(0x7fb5c00b25a0 msgr2=0x7fb5c00b1c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:54:30.082 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:30.081+0000 7fb5c4a9a640 1 -- 172.21.15.33:0/2992244300 shutdown_connections 2024-05-08T10:54:30.082 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:30.082+0000 7fb5c4a9a640 1 -- 172.21.15.33:0/2992244300 wait complete. 2024-05-08T10:54:30.091 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-05-08T10:54:30.166 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-08T10:54:30.169+0000 7fe860991040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-08T10:54:30.216 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-08T10:54:30.219+0000 7fe860991040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-08T10:54:30.226 INFO:tasks.ceph.mgr.y.smithi033.stderr:2024-05-08T10:54:30.229+0000 7f908ba15040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-08T10:54:30.279 INFO:tasks.ceph.mgr.y.smithi033.stderr:2024-05-08T10:54:30.281+0000 7f908ba15040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-08T10:54:30.285 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-08T10:54:30.288+0000 7fe860991040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-08T10:54:30.332 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-08T10:54:30.335+0000 7fe860991040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-08T10:54:30.353 INFO:tasks.ceph.mgr.y.smithi033.stderr:2024-05-08T10:54:30.355+0000 7f908ba15040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-08T10:54:30.400 INFO:tasks.ceph.mgr.y.smithi033.stderr:2024-05-08T10:54:30.403+0000 7f908ba15040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-08T10:54:30.811 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-08T10:54:30.814+0000 7fe860991040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-08T10:54:30.902 INFO:tasks.ceph.mgr.y.smithi033.stderr:2024-05-08T10:54:30.904+0000 7f908ba15040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-08T10:54:30.928 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-08T10:54:30.931+0000 7fe860991040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-08T10:54:31.025 INFO:tasks.ceph.mgr.y.smithi033.stderr:2024-05-08T10:54:31.028+0000 7f908ba15040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-08T10:54:31.947 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-08T10:54:31.949+0000 7fe801e10640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-05-08T10:54:31.947 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-08T10:54:31.950+0000 7fe801e10640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-05-08T10:54:32.944 INFO:tasks.ceph.osd.3.smithi033.stderr:2024-05-08T10:54:32.947+0000 7f0c87a10640 -1 osd.3 0 log_to_monitors true 2024-05-08T10:54:32.961 INFO:tasks.ceph.osd.4.smithi174.stderr:2024-05-08T10:54:32.964+0000 7f09e900c640 -1 osd.4 0 log_to_monitors true 2024-05-08T10:54:32.994 INFO:tasks.ceph.osd.1.smithi033.stderr:2024-05-08T10:54:32.997+0000 7fb26ac12640 -1 osd.1 0 log_to_monitors true 2024-05-08T10:54:33.089 INFO:tasks.ceph.osd.6.smithi174.stderr:2024-05-08T10:54:33.007+0000 7f5baaf57640 -1 osd.6 0 log_to_monitors true 2024-05-08T10:54:33.089 INFO:tasks.ceph.osd.2.smithi033.stderr:2024-05-08T10:54:32.998+0000 7f7d1d030640 -1 osd.2 0 log_to_monitors true 2024-05-08T10:54:33.089 INFO:tasks.ceph.osd.7.smithi174.stderr:2024-05-08T10:54:33.017+0000 7ffbdae14640 -1 osd.7 0 log_to_monitors true 2024-05-08T10:54:33.089 INFO:tasks.ceph.osd.0.smithi033.stderr:2024-05-08T10:54:33.003+0000 7f0cd1a13640 -1 osd.0 0 log_to_monitors true 2024-05-08T10:54:33.090 INFO:tasks.ceph.osd.5.smithi174.stderr:2024-05-08T10:54:33.049+0000 7f5cc49cb640 -1 osd.5 0 log_to_monitors true 2024-05-08T10:54:36.898 DEBUG:teuthology.orchestra.run.smithi033:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-08T10:54:36.981 INFO:tasks.ceph.osd.2.smithi033.stderr:2024-05-08T10:54:36.983+0000 7f7d17d55640 -1 osd.2 0 waiting for initial osdmap 2024-05-08T10:54:36.999 INFO:tasks.ceph.osd.2.smithi033.stderr:2024-05-08T10:54:37.002+0000 7f7d10387640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T10:54:37.039 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:37.042+0000 7fbbdef69640 1 Processor -- start 2024-05-08T10:54:37.040 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:37.042+0000 7fbbdef69640 1 -- start start 2024-05-08T10:54:37.042 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:37.043+0000 7fbbdef69640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fbbd815aa90 0x7fbbd8070c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:37.043 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:37.043+0000 7fbbdef69640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbd80b3110 con 0x7fbbd8071300 2024-05-08T10:54:37.043 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:37.043+0000 7fbbdef69640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbd80b33f0 con 0x7fbbd8071fe0 2024-05-08T10:54:37.043 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:37.043+0000 7fbbdef69640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbd80b3a40 con 0x7fbbd815aa90 2024-05-08T10:54:37.043 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:37.043+0000 7fbbd7fff640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fbbd8071300 0x7fbbd80718d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:37152/0 (socket says 172.21.15.33:37152) 2024-05-08T10:54:37.043 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:37.044+0000 7fbbd7fff640 1 -- 172.21.15.33:0/2710228 learned_addr learned my addr 172.21.15.33:0/2710228 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-05-08T10:54:37.043 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:37.044+0000 7fbbdcd05640 1 --2- 172.21.15.33:0/2710228 >> v2:172.21.15.174:3300/0 conn(0x7fbbd815aa90 0x7fbbd8070c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:37.043 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:37.044+0000 7fbbd77fe640 1 -- 172.21.15.33:0/2710228 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3461481744 0 0) 0x7fbbd80b3110 con 0x7fbbd8071300 2024-05-08T10:54:37.043 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:37.044+0000 7fbbd77fe640 1 -- 172.21.15.33:0/2710228 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbbc0003520 con 0x7fbbd8071300 2024-05-08T10:54:37.044 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:37.044+0000 7fbbd77fe640 1 -- 172.21.15.33:0/2710228 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1465986679 0 0) 0x7fbbd80b33f0 con 0x7fbbd8071fe0 2024-05-08T10:54:37.044 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:37.044+0000 7fbbd77fe640 1 -- 172.21.15.33:0/2710228 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbbd80b3110 con 0x7fbbd8071fe0 2024-05-08T10:54:37.044 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:37.044+0000 7fbbdcd05640 1 -- 172.21.15.33:0/2710228 >> v1:172.21.15.174:6789/0 conn(0x7fbbd8071fe0 legacy=0x7fbbd80b3ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:37.044 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:37.044+0000 7fbbdcd05640 1 -- 172.21.15.33:0/2710228 >> v1:172.21.15.33:6789/0 conn(0x7fbbd8071300 legacy=0x7fbbd80718d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:37.044 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:37.044+0000 7fbbdcd05640 1 -- 172.21.15.33:0/2710228 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbd80b36d0 con 0x7fbbd815aa90 2024-05-08T10:54:37.044 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:37.045+0000 7fbbdcd05640 1 --2- 172.21.15.33:0/2710228 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbbd815aa90 0x7fbbd8070c90 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc00ba40 tx=0x7fbbcc02c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5b72e237b8f97097 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:54:37.044 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:37.045+0000 7fbbd77fe640 1 -- 172.21.15.33:0/2710228 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbcc02f070 con 0x7fbbd815aa90 2024-05-08T10:54:37.044 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:37.045+0000 7fbbd77fe640 1 -- 172.21.15.33:0/2710228 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbcc038070 con 0x7fbbd815aa90 2024-05-08T10:54:37.044 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:37.045+0000 7fbbd77fe640 1 -- 172.21.15.33:0/2710228 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbcc02f070 con 0x7fbbd815aa90 2024-05-08T10:54:37.048 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:37.046+0000 7fbbdef69640 1 -- 172.21.15.33:0/2710228 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbbd815aa90 msgr2=0x7fbbd8070c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:37.048 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:37.046+0000 7fbbdef69640 1 --2- 172.21.15.33:0/2710228 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbbd815aa90 0x7fbbd8070c90 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc00ba40 tx=0x7fbbcc02c8e0 comp rx=0 tx=0).stop 2024-05-08T10:54:37.048 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:37.046+0000 7fbbdef69640 1 -- 172.21.15.33:0/2710228 shutdown_connections 2024-05-08T10:54:37.049 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:37.046+0000 7fbbdef69640 1 --2- 172.21.15.33:0/2710228 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbbd815aa90 0x7fbbd8070c90 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:37.049 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:37.046+0000 7fbbdef69640 1 -- 172.21.15.33:0/2710228 >> 172.21.15.33:0/2710228 conn(0x7fbbd80d0080 msgr2=0x7fbbd80d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:54:37.049 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:37.046+0000 7fbbdef69640 1 -- 172.21.15.33:0/2710228 shutdown_connections 2024-05-08T10:54:37.049 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:37.046+0000 7fbbdef69640 1 -- 172.21.15.33:0/2710228 wait complete. 2024-05-08T10:54:37.049 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:37.047+0000 7fbbdef69640 1 Processor -- start 2024-05-08T10:54:37.049 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:37.048+0000 7fbbdef69640 1 -- start start 2024-05-08T10:54:37.049 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:37.048+0000 7fbbdef69640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbbd8071300 0x7fbbd814d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:37.049 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:37.048+0000 7fbbdef69640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbbd8071fe0 0x7fbbd81f8550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:37.049 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:37.049+0000 7fbbdef69640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbbd815aa90 0x7fbbd80ce340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:37.049 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:37.049+0000 7fbbdef69640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd815bb10 con 0x7fbbd8071300 2024-05-08T10:54:37.049 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:37.049+0000 7fbbdcd05640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbbd8071300 0x7fbbd814d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:37.050 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:37.049+0000 7fbbd7fff640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbbd8071fe0 0x7fbbd81f8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:37.050 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:37.049+0000 7fbbd7fff640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbbd8071fe0 0x7fbbd81f8550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.33:44436/0 (socket says 172.21.15.33:44436) 2024-05-08T10:54:37.050 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:37.049+0000 7fbbd7fff640 1 -- 172.21.15.33:0/359768082 learned_addr learned my addr 172.21.15.33:0/359768082 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:54:37.050 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:37.049+0000 7fbbdef69640 1 -- 172.21.15.33:0/359768082 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd815b990 con 0x7fbbd8071fe0 2024-05-08T10:54:37.050 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:37.049+0000 7fbbdef69640 1 -- 172.21.15.33:0/359768082 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd80b45e0 con 0x7fbbd815aa90 2024-05-08T10:54:37.050 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:37.049+0000 7fbbdd506640 1 --2- 172.21.15.33:0/359768082 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbbd815aa90 0x7fbbd80ce340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:37.050 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:37.049+0000 7fbbd7fff640 1 -- 172.21.15.33:0/359768082 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbbd815aa90 msgr2=0x7fbbd80ce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:37.051 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:37.049+0000 7fbbd7fff640 1 --2- 172.21.15.33:0/359768082 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbbd815aa90 0x7fbbd80ce340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:37.051 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:37.049+0000 7fbbd7fff640 1 -- 172.21.15.33:0/359768082 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbbd8071300 msgr2=0x7fbbd814d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:37.051 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:37.049+0000 7fbbd7fff640 1 --2- 172.21.15.33:0/359768082 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbbd8071300 0x7fbbd814d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:37.051 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:37.049+0000 7fbbd7fff640 1 -- 172.21.15.33:0/359768082 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbd81fb340 con 0x7fbbd8071fe0 2024-05-08T10:54:37.051 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:37.049+0000 7fbbdcd05640 1 --2- 172.21.15.33:0/359768082 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbbd8071300 0x7fbbd814d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T10:54:37.051 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:37.050+0000 7fbbdd506640 1 --2- 172.21.15.33:0/359768082 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbbd815aa90 0x7fbbd80ce340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:54:37.051 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:37.050+0000 7fbbd7fff640 1 --2- 172.21.15.33:0/359768082 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbbd8071fe0 0x7fbbd81f8550 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fbbc800c500 tx=0x7fbbc800c9c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:54:37.051 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:37.050+0000 7fbbd57fa640 1 -- 172.21.15.33:0/359768082 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc8017070 con 0x7fbbd8071fe0 2024-05-08T10:54:37.051 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:37.050+0000 7fbbd57fa640 1 -- 172.21.15.33:0/359768082 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbc8005ce0 con 0x7fbbd8071fe0 2024-05-08T10:54:37.052 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:37.050+0000 7fbbdef69640 1 -- 172.21.15.33:0/359768082 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbd81fb620 con 0x7fbbd8071fe0 2024-05-08T10:54:37.052 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:37.051+0000 7fbbd57fa640 1 -- 172.21.15.33:0/359768082 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc80072f0 con 0x7fbbd8071fe0 2024-05-08T10:54:37.052 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:37.051+0000 7fbbdef69640 1 -- 172.21.15.33:0/359768082 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbd81fbbe0 con 0x7fbbd8071fe0 2024-05-08T10:54:37.053 INFO:tasks.ceph.osd.4.smithi174.stderr:2024-05-08T10:54:37.055+0000 7f09e41ab640 -1 osd.4 0 waiting for initial osdmap 2024-05-08T10:54:37.054 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:37.053+0000 7fbbd57fa640 1 -- 172.21.15.33:0/359768082 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 4) v1 ==== 89724+0+0 (secure 0 0 0) 0x7fbbc801a070 con 0x7fbbd8071fe0 2024-05-08T10:54:37.054 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:37.053+0000 7fbbdef69640 1 -- 172.21.15.33:0/359768082 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbd806de60 con 0x7fbbd8071fe0 2024-05-08T10:54:37.054 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:37.053+0000 7fbbd57fa640 1 --2- 172.21.15.33:0/359768082 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fbbc406b440 0x7fbbc406d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:37.054 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:37.054+0000 7fbbd57fa640 1 -- 172.21.15.33:0/359768082 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7fbbc8088dc0 con 0x7fbbd8071fe0 2024-05-08T10:54:37.054 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:37.054+0000 7fbbdcd05640 1 --2- 172.21.15.33:0/359768082 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fbbc406b440 0x7fbbc406d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:37.054 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:37.054+0000 7fbbdcd05640 1 --2- 172.21.15.33:0/359768082 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fbbc406b440 0x7fbbc406d900 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc037000 tx=0x7fbbcc032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:54:37.055 INFO:tasks.ceph.osd.7.smithi174.stderr:2024-05-08T10:54:37.058+0000 7ffbd76ba640 -1 osd.7 0 waiting for initial osdmap 2024-05-08T10:54:37.059 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:37.062+0000 7fbbd57fa640 1 -- 172.21.15.33:0/359768082 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fbbc80584f0 con 0x7fbbd8071fe0 2024-05-08T10:54:37.065 INFO:tasks.ceph.osd.4.smithi174.stderr:2024-05-08T10:54:37.068+0000 7f09dc7dd640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T10:54:37.067 INFO:tasks.ceph.osd.7.smithi174.stderr:2024-05-08T10:54:37.070+0000 7ffbce4b4640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T10:54:37.067 INFO:tasks.ceph.osd.6.smithi174.stderr:2024-05-08T10:54:37.070+0000 7f5ba66ca640 -1 osd.6 0 waiting for initial osdmap 2024-05-08T10:54:37.071 INFO:tasks.ceph.osd.5.smithi174.stderr:2024-05-08T10:54:37.074+0000 7f5cc013e640 -1 osd.5 0 waiting for initial osdmap 2024-05-08T10:54:37.079 INFO:tasks.ceph.osd.6.smithi174.stderr:2024-05-08T10:54:37.082+0000 7f5b9ecfc640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T10:54:37.089 INFO:tasks.ceph.osd.5.smithi174.stderr:2024-05-08T10:54:37.092+0000 7f5cb8770640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T10:54:37.094 INFO:tasks.ceph.osd.3.smithi033.stderr:2024-05-08T10:54:37.097+0000 7f0c82c2e640 -1 osd.3 0 waiting for initial osdmap 2024-05-08T10:54:37.110 INFO:tasks.ceph.osd.1.smithi033.stderr:2024-05-08T10:54:37.113+0000 7fb265e2e640 -1 osd.1 0 waiting for initial osdmap 2024-05-08T10:54:37.113 INFO:tasks.ceph.osd.3.smithi033.stderr:2024-05-08T10:54:37.116+0000 7f0c7b260640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T10:54:37.115 INFO:tasks.ceph.osd.0.smithi033.stderr:2024-05-08T10:54:37.118+0000 7f0ccca69640 -1 osd.0 0 waiting for initial osdmap 2024-05-08T10:54:37.121 INFO:tasks.ceph.osd.1.smithi033.stderr:2024-05-08T10:54:37.124+0000 7fb25e460640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T10:54:37.131 INFO:tasks.ceph.osd.0.smithi033.stderr:2024-05-08T10:54:37.134+0000 7f0cc509b640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T10:54:37.267 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:37.270+0000 7fbbdef69640 1 -- 172.21.15.33:0/359768082 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbbd80d0f00 con 0x7fbbd8071fe0 2024-05-08T10:54:37.267 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:37.270+0000 7fbbd57fa640 1 -- 172.21.15.33:0/359768082 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7058 (secure 0 0 0) 0x7fbbc805c590 con 0x7fbbd8071fe0 2024-05-08T10:54:37.268 INFO:teuthology.misc.health.smithi033.stdout: 2024-05-08T10:54:37.268 INFO:teuthology.misc.health.smithi033.stdout:{"epoch":12,"fsid":"963217b2-c375-4f5a-95cf-88e199dd38ff","created":"2024-05-08T10:54:26.711528+0000","modified":"2024-05-08T10:54:34.957974+0000","last_up_change":"0.000000","last_in_change":"2024-05-08T10:54:28.834106+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c5da4fb5-d4f2-4982-a804-2aa92fe77731","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f8fdd8db-c2a3-4d28-81f3-b30f44bea7c7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"87d465f3-b40f-48dd-bae2-4c67904d4828","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"79450edf-9637-4181-9372-e1cd5e91e73e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"bd0debfa-e559-4b1e-920d-6b2639c7085e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"ff0f51c0-672b-448f-9de1-b9305ce8c00d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"93061f6c-c0ce-47e9-88a0-1151c5ccb4e0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"7be1dcf3-1957-4ec3-bacf-f5f9fff580a2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T10:54:37.270 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:37.272+0000 7fbbdef69640 1 -- 172.21.15.33:0/359768082 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fbbc406b440 msgr2=0x7fbbc406d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:37.270 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:37.272+0000 7fbbdef69640 1 --2- 172.21.15.33:0/359768082 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fbbc406b440 0x7fbbc406d900 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc037000 tx=0x7fbbcc032000 comp rx=0 tx=0).stop 2024-05-08T10:54:37.270 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:37.272+0000 7fbbdef69640 1 -- 172.21.15.33:0/359768082 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbbd8071fe0 msgr2=0x7fbbd81f8550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:37.270 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:37.272+0000 7fbbdef69640 1 --2- 172.21.15.33:0/359768082 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbbd8071fe0 0x7fbbd81f8550 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fbbc800c500 tx=0x7fbbc800c9c0 comp rx=0 tx=0).stop 2024-05-08T10:54:37.270 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:37.272+0000 7fbbdef69640 1 -- 172.21.15.33:0/359768082 shutdown_connections 2024-05-08T10:54:37.270 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:37.272+0000 7fbbdef69640 1 --2- 172.21.15.33:0/359768082 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fbbc406b440 0x7fbbc406d900 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:37.270 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:37.272+0000 7fbbdef69640 1 --2- 172.21.15.33:0/359768082 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbbd815aa90 0x7fbbd80ce340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:37.271 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:37.272+0000 7fbbdef69640 1 --2- 172.21.15.33:0/359768082 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbbd8071fe0 0x7fbbd81f8550 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:37.271 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:37.272+0000 7fbbdef69640 1 --2- 172.21.15.33:0/359768082 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbbd8071300 0x7fbbd814d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:37.271 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:37.272+0000 7fbbdef69640 1 -- 172.21.15.33:0/359768082 >> 172.21.15.33:0/359768082 conn(0x7fbbd80d0080 msgr2=0x7fbbd80d0460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:54:37.271 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:37.273+0000 7fbbdef69640 1 -- 172.21.15.33:0/359768082 shutdown_connections 2024-05-08T10:54:37.271 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:37.273+0000 7fbbdef69640 1 -- 172.21.15.33:0/359768082 wait complete. 2024-05-08T10:54:37.279 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-05-08T10:54:44.086 DEBUG:teuthology.orchestra.run.smithi033:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-08T10:54:44.192 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:44.195+0000 7f3167815640 1 Processor -- start 2024-05-08T10:54:44.193 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:44.195+0000 7f3167815640 1 -- start start 2024-05-08T10:54:44.194 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:44.196+0000 7f3167815640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f3160161540 0x7f31600d0500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:44.194 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:44.196+0000 7f3167815640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f31600d0a40 0x7f31600d26f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:44.194 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:44.196+0000 7f3167815640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31600b06e0 con 0x7f31600b4b20 2024-05-08T10:54:44.194 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:44.196+0000 7f3167815640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3160161920 con 0x7f3160161540 2024-05-08T10:54:44.194 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:44.196+0000 7f3167815640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31600b4810 con 0x7f31600d0a40 2024-05-08T10:54:44.194 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:44.196+0000 7f31655b1640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f3160161540 0x7f31600d0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:44.194 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:44.196+0000 7f31655b1640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f3160161540 0x7f31600d0500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55304/0 (socket says 172.21.15.33:55304) 2024-05-08T10:54:44.195 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:44.196+0000 7f31655b1640 1 -- 172.21.15.33:0/1599619272 learned_addr learned my addr 172.21.15.33:0/1599619272 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:54:44.195 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:44.197+0000 7f3165db2640 1 --2- 172.21.15.33:0/1599619272 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f31600d0a40 0x7f31600d26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:44.195 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:44.197+0000 7f31655b1640 1 -- 172.21.15.33:0/1599619272 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f31600d0a40 msgr2=0x7f31600d26f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:54:44.195 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:44.197+0000 7f31655b1640 1 --2- 172.21.15.33:0/1599619272 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f31600d0a40 0x7f31600d26f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:44.195 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:44.197+0000 7f31655b1640 1 -- 172.21.15.33:0/1599619272 >> v1:172.21.15.174:6789/0 conn(0x7f31600b4b20 legacy=0x7f31600cea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:44.195 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:44.197+0000 7f31655b1640 1 -- 172.21.15.33:0/1599619272 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31600d4a10 con 0x7f3160161540 2024-05-08T10:54:44.196 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:44.197+0000 7f31655b1640 1 --2- 172.21.15.33:0/1599619272 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3160161540 0x7f31600d0500 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f315c009870 tx=0x7f315c02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1752000db3bc4ca server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:54:44.196 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:44.198+0000 7f3157fff640 1 -- 172.21.15.33:0/1599619272 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f315c037070 con 0x7f3160161540 2024-05-08T10:54:44.196 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:44.198+0000 7f3157fff640 1 -- 172.21.15.33:0/1599619272 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f315c032440 con 0x7f3160161540 2024-05-08T10:54:44.196 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:44.198+0000 7f3157fff640 1 -- 172.21.15.33:0/1599619272 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f315c032810 con 0x7f3160161540 2024-05-08T10:54:44.196 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:44.198+0000 7f3167815640 1 -- 172.21.15.33:0/1599619272 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3160161540 msgr2=0x7f31600d0500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:44.196 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:44.198+0000 7f3167815640 1 --2- 172.21.15.33:0/1599619272 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3160161540 0x7f31600d0500 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f315c009870 tx=0x7f315c02a1c0 comp rx=0 tx=0).stop 2024-05-08T10:54:44.196 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:44.198+0000 7f3167815640 1 -- 172.21.15.33:0/1599619272 shutdown_connections 2024-05-08T10:54:44.197 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:44.198+0000 7f3167815640 1 --2- 172.21.15.33:0/1599619272 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f31600d0a40 0x7f31600d26f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:44.197 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:44.198+0000 7f3167815640 1 --2- 172.21.15.33:0/1599619272 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3160161540 0x7f31600d0500 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:44.197 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:44.198+0000 7f3167815640 1 -- 172.21.15.33:0/1599619272 >> 172.21.15.33:0/1599619272 conn(0x7f31600d3b10 msgr2=0x7f31600d3f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:54:44.197 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:44.198+0000 7f3167815640 1 -- 172.21.15.33:0/1599619272 shutdown_connections 2024-05-08T10:54:44.197 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:44.198+0000 7f3167815640 1 -- 172.21.15.33:0/1599619272 wait complete. 2024-05-08T10:54:44.199 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:44.200+0000 7f3167815640 1 Processor -- start 2024-05-08T10:54:44.199 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:44.200+0000 7f3167815640 1 -- start start 2024-05-08T10:54:44.199 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:44.200+0000 7f3167815640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f31600b4b20 0x7f316014c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:44.200 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:44.200+0000 7f3167815640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f31600d0a40 0x7f31600cabe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:44.200 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:44.200+0000 7f3167815640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3160161540 0x7f316015fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:44.200 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:44.200+0000 7f3167815640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31600b44a0 con 0x7f3160161540 2024-05-08T10:54:44.200 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:44.200+0000 7f3167815640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31600b41c0 con 0x7f31600d0a40 2024-05-08T10:54:44.200 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:44.200+0000 7f3167815640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31600d4630 con 0x7f31600b4b20 2024-05-08T10:54:44.200 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:44.200+0000 7f3165db2640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3160161540 0x7f316015fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:44.200 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:44.201+0000 7f3165db2640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3160161540 0x7f316015fe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55306/0 (socket says 172.21.15.33:55306) 2024-05-08T10:54:44.200 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:44.201+0000 7f3165db2640 1 -- 172.21.15.33:0/1927868773 learned_addr learned my addr 172.21.15.33:0/1927868773 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:54:44.200 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:44.201+0000 7f3164db0640 1 --2- 172.21.15.33:0/1927868773 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f31600d0a40 0x7f31600cabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:44.200 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:44.201+0000 7f31655b1640 1 --2- 172.21.15.33:0/1927868773 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f31600b4b20 0x7f316014c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:44.200 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:44.201+0000 7f3165db2640 1 -- 172.21.15.33:0/1927868773 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f31600b4b20 msgr2=0x7f316014c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:44.200 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:44.201+0000 7f3165db2640 1 --2- 172.21.15.33:0/1927868773 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f31600b4b20 0x7f316014c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:44.200 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:44.201+0000 7f3165db2640 1 -- 172.21.15.33:0/1927868773 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f31600d0a40 msgr2=0x7f31600cabe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:44.200 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:44.201+0000 7f3165db2640 1 --2- 172.21.15.33:0/1927868773 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f31600d0a40 0x7f31600cabe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:44.201 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:44.201+0000 7f3165db2640 1 -- 172.21.15.33:0/1927868773 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31600cbf40 con 0x7f3160161540 2024-05-08T10:54:44.201 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:44.201+0000 7f3165db2640 1 --2- 172.21.15.33:0/1927868773 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3160161540 0x7f316015fe70 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f3158007e70 tx=0x7f315800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:54:44.201 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:44.201+0000 7f3155ffb640 1 -- 172.21.15.33:0/1927868773 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3158014620 con 0x7f3160161540 2024-05-08T10:54:44.201 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:44.201+0000 7f3155ffb640 1 -- 172.21.15.33:0/1927868773 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3158019070 con 0x7f3160161540 2024-05-08T10:54:44.201 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:44.201+0000 7f3167815640 1 -- 172.21.15.33:0/1927868773 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31600cb6a0 con 0x7f3160161540 2024-05-08T10:54:44.201 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:44.201+0000 7f3155ffb640 1 -- 172.21.15.33:0/1927868773 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3158014a20 con 0x7f3160161540 2024-05-08T10:54:44.201 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:44.202+0000 7f3167815640 1 -- 172.21.15.33:0/1927868773 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31600cbc60 con 0x7f3160161540 2024-05-08T10:54:44.201 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:44.202+0000 7f3167815640 1 -- 172.21.15.33:0/1927868773 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31600a1a60 con 0x7f3160161540 2024-05-08T10:54:44.202 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:44.203+0000 7f3155ffb640 1 -- 172.21.15.33:0/1927868773 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3158014bc0 con 0x7f3160161540 2024-05-08T10:54:44.202 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:44.203+0000 7f3155ffb640 1 --2- 172.21.15.33:0/1927868773 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f314406b520 0x7f314406d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:44.202 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:44.204+0000 7f3155ffb640 1 -- 172.21.15.33:0/1927868773 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f315808a5d0 con 0x7f3160161540 2024-05-08T10:54:44.202 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:44.204+0000 7f31655b1640 1 --2- 172.21.15.33:0/1927868773 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f314406b520 0x7f314406d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:44.202 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:44.204+0000 7f31655b1640 1 --2- 172.21.15.33:0/1927868773 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f314406b520 0x7f314406d9e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f315c034000 tx=0x7f315c02e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:54:44.205 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:44.208+0000 7f3155ffb640 1 -- 172.21.15.33:0/1927868773 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f31580591c0 con 0x7f3160161540 2024-05-08T10:54:44.390 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:44.392+0000 7f3167815640 1 -- 172.21.15.33:0/1927868773 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f31600c9fb0 con 0x7f3160161540 2024-05-08T10:54:44.390 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:44.393+0000 7f3155ffb640 1 -- 172.21.15.33:0/1927868773 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12896 (secure 0 0 0) 0x7f315805d260 con 0x7f3160161540 2024-05-08T10:54:44.391 INFO:teuthology.misc.health.smithi033.stdout: 2024-05-08T10:54:44.391 INFO:teuthology.misc.health.smithi033.stdout:{"epoch":16,"fsid":"963217b2-c375-4f5a-95cf-88e199dd38ff","created":"2024-05-08T10:54:26.711528+0000","modified":"2024-05-08T10:54:40.992408+0000","last_up_change":"2024-05-08T10:54:37.987478+0000","last_in_change":"2024-05-08T10:54:28.834106+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T10:54:38.989228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c5da4fb5-d4f2-4982-a804-2aa92fe77731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3990629207},{"type":"v1","addr":"172.21.15.33:6817","nonce":3990629207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3990629207},{"type":"v1","addr":"172.21.15.33:6819","nonce":3990629207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3990629207},{"type":"v1","addr":"172.21.15.33:6823","nonce":3990629207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3990629207},{"type":"v1","addr":"172.21.15.33:6821","nonce":3990629207}]},"public_addr":"172.21.15.33:6817/3990629207","cluster_addr":"172.21.15.33:6819/3990629207","heartbeat_back_addr":"172.21.15.33:6823/3990629207","heartbeat_front_addr":"172.21.15.33:6821/3990629207","state":["exists","up"]},{"osd":1,"uuid":"f8fdd8db-c2a3-4d28-81f3-b30f44bea7c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":1758076090},{"type":"v1","addr":"172.21.15.33:6825","nonce":1758076090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":1758076090},{"type":"v1","addr":"172.21.15.33:6827","nonce":1758076090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":1758076090},{"type":"v1","addr":"172.21.15.33:6831","nonce":1758076090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":1758076090},{"type":"v1","addr":"172.21.15.33:6829","nonce":1758076090}]},"public_addr":"172.21.15.33:6825/1758076090","cluster_addr":"172.21.15.33:6827/1758076090","heartbeat_back_addr":"172.21.15.33:6831/1758076090","heartbeat_front_addr":"172.21.15.33:6829/1758076090","state":["exists","up"]},{"osd":2,"uuid":"87d465f3-b40f-48dd-bae2-4c67904d4828","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":2940853479},{"type":"v1","addr":"172.21.15.33:6801","nonce":2940853479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6803","nonce":2940853479},{"type":"v1","addr":"172.21.15.33:6805","nonce":2940853479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6811","nonce":2940853479},{"type":"v1","addr":"172.21.15.33:6813","nonce":2940853479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6807","nonce":2940853479},{"type":"v1","addr":"172.21.15.33:6809","nonce":2940853479}]},"public_addr":"172.21.15.33:6801/2940853479","cluster_addr":"172.21.15.33:6805/2940853479","heartbeat_back_addr":"172.21.15.33:6813/2940853479","heartbeat_front_addr":"172.21.15.33:6809/2940853479","state":["exists","up"]},{"osd":3,"uuid":"79450edf-9637-4181-9372-e1cd5e91e73e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":4029047077},{"type":"v1","addr":"172.21.15.33:6804","nonce":4029047077}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":4029047077},{"type":"v1","addr":"172.21.15.33:6808","nonce":4029047077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":4029047077},{"type":"v1","addr":"172.21.15.33:6815","nonce":4029047077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":4029047077},{"type":"v1","addr":"172.21.15.33:6812","nonce":4029047077}]},"public_addr":"172.21.15.33:6804/4029047077","cluster_addr":"172.21.15.33:6808/4029047077","heartbeat_back_addr":"172.21.15.33:6815/4029047077","heartbeat_front_addr":"172.21.15.33:6812/4029047077","state":["exists","up"]},{"osd":4,"uuid":"bd0debfa-e559-4b1e-920d-6b2639c7085e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":1697399220},{"type":"v1","addr":"172.21.15.174:6801","nonce":1697399220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":1697399220},{"type":"v1","addr":"172.21.15.174:6803","nonce":1697399220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":1697399220},{"type":"v1","addr":"172.21.15.174:6807","nonce":1697399220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":1697399220},{"type":"v1","addr":"172.21.15.174:6805","nonce":1697399220}]},"public_addr":"172.21.15.174:6801/1697399220","cluster_addr":"172.21.15.174:6803/1697399220","heartbeat_back_addr":"172.21.15.174:6807/1697399220","heartbeat_front_addr":"172.21.15.174:6805/1697399220","state":["exists","up"]},{"osd":5,"uuid":"ff0f51c0-672b-448f-9de1-b9305ce8c00d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":1511860729},{"type":"v1","addr":"172.21.15.174:6825","nonce":1511860729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":1511860729},{"type":"v1","addr":"172.21.15.174:6827","nonce":1511860729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":1511860729},{"type":"v1","addr":"172.21.15.174:6831","nonce":1511860729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":1511860729},{"type":"v1","addr":"172.21.15.174:6829","nonce":1511860729}]},"public_addr":"172.21.15.174:6825/1511860729","cluster_addr":"172.21.15.174:6827/1511860729","heartbeat_back_addr":"172.21.15.174:6831/1511860729","heartbeat_front_addr":"172.21.15.174:6829/1511860729","state":["exists","up"]},{"osd":6,"uuid":"93061f6c-c0ce-47e9-88a0-1151c5ccb4e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":2326407945},{"type":"v1","addr":"172.21.15.174:6817","nonce":2326407945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":2326407945},{"type":"v1","addr":"172.21.15.174:6819","nonce":2326407945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":2326407945},{"type":"v1","addr":"172.21.15.174:6823","nonce":2326407945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":2326407945},{"type":"v1","addr":"172.21.15.174:6821","nonce":2326407945}]},"public_addr":"172.21.15.174:6817/2326407945","cluster_addr":"172.21.15.174:6819/2326407945","heartbeat_back_addr":"172.21.15.174:6823/2326407945","heartbeat_front_addr":"172.21.15.174:6821/2326407945","state":["exists","up"]},{"osd":7,"uuid":"7be1dcf3-1957-4ec3-bacf-f5f9fff580a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":1637570253},{"type":"v1","addr":"172.21.15.174:6809","nonce":1637570253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":1637570253},{"type":"v1","addr":"172.21.15.174:6811","nonce":1637570253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":1637570253},{"type":"v1","addr":"172.21.15.174:6815","nonce":1637570253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":1637570253},{"type":"v1","addr":"172.21.15.174:6813","nonce":1637570253}]},"public_addr":"172.21.15.174:6809/1637570253","cluster_addr":"172.21.15.174:6811/1637570253","heartbeat_back_addr":"172.21.15.174:6815/1637570253","heartbeat_front_addr":"172.21.15.174:6813/1637570253","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:33.997709+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:34.016568+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:33.990484+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:33.980666+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:33.920609+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:34.005069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:34.018345+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:34.061646+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T10:54:44.393 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:44.395+0000 7f3167815640 1 -- 172.21.15.33:0/1927868773 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f314406b520 msgr2=0x7f314406d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:44.393 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:44.395+0000 7f3167815640 1 --2- 172.21.15.33:0/1927868773 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f314406b520 0x7f314406d9e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f315c034000 tx=0x7f315c02e000 comp rx=0 tx=0).stop 2024-05-08T10:54:44.393 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:44.395+0000 7f3167815640 1 -- 172.21.15.33:0/1927868773 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3160161540 msgr2=0x7f316015fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:44.393 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:44.395+0000 7f3167815640 1 --2- 172.21.15.33:0/1927868773 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3160161540 0x7f316015fe70 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f3158007e70 tx=0x7f315800e4b0 comp rx=0 tx=0).stop 2024-05-08T10:54:44.393 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:44.395+0000 7f3167815640 1 -- 172.21.15.33:0/1927868773 shutdown_connections 2024-05-08T10:54:44.393 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:44.395+0000 7f3167815640 1 --2- 172.21.15.33:0/1927868773 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f314406b520 0x7f314406d9e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:44.393 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:44.395+0000 7f3167815640 1 --2- 172.21.15.33:0/1927868773 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3160161540 0x7f316015fe70 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:44.393 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:44.395+0000 7f3167815640 1 --2- 172.21.15.33:0/1927868773 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f31600d0a40 0x7f31600cabe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:44.393 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:44.395+0000 7f3167815640 1 --2- 172.21.15.33:0/1927868773 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f31600b4b20 0x7f316014c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:44.393 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:44.395+0000 7f3167815640 1 -- 172.21.15.33:0/1927868773 >> 172.21.15.33:0/1927868773 conn(0x7f31600d3b10 msgr2=0x7f31600d1f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:54:44.393 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:44.395+0000 7f3167815640 1 -- 172.21.15.33:0/1927868773 shutdown_connections 2024-05-08T10:54:44.394 INFO:teuthology.misc.health.smithi033.stderr:2024-05-08T10:54:44.395+0000 7f3167815640 1 -- 172.21.15.33:0/1927868773 wait complete. 2024-05-08T10:54:44.402 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-05-08T10:54:44.402 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-05-08T10:54:44.403 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-08T10:54:44.403 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-08T10:54:44.405 INFO:tasks.ceph.mds.a:Started 2024-05-08T10:54:44.405 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-08T10:54:44.405 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-08T10:54:44.407 INFO:tasks.ceph.mds.c:Started 2024-05-08T10:54:44.407 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-08T10:54:44.408 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-08T10:54:44.411 INFO:tasks.ceph.mds.b:Started 2024-05-08T10:54:44.411 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-08T10:54:44.411 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-08T10:54:44.413 INFO:tasks.ceph.mds.d:Started 2024-05-08T10:54:44.413 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-05-08T10:54:44.413 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T10:54:44.483 INFO:tasks.ceph.mds.a.smithi033.stdout:starting mds.a at 2024-05-08T10:54:44.483 INFO:tasks.ceph.mds.c.smithi033.stdout:starting mds.c at 2024-05-08T10:54:44.498 INFO:tasks.ceph.mds.b.smithi174.stdout:starting mds.b at 2024-05-08T10:54:44.498 INFO:tasks.ceph.mds.d.smithi174.stdout:starting mds.d at 2024-05-08T10:54:44.498 INFO:tasks.ceph.mds.d.smithi174.stderr:2024-05-08T10:54:44.501+0000 7f561ef24640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2024-05-08T10:54:44.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:44.524+0000 7f23eee7d640 1 Processor -- start 2024-05-08T10:54:44.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:44.524+0000 7f23eee7d640 1 -- start start 2024-05-08T10:54:44.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:44.524+0000 7f23eee7d640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f23e815be10 0x7f23e80d2460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:44.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:44.524+0000 7f23eee7d640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23e80ccc30 con 0x7f23e80ce180 2024-05-08T10:54:44.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:44.525+0000 7f23ed41a640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f23e80ce180 0x7f23e80cf7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:37156/0 (socket says 172.21.15.33:37156) 2024-05-08T10:54:44.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:44.525+0000 7f23ed41a640 1 -- 172.21.15.33:0/3616123358 learned_addr learned my addr 172.21.15.33:0/3616123358 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-05-08T10:54:44.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:44.525+0000 7f23eee7d640 1 -- 172.21.15.33:0/3616123358 --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23e80ccf10 con 0x7f23e815ba30 2024-05-08T10:54:44.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:44.525+0000 7f23eee7d640 1 -- 172.21.15.33:0/3616123358 --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23e80cd840 con 0x7f23e815be10 2024-05-08T10:54:44.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:44.525+0000 7f23e7fff640 1 --2- 172.21.15.33:0/3616123358 >> v2:172.21.15.174:3300/0 conn(0x7f23e815be10 0x7f23e80d2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:44.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:44.525+0000 7f23e77fe640 1 -- 172.21.15.33:0/3616123358 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4217941026 0 0) 0x7f23e80ccc30 con 0x7f23e80ce180 2024-05-08T10:54:44.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:44.525+0000 7f23e77fe640 1 -- 172.21.15.33:0/3616123358 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23d8003520 con 0x7f23e80ce180 2024-05-08T10:54:44.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:44.525+0000 7f23e77fe640 1 -- 172.21.15.33:0/3616123358 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3808441766 0 0) 0x7f23e80ccf10 con 0x7f23e815ba30 2024-05-08T10:54:44.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:44.525+0000 7f23e77fe640 1 -- 172.21.15.33:0/3616123358 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23e80ccc30 con 0x7f23e815ba30 2024-05-08T10:54:44.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:44.525+0000 7f23e77fe640 1 -- 172.21.15.33:0/3616123358 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1884275621 0 0) 0x7f23d8003520 con 0x7f23e80ce180 2024-05-08T10:54:44.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:44.525+0000 7f23e7fff640 1 -- 172.21.15.33:0/3616123358 >> v1:172.21.15.174:6789/0 conn(0x7f23e815ba30 legacy=0x7f23e80cc450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:44.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:44.525+0000 7f23e7fff640 1 -- 172.21.15.33:0/3616123358 >> v1:172.21.15.33:6789/0 conn(0x7f23e80ce180 legacy=0x7f23e80cf7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:44.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:44.525+0000 7f23e7fff640 1 -- 172.21.15.33:0/3616123358 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23e80cd1f0 con 0x7f23e815be10 2024-05-08T10:54:44.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:44.526+0000 7f23e7fff640 1 --2- 172.21.15.33:0/3616123358 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f23e815be10 0x7f23e80d2460 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f23d40097a0 tx=0x7f23d402a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=40a2f834941fe593 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:54:44.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:44.526+0000 7f23e77fe640 1 -- 172.21.15.33:0/3616123358 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d4037070 con 0x7f23e815be10 2024-05-08T10:54:44.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:44.526+0000 7f23e77fe640 1 -- 172.21.15.33:0/3616123358 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23d402ac50 con 0x7f23e815be10 2024-05-08T10:54:44.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:44.526+0000 7f23e77fe640 1 -- 172.21.15.33:0/3616123358 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23e00019f0 con 0x7f23e815be10 2024-05-08T10:54:44.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:44.527+0000 7f23eee7d640 1 -- 172.21.15.33:0/3616123358 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f23e815be10 msgr2=0x7f23e80d2460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:44.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:44.527+0000 7f23eee7d640 1 --2- 172.21.15.33:0/3616123358 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f23e815be10 0x7f23e80d2460 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f23d40097a0 tx=0x7f23d402a1c0 comp rx=0 tx=0).stop 2024-05-08T10:54:44.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:44.527+0000 7f23eee7d640 1 -- 172.21.15.33:0/3616123358 shutdown_connections 2024-05-08T10:54:44.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:44.527+0000 7f23eee7d640 1 --2- 172.21.15.33:0/3616123358 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f23e815be10 0x7f23e80d2460 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:44.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:44.527+0000 7f23eee7d640 1 -- 172.21.15.33:0/3616123358 >> 172.21.15.33:0/3616123358 conn(0x7f23e80d1940 msgr2=0x7f23e80d1d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:54:44.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:44.527+0000 7f23eee7d640 1 -- 172.21.15.33:0/3616123358 shutdown_connections 2024-05-08T10:54:44.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:44.527+0000 7f23eee7d640 1 -- 172.21.15.33:0/3616123358 wait complete. 2024-05-08T10:54:44.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:44.528+0000 7f23eee7d640 1 Processor -- start 2024-05-08T10:54:44.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:44.528+0000 7f23eee7d640 1 -- start start 2024-05-08T10:54:44.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:44.529+0000 7f23eee7d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23e80ce180 0x7f23e80cb530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:44.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:44.529+0000 7f23eee7d640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f23e815ba30 0x7f23e81f3a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:44.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:44.529+0000 7f23eee7d640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f23e815be10 0x7f23e8157fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:44.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:44.529+0000 7f23eee7d640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23e80ce5f0 con 0x7f23e80ce180 2024-05-08T10:54:44.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:44.529+0000 7f23eee7d640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23e806e6e0 con 0x7f23e815be10 2024-05-08T10:54:44.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:44.529+0000 7f23eee7d640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23e80ce770 con 0x7f23e815ba30 2024-05-08T10:54:44.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:44.529+0000 7f23ecc19640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23e80ce180 0x7f23e80cb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:44.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:44.529+0000 7f23ecc19640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23e80ce180 0x7f23e80cb530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55338/0 (socket says 172.21.15.33:55338) 2024-05-08T10:54:44.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:44.529+0000 7f23ecc19640 1 -- 172.21.15.33:0/2948860888 learned_addr learned my addr 172.21.15.33:0/2948860888 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:54:44.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:44.529+0000 7f23e7fff640 1 --2- 172.21.15.33:0/2948860888 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f23e815ba30 0x7f23e81f3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:44.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:44.529+0000 7f23ed41a640 1 --2- 172.21.15.33:0/2948860888 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f23e815be10 0x7f23e8157fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:44.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:44.529+0000 7f23ecc19640 1 -- 172.21.15.33:0/2948860888 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f23e815ba30 msgr2=0x7f23e81f3a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:44.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:44.529+0000 7f23ecc19640 1 --2- 172.21.15.33:0/2948860888 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f23e815ba30 0x7f23e81f3a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:44.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:44.529+0000 7f23ecc19640 1 -- 172.21.15.33:0/2948860888 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f23e815be10 msgr2=0x7f23e8157fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:44.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:44.529+0000 7f23ecc19640 1 --2- 172.21.15.33:0/2948860888 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f23e815be10 0x7f23e8157fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:44.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:44.529+0000 7f23ecc19640 1 -- 172.21.15.33:0/2948860888 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23e81f42b0 con 0x7f23e80ce180 2024-05-08T10:54:44.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:44.529+0000 7f23ed41a640 1 --2- 172.21.15.33:0/2948860888 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f23e815be10 0x7f23e8157fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:54:44.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:44.530+0000 7f23ecc19640 1 --2- 172.21.15.33:0/2948860888 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23e80ce180 0x7f23e80cb530 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f23dc00c4c0 tx=0x7f23dc00c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:54:44.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:44.530+0000 7f23e57fa640 1 -- 172.21.15.33:0/2948860888 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23dc0052d0 con 0x7f23e80ce180 2024-05-08T10:54:44.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:44.530+0000 7f23e57fa640 1 -- 172.21.15.33:0/2948860888 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23dc005470 con 0x7f23e80ce180 2024-05-08T10:54:44.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:44.530+0000 7f23eee7d640 1 -- 172.21.15.33:0/2948860888 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23e81f4590 con 0x7f23e80ce180 2024-05-08T10:54:44.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:44.530+0000 7f23e57fa640 1 -- 172.21.15.33:0/2948860888 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23dc012870 con 0x7f23e80ce180 2024-05-08T10:54:44.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:44.530+0000 7f23eee7d640 1 -- 172.21.15.33:0/2948860888 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23e81f3fc0 con 0x7f23e80ce180 2024-05-08T10:54:44.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:44.531+0000 7f23eee7d640 1 -- 172.21.15.33:0/2948860888 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23e8069d20 con 0x7f23e80ce180 2024-05-08T10:54:44.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:44.531+0000 7f23e57fa640 1 -- 172.21.15.33:0/2948860888 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f23dc012a10 con 0x7f23e80ce180 2024-05-08T10:54:44.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:44.532+0000 7f23e57fa640 1 --2- 172.21.15.33:0/2948860888 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f23cc06b4d0 0x7f23cc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:44.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:44.532+0000 7f23e57fa640 1 -- 172.21.15.33:0/2948860888 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f23dc089b70 con 0x7f23e80ce180 2024-05-08T10:54:44.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:44.532+0000 7f23e7fff640 1 --2- 172.21.15.33:0/2948860888 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f23cc06b4d0 0x7f23cc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:44.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:44.532+0000 7f23e7fff640 1 --2- 172.21.15.33:0/2948860888 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f23cc06b4d0 0x7f23cc06d990 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f23d4034000 tx=0x7f23d402e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:54:44.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:44.536+0000 7f23e57fa640 1 -- 172.21.15.33:0/2948860888 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f23dc058cc0 con 0x7f23e80ce180 2024-05-08T10:54:44.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:44.756+0000 7f23eee7d640 1 -- 172.21.15.33:0/2948860888 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f23e80b78c0 con 0x7f23e80ce180 2024-05-08T10:54:44.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:44.756+0000 7f23e57fa640 1 -- 172.21.15.33:0/2948860888 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1324 (secure 0 0 0) 0x7f23dc0585c0 con 0x7f23e80ce180 2024-05-08T10:54:44.754 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:54:44.754 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6834/3541391922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":3541391922},{"type":"v1","addr":"172.21.15.33:6834","nonce":3541391922}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2024-05-08T10:54:44.754 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 2 2024-05-08T10:54:44.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:44.758+0000 7f23eee7d640 1 -- 172.21.15.33:0/2948860888 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f23cc06b4d0 msgr2=0x7f23cc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:44.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:44.758+0000 7f23eee7d640 1 --2- 172.21.15.33:0/2948860888 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f23cc06b4d0 0x7f23cc06d990 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f23d4034000 tx=0x7f23d402e000 comp rx=0 tx=0).stop 2024-05-08T10:54:44.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:44.758+0000 7f23eee7d640 1 -- 172.21.15.33:0/2948860888 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23e80ce180 msgr2=0x7f23e80cb530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:44.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:44.758+0000 7f23eee7d640 1 --2- 172.21.15.33:0/2948860888 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23e80ce180 0x7f23e80cb530 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f23dc00c4c0 tx=0x7f23dc00c980 comp rx=0 tx=0).stop 2024-05-08T10:54:44.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:44.758+0000 7f23eee7d640 1 -- 172.21.15.33:0/2948860888 shutdown_connections 2024-05-08T10:54:44.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:44.758+0000 7f23eee7d640 1 --2- 172.21.15.33:0/2948860888 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f23cc06b4d0 0x7f23cc06d990 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:44.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:44.758+0000 7f23eee7d640 1 --2- 172.21.15.33:0/2948860888 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f23e815be10 0x7f23e8157fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:44.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:44.758+0000 7f23eee7d640 1 --2- 172.21.15.33:0/2948860888 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f23e815ba30 0x7f23e81f3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:44.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:44.758+0000 7f23eee7d640 1 --2- 172.21.15.33:0/2948860888 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23e80ce180 0x7f23e80cb530 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:44.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:44.758+0000 7f23eee7d640 1 -- 172.21.15.33:0/2948860888 >> 172.21.15.33:0/2948860888 conn(0x7f23e80d1940 msgr2=0x7f23e80b4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:54:44.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:44.758+0000 7f23eee7d640 1 -- 172.21.15.33:0/2948860888 shutdown_connections 2024-05-08T10:54:44.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:44.758+0000 7f23eee7d640 1 -- 172.21.15.33:0/2948860888 wait complete. 2024-05-08T10:54:46.767 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T10:54:46.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:46.886+0000 7ff103acd640 1 Processor -- start 2024-05-08T10:54:46.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:46.886+0000 7ff103acd640 1 -- start start 2024-05-08T10:54:46.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:46.887+0000 7ff103acd640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff0fc0b4c60 0x7ff0fc15e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:46.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:46.887+0000 7ff103acd640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0fc0d4910 con 0x7ff0fc0d0920 2024-05-08T10:54:46.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:46.887+0000 7ff103acd640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0fc0d25e0 con 0x7ff0fc0d0540 2024-05-08T10:54:46.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:46.887+0000 7ff103acd640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0fc0d46c0 con 0x7ff0fc0b4c60 2024-05-08T10:54:46.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:46.887+0000 7ff10206a640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff0fc0b4c60 0x7ff0fc15e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:46.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:46.887+0000 7ff101068640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7ff0fc0d0920 0x7ff0fc0ce7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:45400/0 (socket says 172.21.15.33:45400) 2024-05-08T10:54:46.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:46.887+0000 7ff101068640 1 -- 172.21.15.33:0/2342803504 learned_addr learned my addr 172.21.15.33:0/2342803504 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-05-08T10:54:46.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:46.887+0000 7ff10206a640 1 --2- 172.21.15.33:0/2342803504 >> v2:172.21.15.33:3300/0 conn(0x7ff0fc0b4c60 0x7ff0fc15e2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46348/0 (socket says 172.21.15.33:46348) 2024-05-08T10:54:46.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:46.888+0000 7ff10206a640 1 -- 172.21.15.33:0/2342803504 >> v1:172.21.15.174:6789/0 conn(0x7ff0fc0d0540 legacy=0x7ff0fc15dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:46.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:46.888+0000 7ff10206a640 1 -- 172.21.15.33:0/2342803504 >> v1:172.21.15.33:6789/0 conn(0x7ff0fc0d0920 legacy=0x7ff0fc0ce7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:46.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:46.888+0000 7ff10206a640 1 -- 172.21.15.33:0/2342803504 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0fc0b4730 con 0x7ff0fc0b4c60 2024-05-08T10:54:46.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:46.888+0000 7ff100867640 1 -- 172.21.15.33:0/2342803504 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3093286071 0 0) 0x7ff0fc0d4910 con 0x7ff0fc0d0920 2024-05-08T10:54:46.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:46.888+0000 7ff10206a640 1 --2- 172.21.15.33:0/2342803504 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff0fc0b4c60 0x7ff0fc15e2e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff0f40097a0 tx=0x7ff0f402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a515c507dc29fe3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:54:46.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:46.889+0000 7ff100867640 1 -- 172.21.15.33:0/2342803504 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f4037070 con 0x7ff0fc0b4c60 2024-05-08T10:54:46.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:46.889+0000 7ff100867640 1 -- 172.21.15.33:0/2342803504 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0f4032440 con 0x7ff0fc0b4c60 2024-05-08T10:54:46.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:46.889+0000 7ff100867640 1 -- 172.21.15.33:0/2342803504 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f402ae60 con 0x7ff0fc0b4c60 2024-05-08T10:54:46.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:46.889+0000 7ff103acd640 1 -- 172.21.15.33:0/2342803504 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff0fc0b4c60 msgr2=0x7ff0fc15e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:46.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:46.889+0000 7ff103acd640 1 --2- 172.21.15.33:0/2342803504 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff0fc0b4c60 0x7ff0fc15e2e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff0f40097a0 tx=0x7ff0f402a110 comp rx=0 tx=0).stop 2024-05-08T10:54:46.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:46.889+0000 7ff103acd640 1 -- 172.21.15.33:0/2342803504 shutdown_connections 2024-05-08T10:54:46.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:46.889+0000 7ff103acd640 1 --2- 172.21.15.33:0/2342803504 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff0fc0b4c60 0x7ff0fc15e2e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:46.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:46.889+0000 7ff103acd640 1 -- 172.21.15.33:0/2342803504 >> 172.21.15.33:0/2342803504 conn(0x7ff0fc0d3ba0 msgr2=0x7ff0fc0d3fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:54:46.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:46.889+0000 7ff103acd640 1 -- 172.21.15.33:0/2342803504 shutdown_connections 2024-05-08T10:54:46.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:46.889+0000 7ff103acd640 1 -- 172.21.15.33:0/2342803504 wait complete. 2024-05-08T10:54:46.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:46.891+0000 7ff103acd640 1 Processor -- start 2024-05-08T10:54:46.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:46.891+0000 7ff103acd640 1 -- start start 2024-05-08T10:54:46.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:46.891+0000 7ff103acd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff0fc0b4c60 0x7ff0fc0cc6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:46.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:46.891+0000 7ff103acd640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff0fc0d0540 0x7ff0fc15a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:46.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:46.891+0000 7ff103acd640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff0fc0d0920 0x7ff0fc0b6760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:46.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:46.891+0000 7ff103acd640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0fc0d2950 con 0x7ff0fc0b4c60 2024-05-08T10:54:46.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:46.891+0000 7ff103acd640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0fc0d2390 con 0x7ff0fc0d0540 2024-05-08T10:54:46.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:46.891+0000 7ff103acd640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0fc0ceec0 con 0x7ff0fc0d0920 2024-05-08T10:54:46.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:46.891+0000 7ff101869640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff0fc0b4c60 0x7ff0fc0cc6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:46.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:46.891+0000 7ff101869640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff0fc0b4c60 0x7ff0fc0cc6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46360/0 (socket says 172.21.15.33:46360) 2024-05-08T10:54:46.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:46.891+0000 7ff101869640 1 -- 172.21.15.33:0/1935093885 learned_addr learned my addr 172.21.15.33:0/1935093885 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:54:46.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:46.892+0000 7ff10206a640 1 --2- 172.21.15.33:0/1935093885 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff0fc0d0920 0x7ff0fc0b6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:46.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:46.892+0000 7ff101068640 1 --2- 172.21.15.33:0/1935093885 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff0fc0d0540 0x7ff0fc15a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:46.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:46.892+0000 7ff101869640 1 -- 172.21.15.33:0/1935093885 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff0fc0d0920 msgr2=0x7ff0fc0b6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:46.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:46.892+0000 7ff101869640 1 --2- 172.21.15.33:0/1935093885 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff0fc0d0920 0x7ff0fc0b6760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:46.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:46.892+0000 7ff101869640 1 -- 172.21.15.33:0/1935093885 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff0fc0d0540 msgr2=0x7ff0fc15a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:46.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:46.892+0000 7ff101869640 1 --2- 172.21.15.33:0/1935093885 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff0fc0d0540 0x7ff0fc15a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:46.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:46.892+0000 7ff101869640 1 -- 172.21.15.33:0/1935093885 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0fc15f230 con 0x7ff0fc0b4c60 2024-05-08T10:54:46.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:46.892+0000 7ff10206a640 1 --2- 172.21.15.33:0/1935093885 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff0fc0d0920 0x7ff0fc0b6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:54:46.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:46.892+0000 7ff101068640 1 --2- 172.21.15.33:0/1935093885 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff0fc0d0540 0x7ff0fc15a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:54:46.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:46.892+0000 7ff101869640 1 --2- 172.21.15.33:0/1935093885 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff0fc0b4c60 0x7ff0fc0cc6d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec00c870 tx=0x7ff0ec00cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:54:46.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:46.892+0000 7ff0fa7fc640 1 -- 172.21.15.33:0/1935093885 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0ec003b70 con 0x7ff0fc0b4c60 2024-05-08T10:54:46.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:46.892+0000 7ff0fa7fc640 1 -- 172.21.15.33:0/1935093885 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0ec003d30 con 0x7ff0fc0b4c60 2024-05-08T10:54:46.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:46.892+0000 7ff103acd640 1 -- 172.21.15.33:0/1935093885 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0fc0ccf20 con 0x7ff0fc0b4c60 2024-05-08T10:54:46.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:46.892+0000 7ff0fa7fc640 1 -- 172.21.15.33:0/1935093885 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0ec00aa90 con 0x7ff0fc0b4c60 2024-05-08T10:54:46.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:46.892+0000 7ff103acd640 1 -- 172.21.15.33:0/1935093885 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0fc0cd4e0 con 0x7ff0fc0b4c60 2024-05-08T10:54:46.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:46.894+0000 7ff103acd640 1 -- 172.21.15.33:0/1935093885 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0fc067440 con 0x7ff0fc0b4c60 2024-05-08T10:54:46.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:46.894+0000 7ff0fa7fc640 1 -- 172.21.15.33:0/1935093885 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff0ec00ac30 con 0x7ff0fc0b4c60 2024-05-08T10:54:46.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:46.894+0000 7ff0fa7fc640 1 --2- 172.21.15.33:0/1935093885 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7ff0e806b4d0 0x7ff0e806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:46.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:46.895+0000 7ff0fa7fc640 1 -- 172.21.15.33:0/1935093885 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff0ec089e80 con 0x7ff0fc0b4c60 2024-05-08T10:54:46.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:46.895+0000 7ff101068640 1 --2- 172.21.15.33:0/1935093885 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7ff0e806b4d0 0x7ff0e806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:46.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:46.895+0000 7ff101068640 1 --2- 172.21.15.33:0/1935093885 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7ff0e806b4d0 0x7ff0e806d990 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc1f75d0 tx=0x7ff0f0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:54:46.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:46.899+0000 7ff0fa7fc640 1 -- 172.21.15.33:0/1935093885 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff0ec059050 con 0x7ff0fc0b4c60 2024-05-08T10:54:47.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.118+0000 7ff103acd640 1 -- 172.21.15.33:0/1935093885 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff0fc0ca500 con 0x7ff0fc0b4c60 2024-05-08T10:54:47.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.118+0000 7ff0fa7fc640 1 -- 172.21.15.33:0/1935093885 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3697 (secure 0 0 0) 0x7ff0ec058950 con 0x7ff0fc0b4c60 2024-05-08T10:54:47.116 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:54:47.116 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4262,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6837/974626320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6835","nonce":974626320},{"type":"v1","addr":"172.21.15.174:6837","nonce":974626320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6834/3541391922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":3541391922},{"type":"v1","addr":"172.21.15.33:6834","nonce":3541391922}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/1492311153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6833","nonce":1492311153},{"type":"v1","addr":"172.21.15.33:6835","nonce":1492311153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4279,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6836/2139245090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2139245090},{"type":"v1","addr":"172.21.15.174:6836","nonce":2139245090}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2024-05-08T10:54:47.116 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 3 2024-05-08T10:54:47.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.120+0000 7ff103acd640 1 -- 172.21.15.33:0/1935093885 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7ff0e806b4d0 msgr2=0x7ff0e806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:47.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.120+0000 7ff103acd640 1 --2- 172.21.15.33:0/1935093885 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7ff0e806b4d0 0x7ff0e806d990 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc1f75d0 tx=0x7ff0f0009040 comp rx=0 tx=0).stop 2024-05-08T10:54:47.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.120+0000 7ff103acd640 1 -- 172.21.15.33:0/1935093885 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff0fc0b4c60 msgr2=0x7ff0fc0cc6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:47.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.120+0000 7ff103acd640 1 --2- 172.21.15.33:0/1935093885 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff0fc0b4c60 0x7ff0fc0cc6d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec00c870 tx=0x7ff0ec00cd30 comp rx=0 tx=0).stop 2024-05-08T10:54:47.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.120+0000 7ff103acd640 1 -- 172.21.15.33:0/1935093885 shutdown_connections 2024-05-08T10:54:47.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.120+0000 7ff103acd640 1 --2- 172.21.15.33:0/1935093885 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7ff0e806b4d0 0x7ff0e806d990 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:47.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.120+0000 7ff103acd640 1 --2- 172.21.15.33:0/1935093885 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff0fc0d0920 0x7ff0fc0b6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:47.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.120+0000 7ff103acd640 1 --2- 172.21.15.33:0/1935093885 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff0fc0d0540 0x7ff0fc15a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:47.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.120+0000 7ff103acd640 1 --2- 172.21.15.33:0/1935093885 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff0fc0b4c60 0x7ff0fc0cc6d0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:47.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.120+0000 7ff103acd640 1 -- 172.21.15.33:0/1935093885 >> 172.21.15.33:0/1935093885 conn(0x7ff0fc0d3ba0 msgr2=0x7ff0fc0d2ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:54:47.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.120+0000 7ff103acd640 1 -- 172.21.15.33:0/1935093885 shutdown_connections 2024-05-08T10:54:47.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.120+0000 7ff103acd640 1 -- 172.21.15.33:0/1935093885 wait complete. 2024-05-08T10:54:47.128 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-08T10:54:47.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.235+0000 7f32b2b16640 1 Processor -- start 2024-05-08T10:54:47.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.235+0000 7f32b2b16640 1 -- start start 2024-05-08T10:54:47.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.235+0000 7f32b2b16640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f32ac06e960 0x7f32ac06f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:47.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.235+0000 7f32b2b16640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f32ac15dfe0 0x7f32ac06f630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:47.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.235+0000 7f32b2b16640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32ac06bd30 con 0x7f32ac15dc00 2024-05-08T10:54:47.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.235+0000 7f32b2b16640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32ac0d0f90 con 0x7f32ac06e960 2024-05-08T10:54:47.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.235+0000 7f32b2b16640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32ac06c010 con 0x7f32ac15dfe0 2024-05-08T10:54:47.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.236+0000 7f32abfff640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f32ac06e960 0x7f32ac06f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:47.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.236+0000 7f32b08b2640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f32ac15dc00 0x7f32ac0d0690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:45404/0 (socket says 172.21.15.33:45404) 2024-05-08T10:54:47.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.236+0000 7f32b08b2640 1 -- 172.21.15.33:0/1147931360 learned_addr learned my addr 172.21.15.33:0/1147931360 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-05-08T10:54:47.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.236+0000 7f32abfff640 1 --2- 172.21.15.33:0/1147931360 >> v2:172.21.15.33:3300/0 conn(0x7f32ac06e960 0x7f32ac06f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46370/0 (socket says 172.21.15.33:46370) 2024-05-08T10:54:47.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.236+0000 7f32b10b3640 1 --2- 172.21.15.33:0/1147931360 >> v2:172.21.15.174:3300/0 conn(0x7f32ac15dfe0 0x7f32ac06f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:47.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.236+0000 7f32abfff640 1 -- 172.21.15.33:0/1147931360 >> v2:172.21.15.174:3300/0 conn(0x7f32ac15dfe0 msgr2=0x7f32ac06f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:54:47.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.236+0000 7f32abfff640 1 --2- 172.21.15.33:0/1147931360 >> v2:172.21.15.174:3300/0 conn(0x7f32ac15dfe0 0x7f32ac06f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:47.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.236+0000 7f32abfff640 1 -- 172.21.15.33:0/1147931360 >> v1:172.21.15.33:6789/0 conn(0x7f32ac15dc00 legacy=0x7f32ac0d0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:47.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.236+0000 7f32ab7fe640 1 -- 172.21.15.33:0/1147931360 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2712561898 0 0) 0x7f32ac06bd30 con 0x7f32ac15dc00 2024-05-08T10:54:47.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.236+0000 7f32abfff640 1 -- 172.21.15.33:0/1147931360 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32ac06c2f0 con 0x7f32ac06e960 2024-05-08T10:54:47.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.237+0000 7f32abfff640 1 --2- 172.21.15.33:0/1147931360 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32ac06e960 0x7f32ac06f0f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f32ac071910 tx=0x7f329802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc645e7b115ff4c2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:54:47.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.237+0000 7f32ab7fe640 1 -- 172.21.15.33:0/1147931360 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3298037070 con 0x7f32ac06e960 2024-05-08T10:54:47.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.237+0000 7f32ab7fe640 1 -- 172.21.15.33:0/1147931360 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3298032440 con 0x7f32ac06e960 2024-05-08T10:54:47.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.237+0000 7f32ab7fe640 1 -- 172.21.15.33:0/1147931360 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3298032810 con 0x7f32ac06e960 2024-05-08T10:54:47.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.237+0000 7f32b2b16640 1 -- 172.21.15.33:0/1147931360 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32ac06e960 msgr2=0x7f32ac06f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:47.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.237+0000 7f32b2b16640 1 --2- 172.21.15.33:0/1147931360 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32ac06e960 0x7f32ac06f0f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f32ac071910 tx=0x7f329802a1a0 comp rx=0 tx=0).stop 2024-05-08T10:54:47.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.237+0000 7f32b2b16640 1 -- 172.21.15.33:0/1147931360 shutdown_connections 2024-05-08T10:54:47.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.237+0000 7f32b2b16640 1 --2- 172.21.15.33:0/1147931360 >> v2:172.21.15.174:3300/0 conn(0x7f32ac15dfe0 0x7f32ac06f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:47.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.237+0000 7f32b2b16640 1 --2- 172.21.15.33:0/1147931360 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32ac06e960 0x7f32ac06f0f0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:47.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.237+0000 7f32b2b16640 1 -- 172.21.15.33:0/1147931360 >> 172.21.15.33:0/1147931360 conn(0x7f32ac0d1940 msgr2=0x7f32ac0d1d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:54:47.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.237+0000 7f32b2b16640 1 -- 172.21.15.33:0/1147931360 shutdown_connections 2024-05-08T10:54:47.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.237+0000 7f32b2b16640 1 -- 172.21.15.33:0/1147931360 wait complete. 2024-05-08T10:54:47.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.238+0000 7f32b2b16640 1 Processor -- start 2024-05-08T10:54:47.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.239+0000 7f32b2b16640 1 -- start start 2024-05-08T10:54:47.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.239+0000 7f32b2b16640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f32ac06e960 0x7f32ac0b6c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:47.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.239+0000 7f32b2b16640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32ac15dc00 0x7f32ac14de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:47.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.239+0000 7f32b2b16640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f32ac15dfe0 0x7f32ac0b13a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:47.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.239+0000 7f32b2b16640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32ac06cc70 con 0x7f32ac15dc00 2024-05-08T10:54:47.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.239+0000 7f32b2b16640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32ac06caf0 con 0x7f32ac15dfe0 2024-05-08T10:54:47.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.239+0000 7f32b2b16640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32ac06cdf0 con 0x7f32ac06e960 2024-05-08T10:54:47.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.239+0000 7f32abfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32ac15dc00 0x7f32ac14de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:47.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.239+0000 7f32abfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32ac15dc00 0x7f32ac14de30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46374/0 (socket says 172.21.15.33:46374) 2024-05-08T10:54:47.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.240+0000 7f32abfff640 1 -- 172.21.15.33:0/708959043 learned_addr learned my addr 172.21.15.33:0/708959043 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:54:47.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.240+0000 7f32b10b3640 1 --2- 172.21.15.33:0/708959043 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f32ac15dfe0 0x7f32ac0b13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:47.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.240+0000 7f32b08b2640 1 --2- 172.21.15.33:0/708959043 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f32ac06e960 0x7f32ac0b6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:47.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.240+0000 7f32abfff640 1 -- 172.21.15.33:0/708959043 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f32ac06e960 msgr2=0x7f32ac0b6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:47.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.240+0000 7f32abfff640 1 --2- 172.21.15.33:0/708959043 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f32ac06e960 0x7f32ac0b6c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:47.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.240+0000 7f32abfff640 1 -- 172.21.15.33:0/708959043 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f32ac15dfe0 msgr2=0x7f32ac0b13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:47.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.240+0000 7f32abfff640 1 --2- 172.21.15.33:0/708959043 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f32ac15dfe0 0x7f32ac0b13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:47.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.240+0000 7f32abfff640 1 -- 172.21.15.33:0/708959043 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32ac14e370 con 0x7f32ac15dc00 2024-05-08T10:54:47.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.240+0000 7f32b10b3640 1 --2- 172.21.15.33:0/708959043 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f32ac15dfe0 0x7f32ac0b13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:54:47.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.240+0000 7f32abfff640 1 --2- 172.21.15.33:0/708959043 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32ac15dc00 0x7f32ac14de30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3298009890 tx=0x7f32980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:54:47.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.240+0000 7f32a97fa640 1 -- 172.21.15.33:0/708959043 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3298037040 con 0x7f32ac15dc00 2024-05-08T10:54:47.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.240+0000 7f32a97fa640 1 -- 172.21.15.33:0/708959043 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3298042070 con 0x7f32ac15dc00 2024-05-08T10:54:47.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.240+0000 7f32b2b16640 1 -- 172.21.15.33:0/708959043 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32ac0b5450 con 0x7f32ac15dc00 2024-05-08T10:54:47.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.240+0000 7f32a97fa640 1 -- 172.21.15.33:0/708959043 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3298030920 con 0x7f32ac15dc00 2024-05-08T10:54:47.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.240+0000 7f32b2b16640 1 -- 172.21.15.33:0/708959043 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32ac0b6450 con 0x7f32ac15dc00 2024-05-08T10:54:47.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.241+0000 7f32b2b16640 1 -- 172.21.15.33:0/708959043 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32ac069d20 con 0x7f32ac15dc00 2024-05-08T10:54:47.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.242+0000 7f32a97fa640 1 -- 172.21.15.33:0/708959043 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3298030ac0 con 0x7f32ac15dc00 2024-05-08T10:54:47.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.242+0000 7f32a97fa640 1 --2- 172.21.15.33:0/708959043 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f329006b4d0 0x7f329006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:47.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.242+0000 7f32a97fa640 1 -- 172.21.15.33:0/708959043 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f32980aa790 con 0x7f32ac15dc00 2024-05-08T10:54:47.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.242+0000 7f32b08b2640 1 --2- 172.21.15.33:0/708959043 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f329006b4d0 0x7f329006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:47.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.243+0000 7f32b08b2640 1 --2- 172.21.15.33:0/708959043 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f329006b4d0 0x7f329006d990 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f32a0000f60 tx=0x7f32a0007b50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:54:47.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.246+0000 7f32a97fa640 1 -- 172.21.15.33:0/708959043 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f32980793a0 con 0x7f32ac15dc00 2024-05-08T10:54:47.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.426+0000 7f32b2b16640 1 -- 172.21.15.33:0/708959043 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f32ac0b78c0 con 0x7f32ac15dc00 2024-05-08T10:54:47.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.427+0000 7f32a97fa640 1 -- 172.21.15.33:0/708959043 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+65 (secure 0 0 0) 0x7f329807d440 con 0x7f32ac15dc00 2024-05-08T10:54:47.424 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:54:47.424 INFO:teuthology.orchestra.run.smithi033.stdout:[ 2024-05-08T10:54:47.425 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T10:54:47.425 INFO:teuthology.orchestra.run.smithi033.stdout: "poolnum": 1, 2024-05-08T10:54:47.425 INFO:teuthology.orchestra.run.smithi033.stdout: "poolname": ".mgr" 2024-05-08T10:54:47.425 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T10:54:47.425 INFO:teuthology.orchestra.run.smithi033.stdout:] 2024-05-08T10:54:47.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.429+0000 7f32b2b16640 1 -- 172.21.15.33:0/708959043 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f329006b4d0 msgr2=0x7f329006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:47.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.429+0000 7f32b2b16640 1 --2- 172.21.15.33:0/708959043 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f329006b4d0 0x7f329006d990 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f32a0000f60 tx=0x7f32a0007b50 comp rx=0 tx=0).stop 2024-05-08T10:54:47.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.429+0000 7f32b2b16640 1 -- 172.21.15.33:0/708959043 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32ac15dc00 msgr2=0x7f32ac14de30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:47.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.429+0000 7f32b2b16640 1 --2- 172.21.15.33:0/708959043 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32ac15dc00 0x7f32ac14de30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3298009890 tx=0x7f32980046c0 comp rx=0 tx=0).stop 2024-05-08T10:54:47.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.429+0000 7f32b2b16640 1 -- 172.21.15.33:0/708959043 shutdown_connections 2024-05-08T10:54:47.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.429+0000 7f32b2b16640 1 --2- 172.21.15.33:0/708959043 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f329006b4d0 0x7f329006d990 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:47.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.429+0000 7f32b2b16640 1 --2- 172.21.15.33:0/708959043 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f32ac15dfe0 0x7f32ac0b13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:47.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.429+0000 7f32b2b16640 1 --2- 172.21.15.33:0/708959043 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32ac15dc00 0x7f32ac14de30 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:47.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.429+0000 7f32b2b16640 1 --2- 172.21.15.33:0/708959043 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f32ac06e960 0x7f32ac0b6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:47.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.429+0000 7f32b2b16640 1 -- 172.21.15.33:0/708959043 >> 172.21.15.33:0/708959043 conn(0x7f32ac0d1940 msgr2=0x7f32ac0d1d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:54:47.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.429+0000 7f32b2b16640 1 -- 172.21.15.33:0/708959043 shutdown_connections 2024-05-08T10:54:47.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.429+0000 7f32b2b16640 1 -- 172.21.15.33:0/708959043 wait complete. 2024-05-08T10:54:47.437 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-08T10:54:47.437 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-08T10:54:47.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.548+0000 7f52dd1a9640 1 Processor -- start 2024-05-08T10:54:47.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.548+0000 7f52dd1a9640 1 -- start start 2024-05-08T10:54:47.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.549+0000 7f52dd1a9640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f52d815e150 0x7f52d80b3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:47.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.549+0000 7f52dd1a9640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f52d80d0a80 0x7f52d80b5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:47.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.549+0000 7f52dd1a9640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52d80d4a60 con 0x7f52d80b2e80 2024-05-08T10:54:47.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.549+0000 7f52dd1a9640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52d80ce960 con 0x7f52d815e150 2024-05-08T10:54:47.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.549+0000 7f52dd1a9640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52d80d2530 con 0x7f52d80d0a80 2024-05-08T10:54:47.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.549+0000 7f52cffff640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f52d80b2e80 0x7f52d80d0370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:45416/0 (socket says 172.21.15.33:45416) 2024-05-08T10:54:47.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.549+0000 7f52cffff640 1 -- 172.21.15.33:0/3332870797 learned_addr learned my addr 172.21.15.33:0/3332870797 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-05-08T10:54:47.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.549+0000 7f52d6d9d640 1 --2- 172.21.15.33:0/3332870797 >> v2:172.21.15.174:3300/0 conn(0x7f52d815e150 0x7f52d80b3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:47.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.549+0000 7f52d759e640 1 --2- 172.21.15.33:0/3332870797 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f52d80d0a80 0x7f52d80b5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:47.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.549+0000 7f52d659c640 1 -- 172.21.15.33:0/3332870797 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3939537872 0 0) 0x7f52d80d4a60 con 0x7f52d80b2e80 2024-05-08T10:54:47.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.550+0000 7f52d659c640 1 -- 172.21.15.33:0/3332870797 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52c4003520 con 0x7f52d80b2e80 2024-05-08T10:54:47.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.550+0000 7f52d659c640 1 -- 172.21.15.33:0/3332870797 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3348016300 0 0) 0x7f52c4003520 con 0x7f52d80b2e80 2024-05-08T10:54:47.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.550+0000 7f52d659c640 1 -- 172.21.15.33:0/3332870797 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f52d80d0a80 msgr2=0x7f52d80b5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:54:47.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.550+0000 7f52d659c640 1 --2- 172.21.15.33:0/3332870797 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f52d80d0a80 0x7f52d80b5090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:47.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.550+0000 7f52d659c640 1 -- 172.21.15.33:0/3332870797 >> v2:172.21.15.174:3300/0 conn(0x7f52d815e150 msgr2=0x7f52d80b3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:54:47.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.550+0000 7f52d659c640 1 --2- 172.21.15.33:0/3332870797 >> v2:172.21.15.174:3300/0 conn(0x7f52d815e150 0x7f52d80b3280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:47.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.550+0000 7f52d659c640 1 -- 172.21.15.33:0/3332870797 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52d80d2810 con 0x7f52d80b2e80 2024-05-08T10:54:47.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.550+0000 7f52d659c640 1 -- 172.21.15.33:0/3332870797 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2948294915 0 0) 0x7f52c0001670 con 0x7f52d80b2e80 2024-05-08T10:54:47.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.550+0000 7f52d659c640 1 -- 172.21.15.33:0/3332870797 >> v1:172.21.15.33:6789/0 conn(0x7f52d80b2e80 legacy=0x7f52d80d0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:47.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.550+0000 7f52d659c640 1 --2- 172.21.15.33:0/3332870797 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f52c40039b0 0x7f52c4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:47.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.550+0000 7f52d659c640 1 --2- 172.21.15.33:0/3332870797 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f52c40043a0 0x7f52c4004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:47.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.550+0000 7f52d659c640 1 --2- 172.21.15.33:0/3332870797 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f52c4004fa0 0x7f52c400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:47.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.550+0000 7f52d659c640 1 -- 172.21.15.33:0/3332870797 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d80ce960 con 0x7f52c4004fa0 2024-05-08T10:54:47.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.550+0000 7f52d659c640 1 -- 172.21.15.33:0/3332870797 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d80d2530 con 0x7f52c40043a0 2024-05-08T10:54:47.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.550+0000 7f52d659c640 1 -- 172.21.15.33:0/3332870797 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52c400bf30 con 0x7f52c40039b0 2024-05-08T10:54:47.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.550+0000 7f52d759e640 1 --2- 172.21.15.33:0/3332870797 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f52d80d0a80 0x7f52d80b5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:54:47.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.550+0000 7f52cffff640 1 --2- 172.21.15.33:0/3332870797 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f52c40043a0 0x7f52c4004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:47.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.550+0000 7f52d6d9d640 1 --2- 172.21.15.33:0/3332870797 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f52c40039b0 0x7f52c4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:47.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.550+0000 7f52d759e640 1 --2- 172.21.15.33:0/3332870797 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f52c4004fa0 0x7f52c400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:47.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.550+0000 7f52d759e640 1 -- 172.21.15.33:0/3332870797 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f52c40039b0 msgr2=0x7f52c4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:54:47.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.550+0000 7f52d759e640 1 --2- 172.21.15.33:0/3332870797 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f52c40039b0 0x7f52c4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:47.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.550+0000 7f52d759e640 1 -- 172.21.15.33:0/3332870797 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f52c40043a0 msgr2=0x7f52c4004880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:54:47.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.550+0000 7f52d759e640 1 --2- 172.21.15.33:0/3332870797 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f52c40043a0 0x7f52c4004880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:47.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.550+0000 7f52d759e640 1 -- 172.21.15.33:0/3332870797 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52c4003520 con 0x7f52c4004fa0 2024-05-08T10:54:47.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.551+0000 7f52d759e640 1 --2- 172.21.15.33:0/3332870797 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f52c4004fa0 0x7f52c400b9c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f52d8162f80 tx=0x7f52c4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b43ef576521d05 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:54:47.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.551+0000 7f52d659c640 1 -- 172.21.15.33:0/3332870797 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52d0009b50 con 0x7f52c4004fa0 2024-05-08T10:54:47.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.551+0000 7f52d659c640 1 -- 172.21.15.33:0/3332870797 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52d0003b90 con 0x7f52c4004fa0 2024-05-08T10:54:47.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.551+0000 7f52d659c640 1 -- 172.21.15.33:0/3332870797 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52d0004030 con 0x7f52c4004fa0 2024-05-08T10:54:47.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.552+0000 7f52dd1a9640 1 -- 172.21.15.33:0/3332870797 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f52c4004fa0 msgr2=0x7f52c400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:47.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.552+0000 7f52dd1a9640 1 --2- 172.21.15.33:0/3332870797 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f52c4004fa0 0x7f52c400b9c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f52d8162f80 tx=0x7f52c4005830 comp rx=0 tx=0).stop 2024-05-08T10:54:47.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.552+0000 7f52d759e640 1 -- 172.21.15.33:0/3332870797 reap_dead start 2024-05-08T10:54:47.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.552+0000 7f52dd1a9640 1 -- 172.21.15.33:0/3332870797 shutdown_connections 2024-05-08T10:54:47.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.552+0000 7f52dd1a9640 1 -- 172.21.15.33:0/3332870797 >> 172.21.15.33:0/3332870797 conn(0x7f52d80d3b80 msgr2=0x7f52d80d3f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:54:47.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.552+0000 7f52dd1a9640 1 -- 172.21.15.33:0/3332870797 shutdown_connections 2024-05-08T10:54:47.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.552+0000 7f52dd1a9640 1 -- 172.21.15.33:0/3332870797 wait complete. 2024-05-08T10:54:47.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.553+0000 7f52dd1a9640 1 Processor -- start 2024-05-08T10:54:47.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.553+0000 7f52dd1a9640 1 -- start start 2024-05-08T10:54:47.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.554+0000 7f52dd1a9640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f52c4004fa0 0x7f52d80cac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:47.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.554+0000 7f52dd1a9640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f52d8152540 0x7f52d8160eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:47.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.554+0000 7f52dd1a9640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f52d814eba0 0x7f52d814f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:47.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.554+0000 7f52dd1a9640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d80d4820 con 0x7f52d814eba0 2024-05-08T10:54:47.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.554+0000 7f52dd1a9640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d80d46a0 con 0x7f52d8152540 2024-05-08T10:54:47.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.554+0000 7f52dd1a9640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52d815e530 con 0x7f52c4004fa0 2024-05-08T10:54:47.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.554+0000 7f52d759e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f52d814eba0 0x7f52d814f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:47.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.554+0000 7f52d759e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f52d814eba0 0x7f52d814f020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46378/0 (socket says 172.21.15.33:46378) 2024-05-08T10:54:47.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.554+0000 7f52d759e640 1 -- 172.21.15.33:0/663454423 learned_addr learned my addr 172.21.15.33:0/663454423 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:54:47.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.554+0000 7f52d6d9d640 1 --2- 172.21.15.33:0/663454423 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f52c4004fa0 0x7f52d80cac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:47.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.554+0000 7f52cffff640 1 --2- 172.21.15.33:0/663454423 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f52d8152540 0x7f52d8160eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:47.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.554+0000 7f52d759e640 1 -- 172.21.15.33:0/663454423 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f52c4004fa0 msgr2=0x7f52d80cac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:47.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.554+0000 7f52d759e640 1 --2- 172.21.15.33:0/663454423 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f52c4004fa0 0x7f52d80cac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:47.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.554+0000 7f52d759e640 1 -- 172.21.15.33:0/663454423 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f52d8152540 msgr2=0x7f52d8160eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:47.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.554+0000 7f52d759e640 1 --2- 172.21.15.33:0/663454423 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f52d8152540 0x7f52d8160eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:47.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.554+0000 7f52d759e640 1 -- 172.21.15.33:0/663454423 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52d80cb190 con 0x7f52d814eba0 2024-05-08T10:54:47.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.554+0000 7f52d6d9d640 1 --2- 172.21.15.33:0/663454423 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f52c4004fa0 0x7f52d80cac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:54:47.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.554+0000 7f52cffff640 1 --2- 172.21.15.33:0/663454423 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f52d8152540 0x7f52d8160eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:54:47.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.554+0000 7f52d759e640 1 --2- 172.21.15.33:0/663454423 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f52d814eba0 0x7f52d814f020 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f52d0004930 tx=0x7f52d0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:54:47.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.555+0000 7f52cf7fe640 1 -- 172.21.15.33:0/663454423 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52d0003990 con 0x7f52d814eba0 2024-05-08T10:54:47.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.555+0000 7f52cf7fe640 1 -- 172.21.15.33:0/663454423 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52d003d430 con 0x7f52d814eba0 2024-05-08T10:54:47.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.555+0000 7f52cf7fe640 1 -- 172.21.15.33:0/663454423 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52d003d620 con 0x7f52d814eba0 2024-05-08T10:54:47.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.555+0000 7f52dd1a9640 1 -- 172.21.15.33:0/663454423 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52d80cb460 con 0x7f52d814eba0 2024-05-08T10:54:47.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.555+0000 7f52dd1a9640 1 -- 172.21.15.33:0/663454423 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52d80cba20 con 0x7f52d814eba0 2024-05-08T10:54:47.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.556+0000 7f52dd1a9640 1 -- 172.21.15.33:0/663454423 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52d8069d20 con 0x7f52d814eba0 2024-05-08T10:54:47.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.556+0000 7f52cf7fe640 1 -- 172.21.15.33:0/663454423 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f52d0044020 con 0x7f52d814eba0 2024-05-08T10:54:47.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.557+0000 7f52cf7fe640 1 --2- 172.21.15.33:0/663454423 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f52b806b4d0 0x7f52b806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:47.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.557+0000 7f52cf7fe640 1 -- 172.21.15.33:0/663454423 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f52d00a9cc0 con 0x7f52d814eba0 2024-05-08T10:54:47.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.557+0000 7f52d6d9d640 1 --2- 172.21.15.33:0/663454423 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f52b806b4d0 0x7f52b806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:47.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.558+0000 7f52d6d9d640 1 --2- 172.21.15.33:0/663454423 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f52b806b4d0 0x7f52b806d990 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f52c8009bc0 tx=0x7f52c8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:54:47.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.561+0000 7f52cf7fe640 1 -- 172.21.15.33:0/663454423 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f52d004b020 con 0x7f52d814eba0 2024-05-08T10:54:47.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:47.742+0000 7f52dd1a9640 1 -- 172.21.15.33:0/663454423 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f52d808dbd0 con 0x7f52d814eba0 2024-05-08T10:54:48.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:48.508+0000 7f52cf7fe640 1 -- 172.21.15.33:0/663454423 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7f52d0031070 con 0x7f52d814eba0 2024-05-08T10:54:48.506 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_metadata' created 2024-05-08T10:54:48.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:48.512+0000 7f52dd1a9640 1 -- 172.21.15.33:0/663454423 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f52b806b4d0 msgr2=0x7f52b806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:48.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:48.512+0000 7f52dd1a9640 1 --2- 172.21.15.33:0/663454423 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f52b806b4d0 0x7f52b806d990 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f52c8009bc0 tx=0x7f52c8008040 comp rx=0 tx=0).stop 2024-05-08T10:54:48.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:48.512+0000 7f52dd1a9640 1 -- 172.21.15.33:0/663454423 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f52d814eba0 msgr2=0x7f52d814f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:48.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:48.512+0000 7f52dd1a9640 1 --2- 172.21.15.33:0/663454423 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f52d814eba0 0x7f52d814f020 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f52d0004930 tx=0x7f52d0004a40 comp rx=0 tx=0).stop 2024-05-08T10:54:48.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:48.512+0000 7f52dd1a9640 1 -- 172.21.15.33:0/663454423 shutdown_connections 2024-05-08T10:54:48.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:48.512+0000 7f52dd1a9640 1 --2- 172.21.15.33:0/663454423 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f52b806b4d0 0x7f52b806d990 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:48.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:48.512+0000 7f52dd1a9640 1 --2- 172.21.15.33:0/663454423 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f52d814eba0 0x7f52d814f020 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:48.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:48.512+0000 7f52dd1a9640 1 --2- 172.21.15.33:0/663454423 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f52d8152540 0x7f52d8160eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:48.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:48.512+0000 7f52dd1a9640 1 --2- 172.21.15.33:0/663454423 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f52c4004fa0 0x7f52d80cac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:48.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:48.512+0000 7f52dd1a9640 1 -- 172.21.15.33:0/663454423 >> 172.21.15.33:0/663454423 conn(0x7f52d80d3b80 msgr2=0x7f52d80b0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:54:48.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:48.512+0000 7f52dd1a9640 1 -- 172.21.15.33:0/663454423 shutdown_connections 2024-05-08T10:54:48.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:48.512+0000 7f52dd1a9640 1 -- 172.21.15.33:0/663454423 wait complete. 2024-05-08T10:54:48.526 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-08T10:54:48.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:48.645+0000 7f7bafcbd640 1 Processor -- start 2024-05-08T10:54:48.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:48.645+0000 7f7bafcbd640 1 -- start start 2024-05-08T10:54:48.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:48.646+0000 7f7bafcbd640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f7ba80b4320 0x7f7ba80d4510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:48.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:48.646+0000 7f7bafcbd640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f7ba80d0c20 0x7f7ba80d1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:48.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:48.646+0000 7f7bafcbd640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ba80cfb90 con 0x7f7ba80b33b0 2024-05-08T10:54:48.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:48.646+0000 7f7bafcbd640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ba80d4a50 con 0x7f7ba80b4320 2024-05-08T10:54:48.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:48.646+0000 7f7bafcbd640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ba80cf5d0 con 0x7f7ba80d0c20 2024-05-08T10:54:48.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:48.646+0000 7f7bada59640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f7ba80b4320 0x7f7ba80d4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:48.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:48.646+0000 7f7bada59640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f7ba80b4320 0x7f7ba80d4510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46380/0 (socket says 172.21.15.33:46380) 2024-05-08T10:54:48.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:48.646+0000 7f7bada59640 1 -- 172.21.15.33:0/963329310 learned_addr learned my addr 172.21.15.33:0/963329310 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:54:48.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:48.646+0000 7f7bad258640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f7ba80b33b0 0x7f7ba80d0510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:45432/0 (socket says 172.21.15.33:45432) 2024-05-08T10:54:48.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:48.647+0000 7f7bada59640 1 -- 172.21.15.33:0/963329310 >> v2:172.21.15.174:3300/0 conn(0x7f7ba80d0c20 msgr2=0x7f7ba80d1fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:54:48.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:48.647+0000 7f7bada59640 1 --2- 172.21.15.33:0/963329310 >> v2:172.21.15.174:3300/0 conn(0x7f7ba80d0c20 0x7f7ba80d1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:48.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:48.647+0000 7f7bada59640 1 -- 172.21.15.33:0/963329310 >> v1:172.21.15.33:6789/0 conn(0x7f7ba80b33b0 legacy=0x7f7ba80d0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:48.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:48.647+0000 7f7bada59640 1 -- 172.21.15.33:0/963329310 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ba80cf8b0 con 0x7f7ba80b4320 2024-05-08T10:54:48.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:48.647+0000 7f7baca57640 1 -- 172.21.15.33:0/963329310 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2392657233 0 0) 0x7f7ba80cfb90 con 0x7f7ba80b33b0 2024-05-08T10:54:48.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:48.647+0000 7f7bada59640 1 --2- 172.21.15.33:0/963329310 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7ba80b4320 0x7f7ba80d4510 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7ba8068980 tx=0x7f7ba402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f707de086ee95e2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:54:48.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:48.647+0000 7f7baca57640 1 -- 172.21.15.33:0/963329310 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ba4036070 con 0x7f7ba80b4320 2024-05-08T10:54:48.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:48.648+0000 7f7baca57640 1 -- 172.21.15.33:0/963329310 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ba4031600 con 0x7f7ba80b4320 2024-05-08T10:54:48.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:48.648+0000 7f7baca57640 1 -- 172.21.15.33:0/963329310 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ba40319d0 con 0x7f7ba80b4320 2024-05-08T10:54:48.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:48.648+0000 7f7bafcbd640 1 -- 172.21.15.33:0/963329310 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7ba80b4320 msgr2=0x7f7ba80d4510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:48.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:48.648+0000 7f7bafcbd640 1 --2- 172.21.15.33:0/963329310 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7ba80b4320 0x7f7ba80d4510 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7ba8068980 tx=0x7f7ba402a730 comp rx=0 tx=0).stop 2024-05-08T10:54:48.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:48.648+0000 7f7bafcbd640 1 -- 172.21.15.33:0/963329310 shutdown_connections 2024-05-08T10:54:48.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:48.648+0000 7f7bafcbd640 1 --2- 172.21.15.33:0/963329310 >> v2:172.21.15.174:3300/0 conn(0x7f7ba80d0c20 0x7f7ba80d1fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:48.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:48.648+0000 7f7bafcbd640 1 --2- 172.21.15.33:0/963329310 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7ba80b4320 0x7f7ba80d4510 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:48.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:48.648+0000 7f7bafcbd640 1 -- 172.21.15.33:0/963329310 >> 172.21.15.33:0/963329310 conn(0x7f7ba809ce90 msgr2=0x7f7ba80d3b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:54:48.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:48.648+0000 7f7bafcbd640 1 -- 172.21.15.33:0/963329310 shutdown_connections 2024-05-08T10:54:48.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:48.648+0000 7f7bafcbd640 1 -- 172.21.15.33:0/963329310 wait complete. 2024-05-08T10:54:48.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:48.649+0000 7f7bafcbd640 1 Processor -- start 2024-05-08T10:54:48.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:48.649+0000 7f7bafcbd640 1 -- start start 2024-05-08T10:54:48.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:48.650+0000 7f7bafcbd640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7ba80b33b0 0x7f7ba80b92b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:48.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:48.650+0000 7f7bafcbd640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7ba80b4320 0x7f7ba815db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:48.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:48.650+0000 7f7bafcbd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7ba80d0c20 0x7f7ba80c8550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:48.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:48.650+0000 7f7bafcbd640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba80b3860 con 0x7f7ba80d0c20 2024-05-08T10:54:48.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:48.650+0000 7f7bafcbd640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba80d1a90 con 0x7f7ba80b33b0 2024-05-08T10:54:48.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:48.650+0000 7f7bafcbd640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba80b4ca0 con 0x7f7ba80b4320 2024-05-08T10:54:48.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:48.650+0000 7f7bae25a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7ba80d0c20 0x7f7ba80c8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:48.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:48.650+0000 7f7bae25a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7ba80d0c20 0x7f7ba80c8550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46390/0 (socket says 172.21.15.33:46390) 2024-05-08T10:54:48.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:48.650+0000 7f7bae25a640 1 -- 172.21.15.33:0/276675599 learned_addr learned my addr 172.21.15.33:0/276675599 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:54:48.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:48.650+0000 7f7bada59640 1 --2- 172.21.15.33:0/276675599 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7ba80b33b0 0x7f7ba80b92b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:48.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:48.650+0000 7f7bad258640 1 --2- 172.21.15.33:0/276675599 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7ba80b4320 0x7f7ba815db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:48.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:48.651+0000 7f7bae25a640 1 -- 172.21.15.33:0/276675599 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7ba80b4320 msgr2=0x7f7ba815db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:48.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:48.651+0000 7f7bae25a640 1 --2- 172.21.15.33:0/276675599 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7ba80b4320 0x7f7ba815db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:48.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:48.651+0000 7f7bae25a640 1 -- 172.21.15.33:0/276675599 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7ba80b33b0 msgr2=0x7f7ba80b92b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:48.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:48.651+0000 7f7bae25a640 1 --2- 172.21.15.33:0/276675599 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7ba80b33b0 0x7f7ba80b92b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:48.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:48.651+0000 7f7bae25a640 1 -- 172.21.15.33:0/276675599 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ba80c8da0 con 0x7f7ba80d0c20 2024-05-08T10:54:48.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:48.651+0000 7f7bada59640 1 --2- 172.21.15.33:0/276675599 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7ba80b33b0 0x7f7ba80b92b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:54:48.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:48.651+0000 7f7bae25a640 1 --2- 172.21.15.33:0/276675599 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7ba80d0c20 0x7f7ba80c8550 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7ba0009fd0 tx=0x7f7ba000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:54:48.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:48.651+0000 7f7b9e7fc640 1 -- 172.21.15.33:0/276675599 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ba0011830 con 0x7f7ba80d0c20 2024-05-08T10:54:48.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:48.651+0000 7f7b9e7fc640 1 -- 172.21.15.33:0/276675599 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ba0016070 con 0x7f7ba80d0c20 2024-05-08T10:54:48.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:48.651+0000 7f7bafcbd640 1 -- 172.21.15.33:0/276675599 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ba80c9080 con 0x7f7ba80d0c20 2024-05-08T10:54:48.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:48.651+0000 7f7b9e7fc640 1 -- 172.21.15.33:0/276675599 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ba0011bf0 con 0x7f7ba80d0c20 2024-05-08T10:54:48.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:48.651+0000 7f7bafcbd640 1 -- 172.21.15.33:0/276675599 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ba80b6b10 con 0x7f7ba80d0c20 2024-05-08T10:54:48.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:48.652+0000 7f7bafcbd640 1 -- 172.21.15.33:0/276675599 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ba8069d20 con 0x7f7ba80d0c20 2024-05-08T10:54:48.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:48.653+0000 7f7b9e7fc640 1 -- 172.21.15.33:0/276675599 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7ba001b460 con 0x7f7ba80d0c20 2024-05-08T10:54:48.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:48.653+0000 7f7b9e7fc640 1 --2- 172.21.15.33:0/276675599 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f7b8c06b4d0 0x7f7b8c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:48.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:48.653+0000 7f7b9e7fc640 1 -- 172.21.15.33:0/276675599 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f7ba0089cc0 con 0x7f7ba80d0c20 2024-05-08T10:54:48.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:48.654+0000 7f7bada59640 1 --2- 172.21.15.33:0/276675599 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f7b8c06b4d0 0x7f7b8c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:48.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:48.654+0000 7f7bada59640 1 --2- 172.21.15.33:0/276675599 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f7b8c06b4d0 0x7f7b8c06d990 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7ba4033000 tx=0x7f7ba4009000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:54:48.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:48.658+0000 7f7b9e7fc640 1 -- 172.21.15.33:0/276675599 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7ba0058db0 con 0x7f7ba80d0c20 2024-05-08T10:54:48.835 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:48.838+0000 7f7bafcbd640 1 -- 172.21.15.33:0/276675599 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f7ba80c7920 con 0x7f7ba80d0c20 2024-05-08T10:54:49.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:49.513+0000 7f7b9e7fc640 1 -- 172.21.15.33:0/276675599 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) v1 ==== 170+0+0 (secure 0 0 0) 0x7f7ba00586b0 con 0x7f7ba80d0c20 2024-05-08T10:54:49.513 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_data' created 2024-05-08T10:54:49.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:49.516+0000 7f7bafcbd640 1 -- 172.21.15.33:0/276675599 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f7b8c06b4d0 msgr2=0x7f7b8c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:49.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:49.516+0000 7f7bafcbd640 1 --2- 172.21.15.33:0/276675599 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f7b8c06b4d0 0x7f7b8c06d990 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7ba4033000 tx=0x7f7ba4009000 comp rx=0 tx=0).stop 2024-05-08T10:54:49.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:49.516+0000 7f7bafcbd640 1 -- 172.21.15.33:0/276675599 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7ba80d0c20 msgr2=0x7f7ba80c8550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:49.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:49.516+0000 7f7bafcbd640 1 --2- 172.21.15.33:0/276675599 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7ba80d0c20 0x7f7ba80c8550 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7ba0009fd0 tx=0x7f7ba000b8e0 comp rx=0 tx=0).stop 2024-05-08T10:54:49.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:49.516+0000 7f7bafcbd640 1 -- 172.21.15.33:0/276675599 shutdown_connections 2024-05-08T10:54:49.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:49.516+0000 7f7bafcbd640 1 --2- 172.21.15.33:0/276675599 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f7b8c06b4d0 0x7f7b8c06d990 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:49.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:49.516+0000 7f7bafcbd640 1 --2- 172.21.15.33:0/276675599 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7ba80d0c20 0x7f7ba80c8550 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:49.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:49.516+0000 7f7bafcbd640 1 --2- 172.21.15.33:0/276675599 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7ba80b4320 0x7f7ba815db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:49.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:49.516+0000 7f7bafcbd640 1 --2- 172.21.15.33:0/276675599 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7ba80b33b0 0x7f7ba80b92b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:49.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:49.516+0000 7f7bafcbd640 1 -- 172.21.15.33:0/276675599 >> 172.21.15.33:0/276675599 conn(0x7f7ba809ce90 msgr2=0x7f7ba806c150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:54:49.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:49.516+0000 7f7bafcbd640 1 -- 172.21.15.33:0/276675599 shutdown_connections 2024-05-08T10:54:49.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:49.516+0000 7f7bafcbd640 1 -- 172.21.15.33:0/276675599 wait complete. 2024-05-08T10:54:49.540 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-08T10:54:49.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:49.653+0000 7fee1f589640 1 Processor -- start 2024-05-08T10:54:49.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:49.654+0000 7fee1f589640 1 -- start start 2024-05-08T10:54:49.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:49.654+0000 7fee1f589640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fee18161600 0x7fee180d46f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:49.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:49.654+0000 7fee1f589640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fee180cf2b0 0x7fee180d0110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:49.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:49.654+0000 7fee1f589640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fee180d0650 0x7fee180d1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:49.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:49.654+0000 7fee1f589640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee180d0a80 con 0x7fee180cf2b0 2024-05-08T10:54:49.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:49.654+0000 7fee1f589640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee180cfd30 con 0x7fee18161600 2024-05-08T10:54:49.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:49.654+0000 7fee1f589640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee180cf770 con 0x7fee180d0650 2024-05-08T10:54:49.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:49.655+0000 7fee1cb24640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fee180cf2b0 0x7fee180d0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:49.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:49.655+0000 7fee1cb24640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fee180cf2b0 0x7fee180d0110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46398/0 (socket says 172.21.15.33:46398) 2024-05-08T10:54:49.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:49.655+0000 7fee1cb24640 1 -- 172.21.15.33:0/1179877225 learned_addr learned my addr 172.21.15.33:0/1179877225 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:54:49.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:49.655+0000 7fee1d325640 1 --2- 172.21.15.33:0/1179877225 >> v2:172.21.15.174:3300/0 conn(0x7fee18161600 0x7fee180d46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:49.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:49.655+0000 7fee1db26640 1 --2- 172.21.15.33:0/1179877225 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fee180d0650 0x7fee180d1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:49.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:49.655+0000 7fee1cb24640 1 -- 172.21.15.33:0/1179877225 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fee180d0650 msgr2=0x7fee180d1ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:54:49.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:49.655+0000 7fee1cb24640 1 --2- 172.21.15.33:0/1179877225 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fee180d0650 0x7fee180d1ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:49.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:49.655+0000 7fee1cb24640 1 -- 172.21.15.33:0/1179877225 >> v2:172.21.15.174:3300/0 conn(0x7fee18161600 msgr2=0x7fee180d46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:54:49.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:49.655+0000 7fee1cb24640 1 --2- 172.21.15.33:0/1179877225 >> v2:172.21.15.174:3300/0 conn(0x7fee18161600 0x7fee180d46f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:49.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:49.655+0000 7fee1cb24640 1 -- 172.21.15.33:0/1179877225 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee180cfa50 con 0x7fee180cf2b0 2024-05-08T10:54:49.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:49.655+0000 7fee1d325640 1 --2- 172.21.15.33:0/1179877225 >> v2:172.21.15.174:3300/0 conn(0x7fee18161600 0x7fee180d46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:54:49.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:49.656+0000 7fee1cb24640 1 --2- 172.21.15.33:0/1179877225 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee180cf2b0 0x7fee180d0110 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fee1808cb10 tx=0x7fee0802a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebc1906832e638 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:54:49.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:49.656+0000 7fee0ffff640 1 -- 172.21.15.33:0/1179877225 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee08037070 con 0x7fee180cf2b0 2024-05-08T10:54:49.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:49.656+0000 7fee0ffff640 1 -- 172.21.15.33:0/1179877225 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee08032440 con 0x7fee180cf2b0 2024-05-08T10:54:49.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:49.656+0000 7fee0ffff640 1 -- 172.21.15.33:0/1179877225 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee08032810 con 0x7fee180cf2b0 2024-05-08T10:54:49.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:49.656+0000 7fee1f589640 1 -- 172.21.15.33:0/1179877225 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee180cf2b0 msgr2=0x7fee180d0110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:49.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:49.656+0000 7fee1f589640 1 --2- 172.21.15.33:0/1179877225 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee180cf2b0 0x7fee180d0110 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fee1808cb10 tx=0x7fee0802a2a0 comp rx=0 tx=0).stop 2024-05-08T10:54:49.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:49.656+0000 7fee1f589640 1 -- 172.21.15.33:0/1179877225 shutdown_connections 2024-05-08T10:54:49.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:49.656+0000 7fee1f589640 1 --2- 172.21.15.33:0/1179877225 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fee180d0650 0x7fee180d1ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:49.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:49.656+0000 7fee1f589640 1 --2- 172.21.15.33:0/1179877225 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee180cf2b0 0x7fee180d0110 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:49.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:49.656+0000 7fee1f589640 1 --2- 172.21.15.33:0/1179877225 >> v2:172.21.15.174:3300/0 conn(0x7fee18161600 0x7fee180d46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:49.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:49.656+0000 7fee1f589640 1 -- 172.21.15.33:0/1179877225 >> 172.21.15.33:0/1179877225 conn(0x7fee180d3bd0 msgr2=0x7fee180d3fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:54:49.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:49.657+0000 7fee1f589640 1 -- 172.21.15.33:0/1179877225 shutdown_connections 2024-05-08T10:54:49.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:49.657+0000 7fee1f589640 1 -- 172.21.15.33:0/1179877225 wait complete. 2024-05-08T10:54:49.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:49.658+0000 7fee1f589640 1 Processor -- start 2024-05-08T10:54:49.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:49.658+0000 7fee1f589640 1 -- start start 2024-05-08T10:54:49.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:49.658+0000 7fee1f589640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fee180cf2b0 0x7fee180ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:49.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:49.658+0000 7fee1f589640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee180d0650 0x7fee181589a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:49.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:49.658+0000 7fee1f589640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fee18161600 0x7fee1815a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:49.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:49.658+0000 7fee1f589640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee181619e0 con 0x7fee180d0650 2024-05-08T10:54:49.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:49.658+0000 7fee1f589640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee180b38e0 con 0x7fee180cf2b0 2024-05-08T10:54:49.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:49.658+0000 7fee1f589640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee180d0e40 con 0x7fee18161600 2024-05-08T10:54:49.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:49.659+0000 7fee1cb24640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee180d0650 0x7fee181589a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:49.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:49.659+0000 7fee1cb24640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee180d0650 0x7fee181589a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46412/0 (socket says 172.21.15.33:46412) 2024-05-08T10:54:49.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:49.659+0000 7fee1cb24640 1 -- 172.21.15.33:0/2556908916 learned_addr learned my addr 172.21.15.33:0/2556908916 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:54:49.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:49.659+0000 7fee1cb24640 1 -- 172.21.15.33:0/2556908916 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fee18161600 msgr2=0x7fee1815a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:49.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:49.659+0000 7fee1db26640 1 --2- 172.21.15.33:0/2556908916 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fee18161600 0x7fee1815a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:49.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:49.659+0000 7fee1d325640 1 --2- 172.21.15.33:0/2556908916 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fee180cf2b0 0x7fee180ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:49.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:49.659+0000 7fee1cb24640 1 --2- 172.21.15.33:0/2556908916 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fee18161600 0x7fee1815a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:49.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:49.659+0000 7fee1cb24640 1 -- 172.21.15.33:0/2556908916 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fee180cf2b0 msgr2=0x7fee180ccdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:49.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:49.659+0000 7fee1cb24640 1 --2- 172.21.15.33:0/2556908916 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fee180cf2b0 0x7fee180ccdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:49.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:49.659+0000 7fee1cb24640 1 -- 172.21.15.33:0/2556908916 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee180cbd50 con 0x7fee180d0650 2024-05-08T10:54:49.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:49.659+0000 7fee1cb24640 1 --2- 172.21.15.33:0/2556908916 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee180d0650 0x7fee181589a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fee08000c00 tx=0x7fee080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:54:49.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:49.659+0000 7fee0dffb640 1 -- 172.21.15.33:0/2556908916 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee08041020 con 0x7fee180d0650 2024-05-08T10:54:49.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:49.659+0000 7fee0dffb640 1 -- 172.21.15.33:0/2556908916 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee080306c0 con 0x7fee180d0650 2024-05-08T10:54:49.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:49.659+0000 7fee1f589640 1 -- 172.21.15.33:0/2556908916 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee180cc030 con 0x7fee180d0650 2024-05-08T10:54:49.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:49.659+0000 7fee0dffb640 1 -- 172.21.15.33:0/2556908916 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee08037040 con 0x7fee180d0650 2024-05-08T10:54:49.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:49.659+0000 7fee1f589640 1 -- 172.21.15.33:0/2556908916 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee180cc5f0 con 0x7fee180d0650 2024-05-08T10:54:49.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:49.660+0000 7fee1f589640 1 -- 172.21.15.33:0/2556908916 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee18069d20 con 0x7fee180d0650 2024-05-08T10:54:49.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:49.661+0000 7fee0dffb640 1 -- 172.21.15.33:0/2556908916 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fee08044020 con 0x7fee180d0650 2024-05-08T10:54:49.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:49.661+0000 7fee0dffb640 1 --2- 172.21.15.33:0/2556908916 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fedfc06b4d0 0x7fedfc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:49.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:49.662+0000 7fee0dffb640 1 -- 172.21.15.33:0/2556908916 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fee080aa960 con 0x7fee180d0650 2024-05-08T10:54:49.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:49.662+0000 7fee1d325640 1 --2- 172.21.15.33:0/2556908916 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fedfc06b4d0 0x7fedfc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:49.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:49.662+0000 7fee1d325640 1 --2- 172.21.15.33:0/2556908916 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fedfc06b4d0 0x7fedfc06d990 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fee18073250 tx=0x7fee14008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:54:49.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:49.666+0000 7fee0dffb640 1 -- 172.21.15.33:0/2556908916 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fee0804b030 con 0x7fee180d0650 2024-05-08T10:54:49.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:49.884+0000 7fee1f589640 1 -- 172.21.15.33:0/2556908916 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fee1815ed50 con 0x7fee180d0650 2024-05-08T10:54:50.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:50.515+0000 7fee0dffb640 1 -- 172.21.15.33:0/2556908916 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fee08079830 con 0x7fee180d0650 2024-05-08T10:54:50.512 INFO:teuthology.orchestra.run.smithi033.stderr:new fs with metadata pool 2 and data pool 3 2024-05-08T10:54:50.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:50.517+0000 7fee1f589640 1 -- 172.21.15.33:0/2556908916 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fedfc06b4d0 msgr2=0x7fedfc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:50.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:50.517+0000 7fee1f589640 1 --2- 172.21.15.33:0/2556908916 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fedfc06b4d0 0x7fedfc06d990 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fee18073250 tx=0x7fee14008040 comp rx=0 tx=0).stop 2024-05-08T10:54:50.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:50.517+0000 7fee1f589640 1 -- 172.21.15.33:0/2556908916 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee180d0650 msgr2=0x7fee181589a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:50.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:50.517+0000 7fee1f589640 1 --2- 172.21.15.33:0/2556908916 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee180d0650 0x7fee181589a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fee08000c00 tx=0x7fee080046c0 comp rx=0 tx=0).stop 2024-05-08T10:54:50.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:50.517+0000 7fee1f589640 1 -- 172.21.15.33:0/2556908916 shutdown_connections 2024-05-08T10:54:50.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:50.517+0000 7fee1f589640 1 --2- 172.21.15.33:0/2556908916 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fedfc06b4d0 0x7fedfc06d990 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:50.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:50.517+0000 7fee1f589640 1 --2- 172.21.15.33:0/2556908916 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fee18161600 0x7fee1815a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:50.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:50.517+0000 7fee1f589640 1 --2- 172.21.15.33:0/2556908916 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee180d0650 0x7fee181589a0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:50.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:50.517+0000 7fee1f589640 1 --2- 172.21.15.33:0/2556908916 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fee180cf2b0 0x7fee180ccdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:50.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:50.517+0000 7fee1f589640 1 -- 172.21.15.33:0/2556908916 >> 172.21.15.33:0/2556908916 conn(0x7fee180d3bd0 msgr2=0x7fee1815f270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:54:50.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:50.518+0000 7fee1f589640 1 -- 172.21.15.33:0/2556908916 shutdown_connections 2024-05-08T10:54:50.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:50.518+0000 7fee1f589640 1 -- 172.21.15.33:0/2556908916 wait complete. 2024-05-08T10:54:50.541 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T10:54:50.606 DEBUG:teuthology.orchestra.run.smithi033:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T10:54:50.608 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T10:54:50.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:50.655+0000 7f89f7cd6640 1 Processor -- start 2024-05-08T10:54:50.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:50.655+0000 7f89f7cd6640 1 -- start start 2024-05-08T10:54:50.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:50.656+0000 7f89f7cd6640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f89f00d4960 0x7f89f00d17e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:50.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:50.656+0000 7f89f7cd6640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f89f00d1e10 0x7f89f00d2260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:50.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:50.656+0000 7f89f7cd6640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89f00ce720 con 0x7f89f01613a0 2024-05-08T10:54:50.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:50.656+0000 7f89f7cd6640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89f00d27a0 con 0x7f89f00d4960 2024-05-08T10:54:50.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:50.656+0000 7f89f7cd6640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89f00cf010 con 0x7f89f00d1e10 2024-05-08T10:54:50.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:50.656+0000 7f89f5a72640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f89f01613a0 0x7f89f00cf4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:45438/0 (socket says 172.21.15.33:45438) 2024-05-08T10:54:50.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:50.656+0000 7f89f5a72640 1 -- 172.21.15.33:0/2136307372 learned_addr learned my addr 172.21.15.33:0/2136307372 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-05-08T10:54:50.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:50.656+0000 7f89f5271640 1 --2- 172.21.15.33:0/2136307372 >> v2:172.21.15.174:3300/0 conn(0x7f89f00d4960 0x7f89f00d17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:50.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:50.656+0000 7f89f6273640 1 --2- 172.21.15.33:0/2136307372 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f89f00d1e10 0x7f89f00d2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:50.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:50.656+0000 7f89f4a70640 1 -- 172.21.15.33:0/2136307372 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2129759830 0 0) 0x7f89f00ce720 con 0x7f89f01613a0 2024-05-08T10:54:50.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:50.656+0000 7f89f4a70640 1 -- 172.21.15.33:0/2136307372 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89dc003520 con 0x7f89f01613a0 2024-05-08T10:54:50.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:50.656+0000 7f89f6273640 1 -- 172.21.15.33:0/2136307372 >> v2:172.21.15.174:3300/0 conn(0x7f89f00d4960 msgr2=0x7f89f00d17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:54:50.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:50.656+0000 7f89f6273640 1 --2- 172.21.15.33:0/2136307372 >> v2:172.21.15.174:3300/0 conn(0x7f89f00d4960 0x7f89f00d17e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:50.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:50.657+0000 7f89f6273640 1 -- 172.21.15.33:0/2136307372 >> v1:172.21.15.33:6789/0 conn(0x7f89f01613a0 legacy=0x7f89f00cf4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:50.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:50.657+0000 7f89f6273640 1 -- 172.21.15.33:0/2136307372 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89f00d12d0 con 0x7f89f00d1e10 2024-05-08T10:54:50.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:50.657+0000 7f89f5271640 1 --2- 172.21.15.33:0/2136307372 >> v2:172.21.15.174:3300/0 conn(0x7f89f00d4960 0x7f89f00d17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T10:54:50.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:50.657+0000 7f89f6273640 1 --2- 172.21.15.33:0/2136307372 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f89f00d1e10 0x7f89f00d2260 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f89e8009d90 tx=0x7f89e802a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6936074a0f5aad8e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:54:50.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:50.657+0000 7f89f4a70640 1 -- 172.21.15.33:0/2136307372 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e8007740 con 0x7f89f00d1e10 2024-05-08T10:54:50.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:50.657+0000 7f89f4a70640 1 -- 172.21.15.33:0/2136307372 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89e80078e0 con 0x7f89f00d1e10 2024-05-08T10:54:50.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:50.658+0000 7f89f4a70640 1 -- 172.21.15.33:0/2136307372 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e8007c90 con 0x7f89f00d1e10 2024-05-08T10:54:50.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:50.658+0000 7f89f7cd6640 1 -- 172.21.15.33:0/2136307372 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f89f00d1e10 msgr2=0x7f89f00d2260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:50.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:50.658+0000 7f89f7cd6640 1 --2- 172.21.15.33:0/2136307372 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f89f00d1e10 0x7f89f00d2260 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f89e8009d90 tx=0x7f89e802a660 comp rx=0 tx=0).stop 2024-05-08T10:54:50.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:50.658+0000 7f89f7cd6640 1 -- 172.21.15.33:0/2136307372 shutdown_connections 2024-05-08T10:54:50.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:50.658+0000 7f89f7cd6640 1 --2- 172.21.15.33:0/2136307372 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f89f00d1e10 0x7f89f00d2260 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:50.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:50.658+0000 7f89f7cd6640 1 --2- 172.21.15.33:0/2136307372 >> v2:172.21.15.174:3300/0 conn(0x7f89f00d4960 0x7f89f00d17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:50.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:50.658+0000 7f89f7cd6640 1 -- 172.21.15.33:0/2136307372 >> 172.21.15.33:0/2136307372 conn(0x7f89f00d3c10 msgr2=0x7f89f00d4020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:54:50.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:50.658+0000 7f89f7cd6640 1 -- 172.21.15.33:0/2136307372 shutdown_connections 2024-05-08T10:54:50.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:50.658+0000 7f89f7cd6640 1 -- 172.21.15.33:0/2136307372 wait complete. 2024-05-08T10:54:50.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:50.659+0000 7f89f7cd6640 1 Processor -- start 2024-05-08T10:54:50.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:50.659+0000 7f89f7cd6640 1 -- start start 2024-05-08T10:54:50.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:50.660+0000 7f89f7cd6640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f89f00d1e10 0x7f89f00cca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:50.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:50.660+0000 7f89f7cd6640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f89f00d4960 0x7f89f00c9390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:50.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:50.660+0000 7f89f7cd6640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f89f01613a0 0x7f89f015e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:50.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:50.660+0000 7f89f7cd6640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89f00cfbb0 con 0x7f89f00d1e10 2024-05-08T10:54:50.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:50.660+0000 7f89f7cd6640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89f00ceca0 con 0x7f89f00d4960 2024-05-08T10:54:50.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:50.660+0000 7f89f7cd6640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89f00d0f80 con 0x7f89f01613a0 2024-05-08T10:54:50.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:50.660+0000 7f89f5a72640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f89f00d1e10 0x7f89f00cca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:50.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:50.660+0000 7f89f5a72640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f89f00d1e10 0x7f89f00cca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46418/0 (socket says 172.21.15.33:46418) 2024-05-08T10:54:50.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:50.660+0000 7f89f5a72640 1 -- 172.21.15.33:0/3326903569 learned_addr learned my addr 172.21.15.33:0/3326903569 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:54:50.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:50.660+0000 7f89f6273640 1 --2- 172.21.15.33:0/3326903569 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f89f01613a0 0x7f89f015e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:50.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:50.660+0000 7f89f5271640 1 --2- 172.21.15.33:0/3326903569 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f89f00d4960 0x7f89f00c9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:50.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:50.661+0000 7f89f5a72640 1 -- 172.21.15.33:0/3326903569 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f89f01613a0 msgr2=0x7f89f015e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:50.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:50.661+0000 7f89f5a72640 1 --2- 172.21.15.33:0/3326903569 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f89f01613a0 0x7f89f015e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:50.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:50.661+0000 7f89f5a72640 1 -- 172.21.15.33:0/3326903569 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f89f00d4960 msgr2=0x7f89f00c9390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:50.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:50.661+0000 7f89f5a72640 1 --2- 172.21.15.33:0/3326903569 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f89f00d4960 0x7f89f00c9390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:50.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:50.661+0000 7f89f5a72640 1 -- 172.21.15.33:0/3326903569 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89f015f170 con 0x7f89f00d1e10 2024-05-08T10:54:50.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:50.661+0000 7f89f5a72640 1 --2- 172.21.15.33:0/3326903569 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f89f00d1e10 0x7f89f00cca70 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f89ec00c390 tx=0x7f89ec00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:54:50.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:50.661+0000 7f89e67fc640 1 -- 172.21.15.33:0/3326903569 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89ec017070 con 0x7f89f00d1e10 2024-05-08T10:54:50.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:50.661+0000 7f89e67fc640 1 -- 172.21.15.33:0/3326903569 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89ec005ce0 con 0x7f89f00d1e10 2024-05-08T10:54:50.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:50.661+0000 7f89f7cd6640 1 -- 172.21.15.33:0/3326903569 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89f00cb6f0 con 0x7f89f00d1e10 2024-05-08T10:54:50.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:50.661+0000 7f89e67fc640 1 -- 172.21.15.33:0/3326903569 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89ec0072f0 con 0x7f89f00d1e10 2024-05-08T10:54:50.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:50.661+0000 7f89f7cd6640 1 -- 172.21.15.33:0/3326903569 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89f00cbcb0 con 0x7f89f00d1e10 2024-05-08T10:54:50.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:50.662+0000 7f89f7cd6640 1 -- 172.21.15.33:0/3326903569 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89f0069d20 con 0x7f89f00d1e10 2024-05-08T10:54:50.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:50.662+0000 7f89e67fc640 1 -- 172.21.15.33:0/3326903569 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f89ec01a070 con 0x7f89f00d1e10 2024-05-08T10:54:50.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:50.663+0000 7f89e67fc640 1 --2- 172.21.15.33:0/3326903569 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f89d406b4d0 0x7f89d406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:50.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:50.663+0000 7f89e67fc640 1 -- 172.21.15.33:0/3326903569 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f89ec0894e0 con 0x7f89f00d1e10 2024-05-08T10:54:50.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:50.663+0000 7f89f5271640 1 --2- 172.21.15.33:0/3326903569 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f89d406b4d0 0x7f89d406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:50.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:50.663+0000 7f89f5271640 1 --2- 172.21.15.33:0/3326903569 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f89d406b4d0 0x7f89d406d990 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f89e0009560 tx=0x7f89e0009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:54:50.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:50.667+0000 7f89e67fc640 1 -- 172.21.15.33:0/3326903569 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f89ec057da0 con 0x7f89f00d1e10 2024-05-08T10:54:50.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:50.847+0000 7f89f7cd6640 1 -- 172.21.15.33:0/3326903569 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f89f008d980 con 0x7f89f00d1e10 2024-05-08T10:54:50.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:50.848+0000 7f89e67fc640 1 -- 172.21.15.33:0/3326903569 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16630 (secure 0 0 0) 0x7f89ec05be40 con 0x7f89f00d1e10 2024-05-08T10:54:50.846 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:54:50.846 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":19,"fsid":"963217b2-c375-4f5a-95cf-88e199dd38ff","created":"2024-05-08T10:54:26.711528+0000","modified":"2024-05-08T10:54:49.885471+0000","last_up_change":"2024-05-08T10:54:37.987478+0000","last_in_change":"2024-05-08T10:54:28.834106+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T10:54:38.989228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T10:54:47.774236+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T10:54:48.869679+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c5da4fb5-d4f2-4982-a804-2aa92fe77731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3990629207},{"type":"v1","addr":"172.21.15.33:6817","nonce":3990629207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3990629207},{"type":"v1","addr":"172.21.15.33:6819","nonce":3990629207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3990629207},{"type":"v1","addr":"172.21.15.33:6823","nonce":3990629207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3990629207},{"type":"v1","addr":"172.21.15.33:6821","nonce":3990629207}]},"public_addr":"172.21.15.33:6817/3990629207","cluster_addr":"172.21.15.33:6819/3990629207","heartbeat_back_addr":"172.21.15.33:6823/3990629207","heartbeat_front_addr":"172.21.15.33:6821/3990629207","state":["exists","up"]},{"osd":1,"uuid":"f8fdd8db-c2a3-4d28-81f3-b30f44bea7c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":1758076090},{"type":"v1","addr":"172.21.15.33:6825","nonce":1758076090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":1758076090},{"type":"v1","addr":"172.21.15.33:6827","nonce":1758076090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":1758076090},{"type":"v1","addr":"172.21.15.33:6831","nonce":1758076090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":1758076090},{"type":"v1","addr":"172.21.15.33:6829","nonce":1758076090}]},"public_addr":"172.21.15.33:6825/1758076090","cluster_addr":"172.21.15.33:6827/1758076090","heartbeat_back_addr":"172.21.15.33:6831/1758076090","heartbeat_front_addr":"172.21.15.33:6829/1758076090","state":["exists","up"]},{"osd":2,"uuid":"87d465f3-b40f-48dd-bae2-4c67904d4828","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":2940853479},{"type":"v1","addr":"172.21.15.33:6801","nonce":2940853479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6803","nonce":2940853479},{"type":"v1","addr":"172.21.15.33:6805","nonce":2940853479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6811","nonce":2940853479},{"type":"v1","addr":"172.21.15.33:6813","nonce":2940853479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6807","nonce":2940853479},{"type":"v1","addr":"172.21.15.33:6809","nonce":2940853479}]},"public_addr":"172.21.15.33:6801/2940853479","cluster_addr":"172.21.15.33:6805/2940853479","heartbeat_back_addr":"172.21.15.33:6813/2940853479","heartbeat_front_addr":"172.21.15.33:6809/2940853479","state":["exists","up"]},{"osd":3,"uuid":"79450edf-9637-4181-9372-e1cd5e91e73e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":4029047077},{"type":"v1","addr":"172.21.15.33:6804","nonce":4029047077}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":4029047077},{"type":"v1","addr":"172.21.15.33:6808","nonce":4029047077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":4029047077},{"type":"v1","addr":"172.21.15.33:6815","nonce":4029047077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":4029047077},{"type":"v1","addr":"172.21.15.33:6812","nonce":4029047077}]},"public_addr":"172.21.15.33:6804/4029047077","cluster_addr":"172.21.15.33:6808/4029047077","heartbeat_back_addr":"172.21.15.33:6815/4029047077","heartbeat_front_addr":"172.21.15.33:6812/4029047077","state":["exists","up"]},{"osd":4,"uuid":"bd0debfa-e559-4b1e-920d-6b2639c7085e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":1697399220},{"type":"v1","addr":"172.21.15.174:6801","nonce":1697399220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":1697399220},{"type":"v1","addr":"172.21.15.174:6803","nonce":1697399220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":1697399220},{"type":"v1","addr":"172.21.15.174:6807","nonce":1697399220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":1697399220},{"type":"v1","addr":"172.21.15.174:6805","nonce":1697399220}]},"public_addr":"172.21.15.174:6801/1697399220","cluster_addr":"172.21.15.174:6803/1697399220","heartbeat_back_addr":"172.21.15.174:6807/1697399220","heartbeat_front_addr":"172.21.15.174:6805/1697399220","state":["exists","up"]},{"osd":5,"uuid":"ff0f51c0-672b-448f-9de1-b9305ce8c00d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":1511860729},{"type":"v1","addr":"172.21.15.174:6825","nonce":1511860729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":1511860729},{"type":"v1","addr":"172.21.15.174:6827","nonce":1511860729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":1511860729},{"type":"v1","addr":"172.21.15.174:6831","nonce":1511860729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":1511860729},{"type":"v1","addr":"172.21.15.174:6829","nonce":1511860729}]},"public_addr":"172.21.15.174:6825/1511860729","cluster_addr":"172.21.15.174:6827/1511860729","heartbeat_back_addr":"172.21.15.174:6831/1511860729","heartbeat_front_addr":"172.21.15.174:6829/1511860729","state":["exists","up"]},{"osd":6,"uuid":"93061f6c-c0ce-47e9-88a0-1151c5ccb4e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":2326407945},{"type":"v1","addr":"172.21.15.174:6817","nonce":2326407945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":2326407945},{"type":"v1","addr":"172.21.15.174:6819","nonce":2326407945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":2326407945},{"type":"v1","addr":"172.21.15.174:6823","nonce":2326407945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":2326407945},{"type":"v1","addr":"172.21.15.174:6821","nonce":2326407945}]},"public_addr":"172.21.15.174:6817/2326407945","cluster_addr":"172.21.15.174:6819/2326407945","heartbeat_back_addr":"172.21.15.174:6823/2326407945","heartbeat_front_addr":"172.21.15.174:6821/2326407945","state":["exists","up"]},{"osd":7,"uuid":"7be1dcf3-1957-4ec3-bacf-f5f9fff580a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":1637570253},{"type":"v1","addr":"172.21.15.174:6809","nonce":1637570253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":1637570253},{"type":"v1","addr":"172.21.15.174:6811","nonce":1637570253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":1637570253},{"type":"v1","addr":"172.21.15.174:6815","nonce":1637570253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":1637570253},{"type":"v1","addr":"172.21.15.174:6813","nonce":1637570253}]},"public_addr":"172.21.15.174:6809/1637570253","cluster_addr":"172.21.15.174:6811/1637570253","heartbeat_back_addr":"172.21.15.174:6815/1637570253","heartbeat_front_addr":"172.21.15.174:6813/1637570253","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:33.997709+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:34.016568+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:33.990484+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:33.980666+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:33.920609+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:34.005069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:34.018345+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:34.061646+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T10:54:50.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:50.850+0000 7f89f7cd6640 1 -- 172.21.15.33:0/3326903569 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f89d406b4d0 msgr2=0x7f89d406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:50.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:50.850+0000 7f89f7cd6640 1 --2- 172.21.15.33:0/3326903569 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f89d406b4d0 0x7f89d406d990 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f89e0009560 tx=0x7f89e0009190 comp rx=0 tx=0).stop 2024-05-08T10:54:50.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:50.850+0000 7f89f7cd6640 1 -- 172.21.15.33:0/3326903569 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f89f00d1e10 msgr2=0x7f89f00cca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:50.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:50.850+0000 7f89f7cd6640 1 --2- 172.21.15.33:0/3326903569 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f89f00d1e10 0x7f89f00cca70 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f89ec00c390 tx=0x7f89ec00c850 comp rx=0 tx=0).stop 2024-05-08T10:54:50.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:50.850+0000 7f89f7cd6640 1 -- 172.21.15.33:0/3326903569 shutdown_connections 2024-05-08T10:54:50.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:50.850+0000 7f89f7cd6640 1 --2- 172.21.15.33:0/3326903569 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f89d406b4d0 0x7f89d406d990 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:50.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:50.850+0000 7f89f7cd6640 1 --2- 172.21.15.33:0/3326903569 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f89f01613a0 0x7f89f015e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:50.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:50.850+0000 7f89f7cd6640 1 --2- 172.21.15.33:0/3326903569 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f89f00d4960 0x7f89f00c9390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:50.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:50.850+0000 7f89f7cd6640 1 --2- 172.21.15.33:0/3326903569 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f89f00d1e10 0x7f89f00cca70 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:50.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:50.850+0000 7f89f7cd6640 1 -- 172.21.15.33:0/3326903569 >> 172.21.15.33:0/3326903569 conn(0x7f89f00d3c10 msgr2=0x7f89f00b2340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:54:50.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:50.850+0000 7f89f7cd6640 1 -- 172.21.15.33:0/3326903569 shutdown_connections 2024-05-08T10:54:50.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:50.850+0000 7f89f7cd6640 1 -- 172.21.15.33:0/3326903569 wait complete. 2024-05-08T10:54:50.859 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T10:54:51.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.005+0000 7f0cc63a9640 1 Processor -- start 2024-05-08T10:54:51.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.006+0000 7f0cc63a9640 1 -- start start 2024-05-08T10:54:51.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.006+0000 7f0cc63a9640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0cc00d0920 0x7f0cc015e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:51.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.006+0000 7f0cc63a9640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f0cc00b4c60 0x7f0cc00ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:51.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.006+0000 7f0cc63a9640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cc00d4910 con 0x7f0cc00d0540 2024-05-08T10:54:51.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.006+0000 7f0cc63a9640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cc00d46c0 con 0x7f0cc00b4c60 2024-05-08T10:54:51.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.006+0000 7f0cc63a9640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc00d2390 con 0x7f0cc00d0920 2024-05-08T10:54:51.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.007+0000 7f0cc4946640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f0cc00b4c60 0x7f0cc00ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:51.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.007+0000 7f0cbf7fe640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0cc00d0920 0x7f0cc015e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:51.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.007+0000 7f0cc4946640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f0cc00b4c60 0x7f0cc00ce7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.33:59156/0 (socket says 172.21.15.33:59156) 2024-05-08T10:54:51.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.007+0000 7f0cbf7fe640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0cc00d0920 0x7f0cc015e2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.33:56956/0 (socket says 172.21.15.33:56956) 2024-05-08T10:54:51.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.007+0000 7f0cc4946640 1 -- 172.21.15.33:0/3887539471 learned_addr learned my addr 172.21.15.33:0/3887539471 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:54:51.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.007+0000 7f0cc4946640 1 -- 172.21.15.33:0/3887539471 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0cc00d0920 msgr2=0x7f0cc015e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:54:51.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.007+0000 7f0cc4946640 1 --2- 172.21.15.33:0/3887539471 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0cc00d0920 0x7f0cc015e2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:51.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.007+0000 7f0cc4946640 1 -- 172.21.15.33:0/3887539471 >> v1:172.21.15.174:6789/0 conn(0x7f0cc00d0540 legacy=0x7f0cc015dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:51.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.007+0000 7f0cc4946640 1 -- 172.21.15.33:0/3887539471 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cc00d25e0 con 0x7f0cc00b4c60 2024-05-08T10:54:51.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.008+0000 7f0cc4946640 1 --2- 172.21.15.33:0/3887539471 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0cc00b4c60 0x7f0cc00ce7b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0cb8009e50 tx=0x7f0cb802a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e1cf8232f59f33db server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:54:51.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.008+0000 7f0cbeffd640 1 -- 172.21.15.33:0/3887539471 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb8036070 con 0x7f0cc00b4c60 2024-05-08T10:54:51.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.008+0000 7f0cbeffd640 1 -- 172.21.15.33:0/3887539471 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cb8031600 con 0x7f0cc00b4c60 2024-05-08T10:54:51.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.008+0000 7f0cbeffd640 1 -- 172.21.15.33:0/3887539471 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb80319d0 con 0x7f0cc00b4c60 2024-05-08T10:54:51.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.008+0000 7f0cc63a9640 1 -- 172.21.15.33:0/3887539471 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0cc00b4c60 msgr2=0x7f0cc00ce7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:51.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.008+0000 7f0cc63a9640 1 --2- 172.21.15.33:0/3887539471 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0cc00b4c60 0x7f0cc00ce7b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0cb8009e50 tx=0x7f0cb802a5f0 comp rx=0 tx=0).stop 2024-05-08T10:54:51.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.009+0000 7f0cc63a9640 1 -- 172.21.15.33:0/3887539471 shutdown_connections 2024-05-08T10:54:51.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.009+0000 7f0cc63a9640 1 --2- 172.21.15.33:0/3887539471 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0cc00b4c60 0x7f0cc00ce7b0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:51.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.009+0000 7f0cc63a9640 1 --2- 172.21.15.33:0/3887539471 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0cc00d0920 0x7f0cc015e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:51.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.009+0000 7f0cc63a9640 1 -- 172.21.15.33:0/3887539471 >> 172.21.15.33:0/3887539471 conn(0x7f0cc00d3ba0 msgr2=0x7f0cc00d3fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:54:51.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.009+0000 7f0cc63a9640 1 -- 172.21.15.33:0/3887539471 shutdown_connections 2024-05-08T10:54:51.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.009+0000 7f0cc63a9640 1 -- 172.21.15.33:0/3887539471 wait complete. 2024-05-08T10:54:51.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.010+0000 7f0cc63a9640 1 Processor -- start 2024-05-08T10:54:51.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.010+0000 7f0cc63a9640 1 -- start start 2024-05-08T10:54:51.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.011+0000 7f0cc63a9640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0cc00b4c60 0x7f0cc00a08f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:51.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.011+0000 7f0cc63a9640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0cc00d0540 0x7f0cc0154f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:51.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.011+0000 7f0cc63a9640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0cc00d0920 0x7f0cc00cc520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:51.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.011+0000 7f0cc63a9640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc00b51d0 con 0x7f0cc00b4c60 2024-05-08T10:54:51.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.011+0000 7f0cc63a9640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc00d2950 con 0x7f0cc00d0540 2024-05-08T10:54:51.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.011+0000 7f0cc63a9640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc00b5350 con 0x7f0cc00d0920 2024-05-08T10:54:51.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.011+0000 7f0cbffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0cc00b4c60 0x7f0cc00a08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:51.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.011+0000 7f0cbffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0cc00b4c60 0x7f0cc00a08f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46422/0 (socket says 172.21.15.33:46422) 2024-05-08T10:54:51.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.011+0000 7f0cbffff640 1 -- 172.21.15.33:0/1091872487 learned_addr learned my addr 172.21.15.33:0/1091872487 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:54:51.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.011+0000 7f0cbf7fe640 1 --2- 172.21.15.33:0/1091872487 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0cc00d0540 0x7f0cc0154f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:51.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.011+0000 7f0cc4946640 1 --2- 172.21.15.33:0/1091872487 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0cc00d0920 0x7f0cc00cc520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:51.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.011+0000 7f0cbffff640 1 -- 172.21.15.33:0/1091872487 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0cc00d0920 msgr2=0x7f0cc00cc520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:51.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.011+0000 7f0cbffff640 1 --2- 172.21.15.33:0/1091872487 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0cc00d0920 0x7f0cc00cc520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:51.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.011+0000 7f0cbffff640 1 -- 172.21.15.33:0/1091872487 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0cc00d0540 msgr2=0x7f0cc0154f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:51.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.011+0000 7f0cbffff640 1 --2- 172.21.15.33:0/1091872487 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0cc00d0540 0x7f0cc0154f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:51.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.011+0000 7f0cbffff640 1 -- 172.21.15.33:0/1091872487 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cc009dba0 con 0x7f0cc00b4c60 2024-05-08T10:54:51.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.012+0000 7f0cbffff640 1 --2- 172.21.15.33:0/1091872487 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0cc00b4c60 0x7f0cc00a08f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0cb000c3c0 tx=0x7f0cb000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:54:51.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.012+0000 7f0cbcff9640 1 -- 172.21.15.33:0/1091872487 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb00052d0 con 0x7f0cc00b4c60 2024-05-08T10:54:51.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.012+0000 7f0cbcff9640 1 -- 172.21.15.33:0/1091872487 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cb0005490 con 0x7f0cc00b4c60 2024-05-08T10:54:51.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.012+0000 7f0cc63a9640 1 -- 172.21.15.33:0/1091872487 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cc01f3e10 con 0x7f0cc00b4c60 2024-05-08T10:54:51.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.012+0000 7f0cbcff9640 1 -- 172.21.15.33:0/1091872487 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb0007260 con 0x7f0cc00b4c60 2024-05-08T10:54:51.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.012+0000 7f0cc63a9640 1 -- 172.21.15.33:0/1091872487 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cc01f46b0 con 0x7f0cc00b4c60 2024-05-08T10:54:51.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.013+0000 7f0cc63a9640 1 -- 172.21.15.33:0/1091872487 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cc0069d20 con 0x7f0cc00b4c60 2024-05-08T10:54:51.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.013+0000 7f0cbcff9640 1 -- 172.21.15.33:0/1091872487 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0cb0007400 con 0x7f0cc00b4c60 2024-05-08T10:54:51.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.014+0000 7f0cbcff9640 1 --2- 172.21.15.33:0/1091872487 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f0cac06b500 0x7f0cac06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:51.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.014+0000 7f0cbcff9640 1 -- 172.21.15.33:0/1091872487 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0cb0089510 con 0x7f0cc00b4c60 2024-05-08T10:54:51.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.014+0000 7f0cbf7fe640 1 --2- 172.21.15.33:0/1091872487 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f0cac06b500 0x7f0cac06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:51.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.014+0000 7f0cbf7fe640 1 --2- 172.21.15.33:0/1091872487 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f0cac06b500 0x7f0cac06d9c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0cc00d10c0 tx=0x7f0cb4009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:54:51.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.018+0000 7f0cbcff9640 1 -- 172.21.15.33:0/1091872487 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0cb0057dd0 con 0x7f0cc00b4c60 2024-05-08T10:54:51.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.203+0000 7f0cc63a9640 1 -- 172.21.15.33:0/1091872487 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0cc0072f70 con 0x7f0cc00b4c60 2024-05-08T10:54:51.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.204+0000 7f0cbcff9640 1 -- 172.21.15.33:0/1091872487 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16630 (secure 0 0 0) 0x7f0cb005be70 con 0x7f0cc00b4c60 2024-05-08T10:54:51.201 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:54:51.202 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":19,"fsid":"963217b2-c375-4f5a-95cf-88e199dd38ff","created":"2024-05-08T10:54:26.711528+0000","modified":"2024-05-08T10:54:49.885471+0000","last_up_change":"2024-05-08T10:54:37.987478+0000","last_in_change":"2024-05-08T10:54:28.834106+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T10:54:38.989228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T10:54:47.774236+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T10:54:48.869679+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c5da4fb5-d4f2-4982-a804-2aa92fe77731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3990629207},{"type":"v1","addr":"172.21.15.33:6817","nonce":3990629207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3990629207},{"type":"v1","addr":"172.21.15.33:6819","nonce":3990629207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3990629207},{"type":"v1","addr":"172.21.15.33:6823","nonce":3990629207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3990629207},{"type":"v1","addr":"172.21.15.33:6821","nonce":3990629207}]},"public_addr":"172.21.15.33:6817/3990629207","cluster_addr":"172.21.15.33:6819/3990629207","heartbeat_back_addr":"172.21.15.33:6823/3990629207","heartbeat_front_addr":"172.21.15.33:6821/3990629207","state":["exists","up"]},{"osd":1,"uuid":"f8fdd8db-c2a3-4d28-81f3-b30f44bea7c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":1758076090},{"type":"v1","addr":"172.21.15.33:6825","nonce":1758076090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":1758076090},{"type":"v1","addr":"172.21.15.33:6827","nonce":1758076090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":1758076090},{"type":"v1","addr":"172.21.15.33:6831","nonce":1758076090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":1758076090},{"type":"v1","addr":"172.21.15.33:6829","nonce":1758076090}]},"public_addr":"172.21.15.33:6825/1758076090","cluster_addr":"172.21.15.33:6827/1758076090","heartbeat_back_addr":"172.21.15.33:6831/1758076090","heartbeat_front_addr":"172.21.15.33:6829/1758076090","state":["exists","up"]},{"osd":2,"uuid":"87d465f3-b40f-48dd-bae2-4c67904d4828","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":2940853479},{"type":"v1","addr":"172.21.15.33:6801","nonce":2940853479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6803","nonce":2940853479},{"type":"v1","addr":"172.21.15.33:6805","nonce":2940853479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6811","nonce":2940853479},{"type":"v1","addr":"172.21.15.33:6813","nonce":2940853479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6807","nonce":2940853479},{"type":"v1","addr":"172.21.15.33:6809","nonce":2940853479}]},"public_addr":"172.21.15.33:6801/2940853479","cluster_addr":"172.21.15.33:6805/2940853479","heartbeat_back_addr":"172.21.15.33:6813/2940853479","heartbeat_front_addr":"172.21.15.33:6809/2940853479","state":["exists","up"]},{"osd":3,"uuid":"79450edf-9637-4181-9372-e1cd5e91e73e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":4029047077},{"type":"v1","addr":"172.21.15.33:6804","nonce":4029047077}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":4029047077},{"type":"v1","addr":"172.21.15.33:6808","nonce":4029047077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":4029047077},{"type":"v1","addr":"172.21.15.33:6815","nonce":4029047077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":4029047077},{"type":"v1","addr":"172.21.15.33:6812","nonce":4029047077}]},"public_addr":"172.21.15.33:6804/4029047077","cluster_addr":"172.21.15.33:6808/4029047077","heartbeat_back_addr":"172.21.15.33:6815/4029047077","heartbeat_front_addr":"172.21.15.33:6812/4029047077","state":["exists","up"]},{"osd":4,"uuid":"bd0debfa-e559-4b1e-920d-6b2639c7085e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":1697399220},{"type":"v1","addr":"172.21.15.174:6801","nonce":1697399220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":1697399220},{"type":"v1","addr":"172.21.15.174:6803","nonce":1697399220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":1697399220},{"type":"v1","addr":"172.21.15.174:6807","nonce":1697399220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":1697399220},{"type":"v1","addr":"172.21.15.174:6805","nonce":1697399220}]},"public_addr":"172.21.15.174:6801/1697399220","cluster_addr":"172.21.15.174:6803/1697399220","heartbeat_back_addr":"172.21.15.174:6807/1697399220","heartbeat_front_addr":"172.21.15.174:6805/1697399220","state":["exists","up"]},{"osd":5,"uuid":"ff0f51c0-672b-448f-9de1-b9305ce8c00d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":1511860729},{"type":"v1","addr":"172.21.15.174:6825","nonce":1511860729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":1511860729},{"type":"v1","addr":"172.21.15.174:6827","nonce":1511860729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":1511860729},{"type":"v1","addr":"172.21.15.174:6831","nonce":1511860729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":1511860729},{"type":"v1","addr":"172.21.15.174:6829","nonce":1511860729}]},"public_addr":"172.21.15.174:6825/1511860729","cluster_addr":"172.21.15.174:6827/1511860729","heartbeat_back_addr":"172.21.15.174:6831/1511860729","heartbeat_front_addr":"172.21.15.174:6829/1511860729","state":["exists","up"]},{"osd":6,"uuid":"93061f6c-c0ce-47e9-88a0-1151c5ccb4e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":2326407945},{"type":"v1","addr":"172.21.15.174:6817","nonce":2326407945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":2326407945},{"type":"v1","addr":"172.21.15.174:6819","nonce":2326407945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":2326407945},{"type":"v1","addr":"172.21.15.174:6823","nonce":2326407945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":2326407945},{"type":"v1","addr":"172.21.15.174:6821","nonce":2326407945}]},"public_addr":"172.21.15.174:6817/2326407945","cluster_addr":"172.21.15.174:6819/2326407945","heartbeat_back_addr":"172.21.15.174:6823/2326407945","heartbeat_front_addr":"172.21.15.174:6821/2326407945","state":["exists","up"]},{"osd":7,"uuid":"7be1dcf3-1957-4ec3-bacf-f5f9fff580a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":1637570253},{"type":"v1","addr":"172.21.15.174:6809","nonce":1637570253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":1637570253},{"type":"v1","addr":"172.21.15.174:6811","nonce":1637570253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":1637570253},{"type":"v1","addr":"172.21.15.174:6815","nonce":1637570253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":1637570253},{"type":"v1","addr":"172.21.15.174:6813","nonce":1637570253}]},"public_addr":"172.21.15.174:6809/1637570253","cluster_addr":"172.21.15.174:6811/1637570253","heartbeat_back_addr":"172.21.15.174:6815/1637570253","heartbeat_front_addr":"172.21.15.174:6813/1637570253","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:33.997709+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:34.016568+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:33.990484+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:33.980666+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:33.920609+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:34.005069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:34.018345+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:34.061646+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T10:54:51.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.206+0000 7f0cc63a9640 1 -- 172.21.15.33:0/1091872487 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f0cac06b500 msgr2=0x7f0cac06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:51.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.206+0000 7f0cc63a9640 1 --2- 172.21.15.33:0/1091872487 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f0cac06b500 0x7f0cac06d9c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0cc00d10c0 tx=0x7f0cb4009190 comp rx=0 tx=0).stop 2024-05-08T10:54:51.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.206+0000 7f0cc63a9640 1 -- 172.21.15.33:0/1091872487 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0cc00b4c60 msgr2=0x7f0cc00a08f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:51.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.206+0000 7f0cc63a9640 1 --2- 172.21.15.33:0/1091872487 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0cc00b4c60 0x7f0cc00a08f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0cb000c3c0 tx=0x7f0cb000c880 comp rx=0 tx=0).stop 2024-05-08T10:54:51.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.206+0000 7f0cc63a9640 1 -- 172.21.15.33:0/1091872487 shutdown_connections 2024-05-08T10:54:51.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.206+0000 7f0cc63a9640 1 --2- 172.21.15.33:0/1091872487 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f0cac06b500 0x7f0cac06d9c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:51.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.206+0000 7f0cc63a9640 1 --2- 172.21.15.33:0/1091872487 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0cc00d0920 0x7f0cc00cc520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:51.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.206+0000 7f0cc63a9640 1 --2- 172.21.15.33:0/1091872487 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0cc00d0540 0x7f0cc0154f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:51.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.206+0000 7f0cc63a9640 1 --2- 172.21.15.33:0/1091872487 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0cc00b4c60 0x7f0cc00a08f0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:51.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.206+0000 7f0cc63a9640 1 -- 172.21.15.33:0/1091872487 >> 172.21.15.33:0/1091872487 conn(0x7f0cc00d3ba0 msgr2=0x7f0cc00d3f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:54:51.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.206+0000 7f0cc63a9640 1 -- 172.21.15.33:0/1091872487 shutdown_connections 2024-05-08T10:54:51.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.206+0000 7f0cc63a9640 1 -- 172.21.15.33:0/1091872487 wait complete. 2024-05-08T10:54:51.215 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-08T10:54:51.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.323+0000 7f762077e640 1 Processor -- start 2024-05-08T10:54:51.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.323+0000 7f762077e640 1 -- start start 2024-05-08T10:54:51.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.324+0000 7f762077e640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f761815dd30 0x7f76180cf160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:51.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.324+0000 7f762077e640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f761815e110 0x7f76180cf6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:51.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.324+0000 7f762077e640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f76180d2220 0x7f76180d2660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:51.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.324+0000 7f762077e640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76180d2ba0 con 0x7f761815dd30 2024-05-08T10:54:51.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.324+0000 7f762077e640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76180b31a0 con 0x7f76180d2220 2024-05-08T10:54:51.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.324+0000 7f762077e640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76180b3480 con 0x7f761815e110 2024-05-08T10:54:51.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.325+0000 7f761e51a640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f761815dd30 0x7f76180cf160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:51.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.325+0000 7f761e51a640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f761815dd30 0x7f76180cf160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46436/0 (socket says 172.21.15.33:46436) 2024-05-08T10:54:51.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.325+0000 7f761e51a640 1 -- 172.21.15.33:0/2958280826 learned_addr learned my addr 172.21.15.33:0/2958280826 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:54:51.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.325+0000 7f761ed1b640 1 --2- 172.21.15.33:0/2958280826 >> v2:172.21.15.174:3300/0 conn(0x7f76180d2220 0x7f76180d2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:51.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.325+0000 7f761dd19640 1 --2- 172.21.15.33:0/2958280826 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f761815e110 0x7f76180cf6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:51.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.325+0000 7f761e51a640 1 -- 172.21.15.33:0/2958280826 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f761815e110 msgr2=0x7f76180cf6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:54:51.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.325+0000 7f761e51a640 1 --2- 172.21.15.33:0/2958280826 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f761815e110 0x7f76180cf6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:51.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.325+0000 7f761e51a640 1 -- 172.21.15.33:0/2958280826 >> v2:172.21.15.174:3300/0 conn(0x7f76180d2220 msgr2=0x7f76180d2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:54:51.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.325+0000 7f761e51a640 1 --2- 172.21.15.33:0/2958280826 >> v2:172.21.15.174:3300/0 conn(0x7f76180d2220 0x7f76180d2660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:51.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.325+0000 7f761e51a640 1 -- 172.21.15.33:0/2958280826 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76180b3760 con 0x7f761815dd30 2024-05-08T10:54:51.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.325+0000 7f761ed1b640 1 --2- 172.21.15.33:0/2958280826 >> v2:172.21.15.174:3300/0 conn(0x7f76180d2220 0x7f76180d2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:54:51.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.325+0000 7f761e51a640 1 --2- 172.21.15.33:0/2958280826 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f761815dd30 0x7f76180cf160 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f761808d550 tx=0x7f760802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fdfec8cecc73c2a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:54:51.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.326+0000 7f761d518640 1 -- 172.21.15.33:0/2958280826 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7608036070 con 0x7f761815dd30 2024-05-08T10:54:51.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.326+0000 7f761d518640 1 -- 172.21.15.33:0/2958280826 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7608031600 con 0x7f761815dd30 2024-05-08T10:54:51.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.326+0000 7f761d518640 1 -- 172.21.15.33:0/2958280826 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76080319d0 con 0x7f761815dd30 2024-05-08T10:54:51.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.326+0000 7f762077e640 1 -- 172.21.15.33:0/2958280826 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f761815dd30 msgr2=0x7f76180cf160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:51.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.326+0000 7f762077e640 1 --2- 172.21.15.33:0/2958280826 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f761815dd30 0x7f76180cf160 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f761808d550 tx=0x7f760802a6a0 comp rx=0 tx=0).stop 2024-05-08T10:54:51.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.326+0000 7f762077e640 1 -- 172.21.15.33:0/2958280826 shutdown_connections 2024-05-08T10:54:51.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.326+0000 7f762077e640 1 --2- 172.21.15.33:0/2958280826 >> v2:172.21.15.174:3300/0 conn(0x7f76180d2220 0x7f76180d2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:51.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.326+0000 7f762077e640 1 --2- 172.21.15.33:0/2958280826 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f761815e110 0x7f76180cf6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:51.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.326+0000 7f762077e640 1 --2- 172.21.15.33:0/2958280826 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f761815dd30 0x7f76180cf160 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:51.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.326+0000 7f762077e640 1 -- 172.21.15.33:0/2958280826 >> 172.21.15.33:0/2958280826 conn(0x7f761809cf10 msgr2=0x7f76180d3c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:54:51.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.326+0000 7f762077e640 1 -- 172.21.15.33:0/2958280826 shutdown_connections 2024-05-08T10:54:51.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.326+0000 7f762077e640 1 -- 172.21.15.33:0/2958280826 wait complete. 2024-05-08T10:54:51.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.327+0000 7f762077e640 1 Processor -- start 2024-05-08T10:54:51.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.328+0000 7f762077e640 1 -- start start 2024-05-08T10:54:51.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.328+0000 7f762077e640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f76180d2220 0x7f76180b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:51.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.328+0000 7f762077e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f761815dd30 0x7f76180cad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:51.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.328+0000 7f762077e640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f761815e110 0x7f7618151e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:51.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.328+0000 7f762077e640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76180d1d60 con 0x7f761815dd30 2024-05-08T10:54:51.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.328+0000 7f762077e640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76180d1be0 con 0x7f761815e110 2024-05-08T10:54:51.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.328+0000 7f762077e640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76180d0250 con 0x7f76180d2220 2024-05-08T10:54:51.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.328+0000 7f761dd19640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f761815dd30 0x7f76180cad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:51.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.328+0000 7f761dd19640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f761815dd30 0x7f76180cad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46442/0 (socket says 172.21.15.33:46442) 2024-05-08T10:54:51.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.328+0000 7f761dd19640 1 -- 172.21.15.33:0/2923714141 learned_addr learned my addr 172.21.15.33:0/2923714141 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:54:51.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.328+0000 7f761ed1b640 1 --2- 172.21.15.33:0/2923714141 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f761815e110 0x7f7618151e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:51.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.328+0000 7f761e51a640 1 --2- 172.21.15.33:0/2923714141 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f76180d2220 0x7f76180b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:51.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.329+0000 7f761dd19640 1 -- 172.21.15.33:0/2923714141 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f76180d2220 msgr2=0x7f76180b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:51.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.329+0000 7f761dd19640 1 --2- 172.21.15.33:0/2923714141 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f76180d2220 0x7f76180b20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:51.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.329+0000 7f761dd19640 1 -- 172.21.15.33:0/2923714141 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f761815e110 msgr2=0x7f7618151e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:51.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.329+0000 7f761dd19640 1 --2- 172.21.15.33:0/2923714141 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f761815e110 0x7f7618151e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:51.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.329+0000 7f761dd19640 1 -- 172.21.15.33:0/2923714141 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76180cded0 con 0x7f761815dd30 2024-05-08T10:54:51.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.329+0000 7f761dd19640 1 --2- 172.21.15.33:0/2923714141 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f761815dd30 0x7f76180cad10 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f760c00d5f0 tx=0x7f760c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:54:51.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.329+0000 7f7616ffd640 1 -- 172.21.15.33:0/2923714141 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f760c0125f0 con 0x7f761815dd30 2024-05-08T10:54:51.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.329+0000 7f7616ffd640 1 -- 172.21.15.33:0/2923714141 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f760c019070 con 0x7f761815dd30 2024-05-08T10:54:51.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.329+0000 7f762077e640 1 -- 172.21.15.33:0/2923714141 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76180b84b0 con 0x7f761815dd30 2024-05-08T10:54:51.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.329+0000 7f7616ffd640 1 -- 172.21.15.33:0/2923714141 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f760c0129d0 con 0x7f761815dd30 2024-05-08T10:54:51.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.329+0000 7f762077e640 1 -- 172.21.15.33:0/2923714141 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76180b8a70 con 0x7f761815dd30 2024-05-08T10:54:51.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.330+0000 7f762077e640 1 -- 172.21.15.33:0/2923714141 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7618069d20 con 0x7f761815dd30 2024-05-08T10:54:51.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.331+0000 7f7616ffd640 1 -- 172.21.15.33:0/2923714141 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f760c012b70 con 0x7f761815dd30 2024-05-08T10:54:51.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.331+0000 7f7616ffd640 1 --2- 172.21.15.33:0/2923714141 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f760406b500 0x7f760406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:51.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.331+0000 7f7616ffd640 1 -- 172.21.15.33:0/2923714141 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f760c08a430 con 0x7f761815dd30 2024-05-08T10:54:51.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.331+0000 7f761e51a640 1 --2- 172.21.15.33:0/2923714141 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f760406b500 0x7f760406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:51.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.332+0000 7f761e51a640 1 --2- 172.21.15.33:0/2923714141 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f760406b500 0x7f760406d9c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7608033000 tx=0x7f7608009000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:54:51.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.336+0000 7f7616ffd640 1 -- 172.21.15.33:0/2923714141 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f760c058cf0 con 0x7f761815dd30 2024-05-08T10:54:51.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:51.553+0000 7f762077e640 1 -- 172.21.15.33:0/2923714141 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f76180ca790 con 0x7f761815dd30 2024-05-08T10:54:52.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:52.535+0000 7f7616ffd640 1 -- 172.21.15.33:0/2923714141 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v6) v1 ==== 118+0+0 (secure 0 0 0) 0x7f760c05cd90 con 0x7f761815dd30 2024-05-08T10:54:52.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:52.538+0000 7f762077e640 1 -- 172.21.15.33:0/2923714141 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f760406b500 msgr2=0x7f760406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:52.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:52.538+0000 7f762077e640 1 --2- 172.21.15.33:0/2923714141 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f760406b500 0x7f760406d9c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7608033000 tx=0x7f7608009000 comp rx=0 tx=0).stop 2024-05-08T10:54:52.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:52.538+0000 7f762077e640 1 -- 172.21.15.33:0/2923714141 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f761815dd30 msgr2=0x7f76180cad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:52.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:52.538+0000 7f762077e640 1 --2- 172.21.15.33:0/2923714141 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f761815dd30 0x7f76180cad10 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f760c00d5f0 tx=0x7f760c00dab0 comp rx=0 tx=0).stop 2024-05-08T10:54:52.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:52.538+0000 7f762077e640 1 -- 172.21.15.33:0/2923714141 shutdown_connections 2024-05-08T10:54:52.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:52.538+0000 7f762077e640 1 --2- 172.21.15.33:0/2923714141 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f760406b500 0x7f760406d9c0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:52.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:52.538+0000 7f762077e640 1 --2- 172.21.15.33:0/2923714141 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f761815e110 0x7f7618151e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:52.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:52.538+0000 7f762077e640 1 --2- 172.21.15.33:0/2923714141 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f761815dd30 0x7f76180cad10 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:52.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:52.538+0000 7f762077e640 1 --2- 172.21.15.33:0/2923714141 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f76180d2220 0x7f76180b20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:52.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:52.538+0000 7f762077e640 1 -- 172.21.15.33:0/2923714141 >> 172.21.15.33:0/2923714141 conn(0x7f761809cf10 msgr2=0x7f76180d06b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:54:52.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:52.538+0000 7f762077e640 1 -- 172.21.15.33:0/2923714141 shutdown_connections 2024-05-08T10:54:52.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:52.538+0000 7f762077e640 1 -- 172.21.15.33:0/2923714141 wait complete. 2024-05-08T10:54:52.549 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-05-08T10:54:52.549 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-08T10:54:52.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:52.665+0000 7f3bb5a9a640 1 Processor -- start 2024-05-08T10:54:52.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:52.665+0000 7f3bb5a9a640 1 -- start start 2024-05-08T10:54:52.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:52.666+0000 7f3bb5a9a640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f3bb00d21c0 0x7f3bb00d25a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:52.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:52.666+0000 7f3bb5a9a640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f3bb00d18b0 0x7f3bb00cf1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:52.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:52.666+0000 7f3bb5a9a640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3bb00d0540 0x7f3bb00d0990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:52.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:52.666+0000 7f3bb5a9a640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bb00b7290 con 0x7f3bb00d21c0 2024-05-08T10:54:52.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:52.666+0000 7f3bb5a9a640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bb00d2ae0 con 0x7f3bb00d18b0 2024-05-08T10:54:52.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:52.666+0000 7f3bb5a9a640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb00cfa30 con 0x7f3bb00d0540 2024-05-08T10:54:52.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:52.666+0000 7f3baf7fe640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f3bb00d21c0 0x7f3bb00d25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:52.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:52.666+0000 7f3baf7fe640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f3bb00d21c0 0x7f3bb00d25a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46448/0 (socket says 172.21.15.33:46448) 2024-05-08T10:54:52.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:52.666+0000 7f3baf7fe640 1 -- 172.21.15.33:0/432604016 learned_addr learned my addr 172.21.15.33:0/432604016 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:54:52.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:52.666+0000 7f3baffff640 1 --2- 172.21.15.33:0/432604016 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3bb00d0540 0x7f3bb00d0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:52.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:52.666+0000 7f3baeffd640 1 --2- 172.21.15.33:0/432604016 >> v2:172.21.15.174:3300/0 conn(0x7f3bb00d18b0 0x7f3bb00cf1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:52.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:52.666+0000 7f3baf7fe640 1 -- 172.21.15.33:0/432604016 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3bb00d0540 msgr2=0x7f3bb00d0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:54:52.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:52.666+0000 7f3baf7fe640 1 --2- 172.21.15.33:0/432604016 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3bb00d0540 0x7f3bb00d0990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:52.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:52.666+0000 7f3baf7fe640 1 -- 172.21.15.33:0/432604016 >> v2:172.21.15.174:3300/0 conn(0x7f3bb00d18b0 msgr2=0x7f3bb00cf1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:54:52.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:52.666+0000 7f3baf7fe640 1 --2- 172.21.15.33:0/432604016 >> v2:172.21.15.174:3300/0 conn(0x7f3bb00d18b0 0x7f3bb00cf1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:52.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:52.666+0000 7f3baf7fe640 1 -- 172.21.15.33:0/432604016 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bb00b6c40 con 0x7f3bb00d21c0 2024-05-08T10:54:52.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:52.667+0000 7f3baf7fe640 1 --2- 172.21.15.33:0/432604016 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3bb00d21c0 0x7f3bb00d25a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3bb006b0e0 tx=0x7f3ba002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46f5fddd6404c844 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:54:52.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:52.667+0000 7f3bae7fc640 1 -- 172.21.15.33:0/432604016 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba0037070 con 0x7f3bb00d21c0 2024-05-08T10:54:52.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:52.667+0000 7f3bae7fc640 1 -- 172.21.15.33:0/432604016 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ba0032440 con 0x7f3bb00d21c0 2024-05-08T10:54:52.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:52.667+0000 7f3bae7fc640 1 -- 172.21.15.33:0/432604016 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba0032810 con 0x7f3bb00d21c0 2024-05-08T10:54:52.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:52.668+0000 7f3bb5a9a640 1 -- 172.21.15.33:0/432604016 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3bb00d21c0 msgr2=0x7f3bb00d25a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:52.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:52.668+0000 7f3bb5a9a640 1 --2- 172.21.15.33:0/432604016 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3bb00d21c0 0x7f3bb00d25a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3bb006b0e0 tx=0x7f3ba002a270 comp rx=0 tx=0).stop 2024-05-08T10:54:52.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:52.668+0000 7f3bb5a9a640 1 -- 172.21.15.33:0/432604016 shutdown_connections 2024-05-08T10:54:52.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:52.668+0000 7f3bb5a9a640 1 --2- 172.21.15.33:0/432604016 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3bb00d0540 0x7f3bb00d0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:52.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:52.668+0000 7f3bb5a9a640 1 --2- 172.21.15.33:0/432604016 >> v2:172.21.15.174:3300/0 conn(0x7f3bb00d18b0 0x7f3bb00cf1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:52.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:52.668+0000 7f3bb5a9a640 1 --2- 172.21.15.33:0/432604016 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3bb00d21c0 0x7f3bb00d25a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:52.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:52.668+0000 7f3bb5a9a640 1 -- 172.21.15.33:0/432604016 >> 172.21.15.33:0/432604016 conn(0x7f3bb00d3be0 msgr2=0x7f3bb00d3ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:54:52.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:52.668+0000 7f3bb5a9a640 1 -- 172.21.15.33:0/432604016 shutdown_connections 2024-05-08T10:54:52.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:52.668+0000 7f3bb5a9a640 1 -- 172.21.15.33:0/432604016 wait complete. 2024-05-08T10:54:52.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:52.669+0000 7f3bb5a9a640 1 Processor -- start 2024-05-08T10:54:52.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:52.669+0000 7f3bb5a9a640 1 -- start start 2024-05-08T10:54:52.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:52.670+0000 7f3bb5a9a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3bb00d0540 0x7f3bb009e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:52.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:52.670+0000 7f3bb5a9a640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3bb00d18b0 0x7f3bb00cd270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:52.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:52.670+0000 7f3bb5a9a640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3bb00d21c0 0x7f3bb0150760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:52.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:52.670+0000 7f3bb5a9a640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb00cf710 con 0x7f3bb00d0540 2024-05-08T10:54:52.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:52.670+0000 7f3bb5a9a640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb015e340 con 0x7f3bb00d18b0 2024-05-08T10:54:52.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:52.670+0000 7f3bb5a9a640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb00d0ed0 con 0x7f3bb00d21c0 2024-05-08T10:54:52.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:52.670+0000 7f3baf7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3bb00d0540 0x7f3bb009e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:52.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:52.670+0000 7f3baf7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3bb00d0540 0x7f3bb009e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46460/0 (socket says 172.21.15.33:46460) 2024-05-08T10:54:52.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:52.670+0000 7f3baf7fe640 1 -- 172.21.15.33:0/674461914 learned_addr learned my addr 172.21.15.33:0/674461914 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:54:52.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:52.670+0000 7f3baffff640 1 --2- 172.21.15.33:0/674461914 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3bb00d21c0 0x7f3bb0150760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:52.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:52.670+0000 7f3baeffd640 1 --2- 172.21.15.33:0/674461914 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3bb00d18b0 0x7f3bb00cd270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:52.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:52.670+0000 7f3baf7fe640 1 -- 172.21.15.33:0/674461914 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3bb00d21c0 msgr2=0x7f3bb0150760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:52.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:52.671+0000 7f3baf7fe640 1 --2- 172.21.15.33:0/674461914 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3bb00d21c0 0x7f3bb0150760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:52.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:52.671+0000 7f3baf7fe640 1 -- 172.21.15.33:0/674461914 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3bb00d18b0 msgr2=0x7f3bb00cd270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:52.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:52.671+0000 7f3baf7fe640 1 --2- 172.21.15.33:0/674461914 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3bb00d18b0 0x7f3bb00cd270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:52.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:52.671+0000 7f3baf7fe640 1 -- 172.21.15.33:0/674461914 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bb0151230 con 0x7f3bb00d0540 2024-05-08T10:54:52.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:52.671+0000 7f3baeffd640 1 --2- 172.21.15.33:0/674461914 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3bb00d18b0 0x7f3bb00cd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T10:54:52.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:52.671+0000 7f3baffff640 1 --2- 172.21.15.33:0/674461914 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3bb00d21c0 0x7f3bb0150760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T10:54:52.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:52.671+0000 7f3baf7fe640 1 --2- 172.21.15.33:0/674461914 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3bb00d0540 0x7f3bb009e440 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3ba0000c00 tx=0x7f3ba00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:54:52.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:52.671+0000 7f3b97fff640 1 -- 172.21.15.33:0/674461914 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba0041020 con 0x7f3bb00d0540 2024-05-08T10:54:52.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:52.671+0000 7f3b97fff640 1 -- 172.21.15.33:0/674461914 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ba00306c0 con 0x7f3bb00d0540 2024-05-08T10:54:52.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:52.671+0000 7f3b97fff640 1 -- 172.21.15.33:0/674461914 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba0037040 con 0x7f3bb00d0540 2024-05-08T10:54:52.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:52.671+0000 7f3bb5a9a640 1 -- 172.21.15.33:0/674461914 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bb0151510 con 0x7f3bb00d0540 2024-05-08T10:54:52.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:52.671+0000 7f3bb5a9a640 1 -- 172.21.15.33:0/674461914 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bb0151ad0 con 0x7f3bb00d0540 2024-05-08T10:54:52.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:52.672+0000 7f3bb5a9a640 1 -- 172.21.15.33:0/674461914 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bb0069d20 con 0x7f3bb00d0540 2024-05-08T10:54:52.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:52.672+0000 7f3b97fff640 1 -- 172.21.15.33:0/674461914 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3ba0044020 con 0x7f3bb00d0540 2024-05-08T10:54:52.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:52.673+0000 7f3b97fff640 1 --2- 172.21.15.33:0/674461914 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f3b9c06b4d0 0x7f3b9c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:52.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:52.673+0000 7f3b97fff640 1 -- 172.21.15.33:0/674461914 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3ba00aa8c0 con 0x7f3bb00d0540 2024-05-08T10:54:52.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:52.673+0000 7f3baeffd640 1 --2- 172.21.15.33:0/674461914 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f3b9c06b4d0 0x7f3b9c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:52.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:52.674+0000 7f3baeffd640 1 --2- 172.21.15.33:0/674461914 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f3b9c06b4d0 0x7f3b9c06d990 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3bb00b4b80 tx=0x7f3ba4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:54:52.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:52.677+0000 7f3b97fff640 1 -- 172.21.15.33:0/674461914 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3ba004b030 con 0x7f3bb00d0540 2024-05-08T10:54:52.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:52.895+0000 7f3bb5a9a640 1 -- 172.21.15.33:0/674461914 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f3bb00b9a50 con 0x7f3bb00d0540 2024-05-08T10:54:53.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:53.543+0000 7f3b97fff640 1 -- 172.21.15.33:0/674461914 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v7) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3ba00790f0 con 0x7f3bb00d0540 2024-05-08T10:54:53.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:53.546+0000 7f3bb5a9a640 1 -- 172.21.15.33:0/674461914 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f3b9c06b4d0 msgr2=0x7f3b9c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:53.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:53.546+0000 7f3bb5a9a640 1 --2- 172.21.15.33:0/674461914 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f3b9c06b4d0 0x7f3b9c06d990 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3bb00b4b80 tx=0x7f3ba4008040 comp rx=0 tx=0).stop 2024-05-08T10:54:53.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:53.546+0000 7f3bb5a9a640 1 -- 172.21.15.33:0/674461914 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3bb00d0540 msgr2=0x7f3bb009e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:53.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:53.546+0000 7f3bb5a9a640 1 --2- 172.21.15.33:0/674461914 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3bb00d0540 0x7f3bb009e440 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3ba0000c00 tx=0x7f3ba00046c0 comp rx=0 tx=0).stop 2024-05-08T10:54:53.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:53.546+0000 7f3bb5a9a640 1 -- 172.21.15.33:0/674461914 shutdown_connections 2024-05-08T10:54:53.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:53.546+0000 7f3bb5a9a640 1 --2- 172.21.15.33:0/674461914 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f3b9c06b4d0 0x7f3b9c06d990 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:53.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:53.546+0000 7f3bb5a9a640 1 --2- 172.21.15.33:0/674461914 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3bb00d21c0 0x7f3bb0150760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:53.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:53.546+0000 7f3bb5a9a640 1 --2- 172.21.15.33:0/674461914 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3bb00d18b0 0x7f3bb00cd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:53.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:53.546+0000 7f3bb5a9a640 1 --2- 172.21.15.33:0/674461914 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3bb00d0540 0x7f3bb009e440 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:53.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:53.546+0000 7f3bb5a9a640 1 -- 172.21.15.33:0/674461914 >> 172.21.15.33:0/674461914 conn(0x7f3bb00d3be0 msgr2=0x7f3bb00b8550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:54:53.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:53.546+0000 7f3bb5a9a640 1 -- 172.21.15.33:0/674461914 shutdown_connections 2024-05-08T10:54:53.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:53.546+0000 7f3bb5a9a640 1 -- 172.21.15.33:0/674461914 wait complete. 2024-05-08T10:54:53.556 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-08T10:54:53.556 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T10:54:53.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:53.665+0000 7f8ea7f9e640 1 Processor -- start 2024-05-08T10:54:53.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:53.666+0000 7f8ea7f9e640 1 -- start start 2024-05-08T10:54:53.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:53.666+0000 7f8ea7f9e640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8ea00d4960 0x7f8ea00d17e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:53.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:53.666+0000 7f8ea7f9e640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f8ea00d1e10 0x7f8ea00d2240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:53.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:53.666+0000 7f8ea7f9e640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ea00ce720 con 0x7f8ea01613a0 2024-05-08T10:54:53.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:53.666+0000 7f8ea7f9e640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ea00cf010 con 0x7f8ea00d1e10 2024-05-08T10:54:53.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:53.666+0000 7f8ea7f9e640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea00d2780 con 0x7f8ea00d4960 2024-05-08T10:54:53.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:53.667+0000 7f8ea653b640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f8ea00d1e10 0x7f8ea00d2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:53.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:53.667+0000 7f8ea653b640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f8ea00d1e10 0x7f8ea00d2240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46468/0 (socket says 172.21.15.33:46468) 2024-05-08T10:54:53.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:53.667+0000 7f8ea653b640 1 -- 172.21.15.33:0/1921881134 learned_addr learned my addr 172.21.15.33:0/1921881134 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:54:53.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:53.667+0000 7f8ea5539640 1 --2- 172.21.15.33:0/1921881134 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8ea00d4960 0x7f8ea00d17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:53.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:53.667+0000 7f8ea653b640 1 -- 172.21.15.33:0/1921881134 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8ea00d4960 msgr2=0x7f8ea00d17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:54:53.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:53.667+0000 7f8ea653b640 1 --2- 172.21.15.33:0/1921881134 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8ea00d4960 0x7f8ea00d17e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:53.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:53.667+0000 7f8ea653b640 1 -- 172.21.15.33:0/1921881134 >> v1:172.21.15.174:6789/0 conn(0x7f8ea01613a0 legacy=0x7f8ea00cf4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:53.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:53.667+0000 7f8ea653b640 1 -- 172.21.15.33:0/1921881134 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ea00d12d0 con 0x7f8ea00d1e10 2024-05-08T10:54:53.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:53.668+0000 7f8ea653b640 1 --2- 172.21.15.33:0/1921881134 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ea00d1e10 0x7f8ea00d2240 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8e98009e50 tx=0x7f8e9802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df8a121ac5308297 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:54:53.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:53.668+0000 7f8ea4d38640 1 -- 172.21.15.33:0/1921881134 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e98036070 con 0x7f8ea00d1e10 2024-05-08T10:54:53.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:53.668+0000 7f8ea4d38640 1 -- 172.21.15.33:0/1921881134 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e98031600 con 0x7f8ea00d1e10 2024-05-08T10:54:53.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:53.668+0000 7f8ea4d38640 1 -- 172.21.15.33:0/1921881134 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e980319d0 con 0x7f8ea00d1e10 2024-05-08T10:54:53.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:53.668+0000 7f8ea7f9e640 1 -- 172.21.15.33:0/1921881134 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ea00d1e10 msgr2=0x7f8ea00d2240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:53.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:53.668+0000 7f8ea7f9e640 1 --2- 172.21.15.33:0/1921881134 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ea00d1e10 0x7f8ea00d2240 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8e98009e50 tx=0x7f8e9802a710 comp rx=0 tx=0).stop 2024-05-08T10:54:53.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:53.668+0000 7f8ea7f9e640 1 -- 172.21.15.33:0/1921881134 shutdown_connections 2024-05-08T10:54:53.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:53.668+0000 7f8ea7f9e640 1 --2- 172.21.15.33:0/1921881134 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ea00d1e10 0x7f8ea00d2240 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:53.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:53.668+0000 7f8ea7f9e640 1 --2- 172.21.15.33:0/1921881134 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8ea00d4960 0x7f8ea00d17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:53.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:53.668+0000 7f8ea7f9e640 1 -- 172.21.15.33:0/1921881134 >> 172.21.15.33:0/1921881134 conn(0x7f8ea00d3c10 msgr2=0x7f8ea00d4020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:54:53.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:53.668+0000 7f8ea7f9e640 1 -- 172.21.15.33:0/1921881134 shutdown_connections 2024-05-08T10:54:53.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:53.668+0000 7f8ea7f9e640 1 -- 172.21.15.33:0/1921881134 wait complete. 2024-05-08T10:54:53.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:53.670+0000 7f8ea7f9e640 1 Processor -- start 2024-05-08T10:54:53.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:53.670+0000 7f8ea7f9e640 1 -- start start 2024-05-08T10:54:53.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:53.670+0000 7f8ea7f9e640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8ea00d1e10 0x7f8ea014a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:53.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:53.670+0000 7f8ea7f9e640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8ea00d4960 0x7f8ea00cace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:53.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:53.670+0000 7f8ea7f9e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ea01613a0 0x7f8ea00cb220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:53.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:53.670+0000 7f8ea7f9e640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea00cfbb0 con 0x7f8ea01613a0 2024-05-08T10:54:53.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:53.670+0000 7f8ea7f9e640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea00ceca0 con 0x7f8ea00d1e10 2024-05-08T10:54:53.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:53.670+0000 7f8ea7f9e640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea00d0f80 con 0x7f8ea00d4960 2024-05-08T10:54:53.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:53.670+0000 7f8ea653b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ea01613a0 0x7f8ea00cb220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:53.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:53.670+0000 7f8ea653b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ea01613a0 0x7f8ea00cb220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46476/0 (socket says 172.21.15.33:46476) 2024-05-08T10:54:53.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:53.670+0000 7f8ea653b640 1 -- 172.21.15.33:0/306115195 learned_addr learned my addr 172.21.15.33:0/306115195 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:54:53.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:53.671+0000 7f8ea653b640 1 -- 172.21.15.33:0/306115195 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8ea00d4960 msgr2=0x7f8ea00cace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:53.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:53.671+0000 7f8ea653b640 1 --2- 172.21.15.33:0/306115195 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8ea00d4960 0x7f8ea00cace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:53.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:53.671+0000 7f8ea653b640 1 -- 172.21.15.33:0/306115195 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8ea00d1e10 msgr2=0x7f8ea014a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:53.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:53.671+0000 7f8ea653b640 1 --2- 172.21.15.33:0/306115195 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8ea00d1e10 0x7f8ea014a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:53.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:53.671+0000 7f8ea653b640 1 -- 172.21.15.33:0/306115195 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ea00b8ae0 con 0x7f8ea01613a0 2024-05-08T10:54:53.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:53.671+0000 7f8ea653b640 1 --2- 172.21.15.33:0/306115195 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ea01613a0 0x7f8ea00cb220 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8e98009e50 tx=0x7f8e98004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:54:53.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:53.671+0000 7f8e967fc640 1 -- 172.21.15.33:0/306115195 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e98036050 con 0x7f8ea01613a0 2024-05-08T10:54:53.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:53.671+0000 7f8e967fc640 1 -- 172.21.15.33:0/306115195 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e98042070 con 0x7f8ea01613a0 2024-05-08T10:54:53.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:53.671+0000 7f8e967fc640 1 -- 172.21.15.33:0/306115195 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e98009510 con 0x7f8ea01613a0 2024-05-08T10:54:53.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:53.671+0000 7f8ea7f9e640 1 -- 172.21.15.33:0/306115195 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ea00b8dc0 con 0x7f8ea01613a0 2024-05-08T10:54:53.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:53.671+0000 7f8ea7f9e640 1 -- 172.21.15.33:0/306115195 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ea00b9380 con 0x7f8ea01613a0 2024-05-08T10:54:53.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:53.672+0000 7f8ea7f9e640 1 -- 172.21.15.33:0/306115195 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ea00b9760 con 0x7f8ea01613a0 2024-05-08T10:54:53.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:53.673+0000 7f8e967fc640 1 -- 172.21.15.33:0/306115195 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8e98007bd0 con 0x7f8ea01613a0 2024-05-08T10:54:53.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:53.673+0000 7f8e967fc640 1 --2- 172.21.15.33:0/306115195 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f8e8406b4d0 0x7f8e8406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:53.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:53.673+0000 7f8e967fc640 1 -- 172.21.15.33:0/306115195 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8e980ab020 con 0x7f8ea01613a0 2024-05-08T10:54:53.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:53.673+0000 7f8ea5d3a640 1 --2- 172.21.15.33:0/306115195 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f8e8406b4d0 0x7f8e8406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:53.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:53.674+0000 7f8ea5d3a640 1 --2- 172.21.15.33:0/306115195 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f8e8406b4d0 0x7f8e8406d990 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c000f60 tx=0x7f8e9c0079d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:54:53.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:53.677+0000 7f8e967fc640 1 -- 172.21.15.33:0/306115195 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8e98045360 con 0x7f8ea01613a0 2024-05-08T10:54:53.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:53.894+0000 7f8ea7f9e640 1 -- 172.21.15.33:0/306115195 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8ea0069d20 con 0x7f8ea01613a0 2024-05-08T10:54:53.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:53.894+0000 7f8e967fc640 1 -- 172.21.15.33:0/306115195 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4935 (secure 0 0 0) 0x7f8e98079f30 con 0x7f8ea01613a0 2024-05-08T10:54:53.892 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:54:53.892 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4262,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6837/974626320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6835","nonce":974626320},{"type":"v1","addr":"172.21.15.174:6837","nonce":974626320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6834/3541391922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":3541391922},{"type":"v1","addr":"172.21.15.33:6834","nonce":3541391922}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/1492311153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6833","nonce":1492311153},{"type":"v1","addr":"172.21.15.33:6835","nonce":1492311153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T10:54:49.885783+0000","modified":"2024-05-08T10:54:52.897089+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.174:6836/2139245090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2139245090},{"type":"v1","addr":"172.21.15.174:6836","nonce":2139245090}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T10:54:53.892 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 7 2024-05-08T10:54:53.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:53.896+0000 7f8ea7f9e640 1 -- 172.21.15.33:0/306115195 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f8e8406b4d0 msgr2=0x7f8e8406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:53.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:53.896+0000 7f8ea7f9e640 1 --2- 172.21.15.33:0/306115195 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f8e8406b4d0 0x7f8e8406d990 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c000f60 tx=0x7f8e9c0079d0 comp rx=0 tx=0).stop 2024-05-08T10:54:53.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:53.896+0000 7f8ea7f9e640 1 -- 172.21.15.33:0/306115195 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ea01613a0 msgr2=0x7f8ea00cb220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:53.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:53.896+0000 7f8ea7f9e640 1 --2- 172.21.15.33:0/306115195 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ea01613a0 0x7f8ea00cb220 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8e98009e50 tx=0x7f8e98004a40 comp rx=0 tx=0).stop 2024-05-08T10:54:53.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:53.896+0000 7f8ea7f9e640 1 -- 172.21.15.33:0/306115195 shutdown_connections 2024-05-08T10:54:53.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:53.896+0000 7f8ea7f9e640 1 --2- 172.21.15.33:0/306115195 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f8e8406b4d0 0x7f8e8406d990 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:53.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:53.896+0000 7f8ea7f9e640 1 --2- 172.21.15.33:0/306115195 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ea01613a0 0x7f8ea00cb220 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:53.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:53.896+0000 7f8ea7f9e640 1 --2- 172.21.15.33:0/306115195 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8ea00d4960 0x7f8ea00cace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:53.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:53.896+0000 7f8ea7f9e640 1 --2- 172.21.15.33:0/306115195 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8ea00d1e10 0x7f8ea014a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:53.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:53.896+0000 7f8ea7f9e640 1 -- 172.21.15.33:0/306115195 >> 172.21.15.33:0/306115195 conn(0x7f8ea00d3c10 msgr2=0x7f8ea00b1e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:54:53.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:53.897+0000 7f8ea7f9e640 1 -- 172.21.15.33:0/306115195 shutdown_connections 2024-05-08T10:54:53.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:53.897+0000 7f8ea7f9e640 1 -- 172.21.15.33:0/306115195 wait complete. 2024-05-08T10:54:53.905 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T10:54:54.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.011+0000 7f944ef6a640 1 Processor -- start 2024-05-08T10:54:54.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.011+0000 7f944ef6a640 1 -- start start 2024-05-08T10:54:54.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.012+0000 7f944ef6a640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f94481613a0 0x7f94480d17e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:54.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.012+0000 7f944ef6a640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94480ce720 con 0x7f94480d4960 2024-05-08T10:54:54.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.012+0000 7f944ef6a640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94480d12d0 con 0x7f94480d1e10 2024-05-08T10:54:54.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.012+0000 7f944ef6a640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94480cf010 con 0x7f94481613a0 2024-05-08T10:54:54.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.012+0000 7f9447fff640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f94480d4960 0x7f94480cf4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:45444/0 (socket says 172.21.15.33:45444) 2024-05-08T10:54:54.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.012+0000 7f9447fff640 1 -- 172.21.15.33:0/1633250600 learned_addr learned my addr 172.21.15.33:0/1633250600 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-05-08T10:54:54.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.012+0000 7f944cd06640 1 --2- 172.21.15.33:0/1633250600 >> v2:172.21.15.174:3300/0 conn(0x7f94481613a0 0x7f94480d17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:54.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.012+0000 7f94477fe640 1 -- 172.21.15.33:0/1633250600 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3355211418 0 0) 0x7f94480ce720 con 0x7f94480d4960 2024-05-08T10:54:54.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.012+0000 7f94477fe640 1 -- 172.21.15.33:0/1633250600 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9438003520 con 0x7f94480d4960 2024-05-08T10:54:54.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.012+0000 7f94477fe640 1 -- 172.21.15.33:0/1633250600 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3289468394 0 0) 0x7f9438003520 con 0x7f94480d4960 2024-05-08T10:54:54.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.012+0000 7f94477fe640 1 -- 172.21.15.33:0/1633250600 >> v2:172.21.15.174:3300/0 conn(0x7f94481613a0 msgr2=0x7f94480d17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:54:54.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.012+0000 7f94477fe640 1 --2- 172.21.15.33:0/1633250600 >> v2:172.21.15.174:3300/0 conn(0x7f94481613a0 0x7f94480d17e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:54.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.012+0000 7f94477fe640 1 -- 172.21.15.33:0/1633250600 >> v1:172.21.15.174:6789/0 conn(0x7f94480d1e10 legacy=0x7f94480d2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:54.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.012+0000 7f94477fe640 1 -- 172.21.15.33:0/1633250600 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94480ce9c0 con 0x7f94480d4960 2024-05-08T10:54:54.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.012+0000 7f94477fe640 1 -- 172.21.15.33:0/1633250600 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2948294915 0 0) 0x7f9434001690 con 0x7f94480d4960 2024-05-08T10:54:54.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.012+0000 7f94477fe640 1 -- 172.21.15.33:0/1633250600 >> v1:172.21.15.33:6789/0 conn(0x7f94480d4960 legacy=0x7f94480cf4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:54.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.012+0000 7f94477fe640 1 --2- 172.21.15.33:0/1633250600 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f94380039b0 0x7f9438003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:54.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.012+0000 7f94477fe640 1 --2- 172.21.15.33:0/1633250600 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9438004800 0x7f9438004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:54.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.012+0000 7f94477fe640 1 --2- 172.21.15.33:0/1633250600 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f94380051c0 0x7f943800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:54.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.013+0000 7f94477fe640 1 -- 172.21.15.33:0/1633250600 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94480cf010 con 0x7f9438004800 2024-05-08T10:54:54.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.013+0000 7f94477fe640 1 -- 172.21.15.33:0/1633250600 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f943800c060 con 0x7f94380051c0 2024-05-08T10:54:54.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.013+0000 7f94477fe640 1 -- 172.21.15.33:0/1633250600 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f943800c260 con 0x7f94380039b0 2024-05-08T10:54:54.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.013+0000 7f9447fff640 1 --2- 172.21.15.33:0/1633250600 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9438004800 0x7f9438004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:54.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.013+0000 7f944cd06640 1 --2- 172.21.15.33:0/1633250600 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f94380039b0 0x7f9438003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:54.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.013+0000 7f944d507640 1 --2- 172.21.15.33:0/1633250600 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f94380051c0 0x7f943800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:54.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.013+0000 7f9447fff640 1 -- 172.21.15.33:0/1633250600 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f94380039b0 msgr2=0x7f9438003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:54:54.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.013+0000 7f9447fff640 1 --2- 172.21.15.33:0/1633250600 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f94380039b0 0x7f9438003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:54.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.013+0000 7f9447fff640 1 -- 172.21.15.33:0/1633250600 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f94380051c0 msgr2=0x7f943800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:54:54.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.013+0000 7f9447fff640 1 --2- 172.21.15.33:0/1633250600 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f94380051c0 0x7f943800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:54.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.013+0000 7f944d507640 1 -- 172.21.15.33:0/1633250600 reap_dead start 2024-05-08T10:54:54.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.013+0000 7f9447fff640 1 -- 172.21.15.33:0/1633250600 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9438003520 con 0x7f9438004800 2024-05-08T10:54:54.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.014+0000 7f9447fff640 1 --2- 172.21.15.33:0/1633250600 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9438004800 0x7f9438004c80 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f943400c210 tx=0x7f9438005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5153a4ca4f829c0e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:54:54.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.014+0000 7f94477fe640 1 -- 172.21.15.33:0/1633250600 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9434007d10 con 0x7f9438004800 2024-05-08T10:54:54.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.014+0000 7f94477fe640 1 -- 172.21.15.33:0/1633250600 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9434005ad0 con 0x7f9438004800 2024-05-08T10:54:54.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.014+0000 7f94477fe640 1 -- 172.21.15.33:0/1633250600 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9434007070 con 0x7f9438004800 2024-05-08T10:54:54.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.014+0000 7f944ef6a640 1 -- 172.21.15.33:0/1633250600 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9438004800 msgr2=0x7f9438004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:54.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.014+0000 7f944ef6a640 1 --2- 172.21.15.33:0/1633250600 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9438004800 0x7f9438004c80 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f943400c210 tx=0x7f9438005830 comp rx=0 tx=0).stop 2024-05-08T10:54:54.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.014+0000 7f944ef6a640 1 -- 172.21.15.33:0/1633250600 shutdown_connections 2024-05-08T10:54:54.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.014+0000 7f944ef6a640 1 --2- 172.21.15.33:0/1633250600 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9438004800 0x7f9438004c80 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:54.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.014+0000 7f944ef6a640 1 -- 172.21.15.33:0/1633250600 >> 172.21.15.33:0/1633250600 conn(0x7f94480d3c10 msgr2=0x7f94480d4020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:54:54.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.014+0000 7f944ef6a640 1 -- 172.21.15.33:0/1633250600 shutdown_connections 2024-05-08T10:54:54.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.014+0000 7f944ef6a640 1 -- 172.21.15.33:0/1633250600 wait complete. 2024-05-08T10:54:54.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.016+0000 7f944ef6a640 1 Processor -- start 2024-05-08T10:54:54.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.016+0000 7f944ef6a640 1 -- start start 2024-05-08T10:54:54.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.016+0000 7f944ef6a640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9438004800 0x7f944815bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:54.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.016+0000 7f944ef6a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9448158c90 0x7f94481590f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:54.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.016+0000 7f944ef6a640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f944815e690 0x7f944815eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:54.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.016+0000 7f944ef6a640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9448161780 con 0x7f9448158c90 2024-05-08T10:54:54.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.016+0000 7f944ef6a640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94480d0f80 con 0x7f944815e690 2024-05-08T10:54:54.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.016+0000 7f944ef6a640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9448161900 con 0x7f9438004800 2024-05-08T10:54:54.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.017+0000 7f9447fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9448158c90 0x7f94481590f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:54.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.017+0000 7f9447fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9448158c90 0x7f94481590f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46500/0 (socket says 172.21.15.33:46500) 2024-05-08T10:54:54.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.017+0000 7f9447fff640 1 -- 172.21.15.33:0/3374588822 learned_addr learned my addr 172.21.15.33:0/3374588822 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:54:54.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.017+0000 7f944d507640 1 --2- 172.21.15.33:0/3374588822 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f944815e690 0x7f944815eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:54.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.017+0000 7f944cd06640 1 --2- 172.21.15.33:0/3374588822 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9438004800 0x7f944815bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:54.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.017+0000 7f9447fff640 1 -- 172.21.15.33:0/3374588822 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9438004800 msgr2=0x7f944815bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:54.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.017+0000 7f9447fff640 1 --2- 172.21.15.33:0/3374588822 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9438004800 0x7f944815bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:54.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.017+0000 7f9447fff640 1 -- 172.21.15.33:0/3374588822 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f944815e690 msgr2=0x7f944815eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:54.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.017+0000 7f9447fff640 1 --2- 172.21.15.33:0/3374588822 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f944815e690 0x7f944815eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:54.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.017+0000 7f9447fff640 1 -- 172.21.15.33:0/3374588822 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f944815b020 con 0x7f9448158c90 2024-05-08T10:54:54.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.017+0000 7f944d507640 1 --2- 172.21.15.33:0/3374588822 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f944815e690 0x7f944815eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:54:54.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.017+0000 7f9447fff640 1 --2- 172.21.15.33:0/3374588822 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9448158c90 0x7f94481590f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f943400c300 tx=0x7f94480d14a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:54:54.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.017+0000 7f94457fa640 1 -- 172.21.15.33:0/3374588822 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9434041020 con 0x7f9448158c90 2024-05-08T10:54:54.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.017+0000 7f94457fa640 1 -- 172.21.15.33:0/3374588822 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9434038040 con 0x7f9448158c90 2024-05-08T10:54:54.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.017+0000 7f944ef6a640 1 -- 172.21.15.33:0/3374588822 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f944814ae60 con 0x7f9448158c90 2024-05-08T10:54:54.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.017+0000 7f94457fa640 1 -- 172.21.15.33:0/3374588822 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9434007070 con 0x7f9448158c90 2024-05-08T10:54:54.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.017+0000 7f944ef6a640 1 -- 172.21.15.33:0/3374588822 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f944815b5c0 con 0x7f9448158c90 2024-05-08T10:54:54.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.018+0000 7f944ef6a640 1 -- 172.21.15.33:0/3374588822 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9448069d20 con 0x7f9448158c90 2024-05-08T10:54:54.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.019+0000 7f94457fa640 1 -- 172.21.15.33:0/3374588822 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9434044020 con 0x7f9448158c90 2024-05-08T10:54:54.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.019+0000 7f94457fa640 1 --2- 172.21.15.33:0/3374588822 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f942c06b4d0 0x7f942c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:54.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.019+0000 7f94457fa640 1 -- 172.21.15.33:0/3374588822 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f94340aa2c0 con 0x7f9448158c90 2024-05-08T10:54:54.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.019+0000 7f944cd06640 1 --2- 172.21.15.33:0/3374588822 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f942c06b4d0 0x7f942c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:54.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.020+0000 7f944cd06640 1 --2- 172.21.15.33:0/3374588822 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f942c06b4d0 0x7f942c06d990 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f943c009b80 tx=0x7f943c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:54:54.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.023+0000 7f94457fa640 1 -- 172.21.15.33:0/3374588822 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9434079260 con 0x7f9448158c90 2024-05-08T10:54:54.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.205+0000 7f944ef6a640 1 -- 172.21.15.33:0/3374588822 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f944808d980 con 0x7f9448158c90 2024-05-08T10:54:54.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.206+0000 7f94457fa640 1 -- 172.21.15.33:0/3374588822 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16617 (secure 0 0 0) 0x7f9434078b60 con 0x7f9448158c90 2024-05-08T10:54:54.204 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:54:54.204 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":20,"fsid":"963217b2-c375-4f5a-95cf-88e199dd38ff","created":"2024-05-08T10:54:26.711528+0000","modified":"2024-05-08T10:54:51.528856+0000","last_up_change":"2024-05-08T10:54:37.987478+0000","last_in_change":"2024-05-08T10:54:28.834106+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T10:54:38.989228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T10:54:47.774236+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T10:54:48.869679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c5da4fb5-d4f2-4982-a804-2aa92fe77731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3990629207},{"type":"v1","addr":"172.21.15.33:6817","nonce":3990629207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3990629207},{"type":"v1","addr":"172.21.15.33:6819","nonce":3990629207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3990629207},{"type":"v1","addr":"172.21.15.33:6823","nonce":3990629207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3990629207},{"type":"v1","addr":"172.21.15.33:6821","nonce":3990629207}]},"public_addr":"172.21.15.33:6817/3990629207","cluster_addr":"172.21.15.33:6819/3990629207","heartbeat_back_addr":"172.21.15.33:6823/3990629207","heartbeat_front_addr":"172.21.15.33:6821/3990629207","state":["exists","up"]},{"osd":1,"uuid":"f8fdd8db-c2a3-4d28-81f3-b30f44bea7c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":1758076090},{"type":"v1","addr":"172.21.15.33:6825","nonce":1758076090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":1758076090},{"type":"v1","addr":"172.21.15.33:6827","nonce":1758076090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":1758076090},{"type":"v1","addr":"172.21.15.33:6831","nonce":1758076090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":1758076090},{"type":"v1","addr":"172.21.15.33:6829","nonce":1758076090}]},"public_addr":"172.21.15.33:6825/1758076090","cluster_addr":"172.21.15.33:6827/1758076090","heartbeat_back_addr":"172.21.15.33:6831/1758076090","heartbeat_front_addr":"172.21.15.33:6829/1758076090","state":["exists","up"]},{"osd":2,"uuid":"87d465f3-b40f-48dd-bae2-4c67904d4828","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":2940853479},{"type":"v1","addr":"172.21.15.33:6801","nonce":2940853479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6803","nonce":2940853479},{"type":"v1","addr":"172.21.15.33:6805","nonce":2940853479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6811","nonce":2940853479},{"type":"v1","addr":"172.21.15.33:6813","nonce":2940853479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6807","nonce":2940853479},{"type":"v1","addr":"172.21.15.33:6809","nonce":2940853479}]},"public_addr":"172.21.15.33:6801/2940853479","cluster_addr":"172.21.15.33:6805/2940853479","heartbeat_back_addr":"172.21.15.33:6813/2940853479","heartbeat_front_addr":"172.21.15.33:6809/2940853479","state":["exists","up"]},{"osd":3,"uuid":"79450edf-9637-4181-9372-e1cd5e91e73e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":4029047077},{"type":"v1","addr":"172.21.15.33:6804","nonce":4029047077}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":4029047077},{"type":"v1","addr":"172.21.15.33:6808","nonce":4029047077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":4029047077},{"type":"v1","addr":"172.21.15.33:6815","nonce":4029047077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":4029047077},{"type":"v1","addr":"172.21.15.33:6812","nonce":4029047077}]},"public_addr":"172.21.15.33:6804/4029047077","cluster_addr":"172.21.15.33:6808/4029047077","heartbeat_back_addr":"172.21.15.33:6815/4029047077","heartbeat_front_addr":"172.21.15.33:6812/4029047077","state":["exists","up"]},{"osd":4,"uuid":"bd0debfa-e559-4b1e-920d-6b2639c7085e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":1697399220},{"type":"v1","addr":"172.21.15.174:6801","nonce":1697399220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":1697399220},{"type":"v1","addr":"172.21.15.174:6803","nonce":1697399220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":1697399220},{"type":"v1","addr":"172.21.15.174:6807","nonce":1697399220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":1697399220},{"type":"v1","addr":"172.21.15.174:6805","nonce":1697399220}]},"public_addr":"172.21.15.174:6801/1697399220","cluster_addr":"172.21.15.174:6803/1697399220","heartbeat_back_addr":"172.21.15.174:6807/1697399220","heartbeat_front_addr":"172.21.15.174:6805/1697399220","state":["exists","up"]},{"osd":5,"uuid":"ff0f51c0-672b-448f-9de1-b9305ce8c00d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":1511860729},{"type":"v1","addr":"172.21.15.174:6825","nonce":1511860729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":1511860729},{"type":"v1","addr":"172.21.15.174:6827","nonce":1511860729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":1511860729},{"type":"v1","addr":"172.21.15.174:6831","nonce":1511860729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":1511860729},{"type":"v1","addr":"172.21.15.174:6829","nonce":1511860729}]},"public_addr":"172.21.15.174:6825/1511860729","cluster_addr":"172.21.15.174:6827/1511860729","heartbeat_back_addr":"172.21.15.174:6831/1511860729","heartbeat_front_addr":"172.21.15.174:6829/1511860729","state":["exists","up"]},{"osd":6,"uuid":"93061f6c-c0ce-47e9-88a0-1151c5ccb4e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":2326407945},{"type":"v1","addr":"172.21.15.174:6817","nonce":2326407945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":2326407945},{"type":"v1","addr":"172.21.15.174:6819","nonce":2326407945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":2326407945},{"type":"v1","addr":"172.21.15.174:6823","nonce":2326407945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":2326407945},{"type":"v1","addr":"172.21.15.174:6821","nonce":2326407945}]},"public_addr":"172.21.15.174:6817/2326407945","cluster_addr":"172.21.15.174:6819/2326407945","heartbeat_back_addr":"172.21.15.174:6823/2326407945","heartbeat_front_addr":"172.21.15.174:6821/2326407945","state":["exists","up"]},{"osd":7,"uuid":"7be1dcf3-1957-4ec3-bacf-f5f9fff580a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":1637570253},{"type":"v1","addr":"172.21.15.174:6809","nonce":1637570253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":1637570253},{"type":"v1","addr":"172.21.15.174:6811","nonce":1637570253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":1637570253},{"type":"v1","addr":"172.21.15.174:6815","nonce":1637570253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":1637570253},{"type":"v1","addr":"172.21.15.174:6813","nonce":1637570253}]},"public_addr":"172.21.15.174:6809/1637570253","cluster_addr":"172.21.15.174:6811/1637570253","heartbeat_back_addr":"172.21.15.174:6815/1637570253","heartbeat_front_addr":"172.21.15.174:6813/1637570253","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:33.997709+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:34.016568+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:33.990484+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:33.980666+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:33.920609+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:34.005069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:34.018345+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:34.061646+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T10:54:54.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.208+0000 7f944ef6a640 1 -- 172.21.15.33:0/3374588822 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f942c06b4d0 msgr2=0x7f942c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:54.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.208+0000 7f944ef6a640 1 --2- 172.21.15.33:0/3374588822 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f942c06b4d0 0x7f942c06d990 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f943c009b80 tx=0x7f943c008040 comp rx=0 tx=0).stop 2024-05-08T10:54:54.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.208+0000 7f944ef6a640 1 -- 172.21.15.33:0/3374588822 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9448158c90 msgr2=0x7f94481590f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:54.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.208+0000 7f944ef6a640 1 --2- 172.21.15.33:0/3374588822 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9448158c90 0x7f94481590f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f943400c300 tx=0x7f94480d14a0 comp rx=0 tx=0).stop 2024-05-08T10:54:54.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.208+0000 7f944ef6a640 1 -- 172.21.15.33:0/3374588822 shutdown_connections 2024-05-08T10:54:54.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.208+0000 7f944ef6a640 1 --2- 172.21.15.33:0/3374588822 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f942c06b4d0 0x7f942c06d990 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:54.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.208+0000 7f944ef6a640 1 --2- 172.21.15.33:0/3374588822 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f944815e690 0x7f944815eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:54.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.208+0000 7f944ef6a640 1 --2- 172.21.15.33:0/3374588822 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9448158c90 0x7f94481590f0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:54.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.208+0000 7f944ef6a640 1 --2- 172.21.15.33:0/3374588822 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9438004800 0x7f944815bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:54.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.208+0000 7f944ef6a640 1 -- 172.21.15.33:0/3374588822 >> 172.21.15.33:0/3374588822 conn(0x7f94480d3c10 msgr2=0x7f94480b35c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:54:54.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.208+0000 7f944ef6a640 1 -- 172.21.15.33:0/3374588822 shutdown_connections 2024-05-08T10:54:54.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.208+0000 7f944ef6a640 1 -- 172.21.15.33:0/3374588822 wait complete. 2024-05-08T10:54:54.219 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-08T10:54:54.219 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T10:54:54.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.325+0000 7fc3662df640 1 Processor -- start 2024-05-08T10:54:54.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.325+0000 7fc3662df640 1 -- start start 2024-05-08T10:54:54.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.326+0000 7fc3662df640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc3601613a0 0x7fc3600d17e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:54.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.326+0000 7fc3662df640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc3600d4960 0x7fc3600cf4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:54.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.326+0000 7fc3662df640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fc3600cf9e0 0x7fc3600d1e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:54.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.326+0000 7fc3662df640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3600cf010 con 0x7fc3600cf9e0 2024-05-08T10:54:54.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.326+0000 7fc3662df640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3600ce720 con 0x7fc3601613a0 2024-05-08T10:54:54.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.326+0000 7fc3662df640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3600d12d0 con 0x7fc3600d4960 2024-05-08T10:54:54.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.326+0000 7fc36487c640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fc3600cf9e0 0x7fc3600d1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:54.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.326+0000 7fc36487c640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fc3600cf9e0 0x7fc3600d1e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46504/0 (socket says 172.21.15.33:46504) 2024-05-08T10:54:54.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.326+0000 7fc36487c640 1 -- 172.21.15.33:0/4129215176 learned_addr learned my addr 172.21.15.33:0/4129215176 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:54:54.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.326+0000 7fc357fff640 1 --2- 172.21.15.33:0/4129215176 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc3600d4960 0x7fc3600cf4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:54.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.326+0000 7fc35ffff640 1 --2- 172.21.15.33:0/4129215176 >> v2:172.21.15.174:3300/0 conn(0x7fc3601613a0 0x7fc3600d17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:54.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.326+0000 7fc36487c640 1 -- 172.21.15.33:0/4129215176 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc3600d4960 msgr2=0x7fc3600cf4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:54:54.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.326+0000 7fc36487c640 1 --2- 172.21.15.33:0/4129215176 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc3600d4960 0x7fc3600cf4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:54.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.326+0000 7fc36487c640 1 -- 172.21.15.33:0/4129215176 >> v2:172.21.15.174:3300/0 conn(0x7fc3601613a0 msgr2=0x7fc3600d17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:54:54.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.326+0000 7fc36487c640 1 --2- 172.21.15.33:0/4129215176 >> v2:172.21.15.174:3300/0 conn(0x7fc3601613a0 0x7fc3600d17e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:54.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.326+0000 7fc36487c640 1 -- 172.21.15.33:0/4129215176 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3600ce9c0 con 0x7fc3600cf9e0 2024-05-08T10:54:54.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.327+0000 7fc36487c640 1 --2- 172.21.15.33:0/4129215176 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3600cf9e0 0x7fc3600d1e10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc36008c650 tx=0x7fc35802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90723f0a374ab699 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:54:54.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.327+0000 7fc35f7fe640 1 -- 172.21.15.33:0/4129215176 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc358036070 con 0x7fc3600cf9e0 2024-05-08T10:54:54.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.327+0000 7fc35f7fe640 1 -- 172.21.15.33:0/4129215176 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc358031600 con 0x7fc3600cf9e0 2024-05-08T10:54:54.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.327+0000 7fc35f7fe640 1 -- 172.21.15.33:0/4129215176 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3580319d0 con 0x7fc3600cf9e0 2024-05-08T10:54:54.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.328+0000 7fc3662df640 1 -- 172.21.15.33:0/4129215176 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3600cf9e0 msgr2=0x7fc3600d1e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:54.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.328+0000 7fc3662df640 1 --2- 172.21.15.33:0/4129215176 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3600cf9e0 0x7fc3600d1e10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc36008c650 tx=0x7fc35802a6a0 comp rx=0 tx=0).stop 2024-05-08T10:54:54.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.328+0000 7fc3662df640 1 -- 172.21.15.33:0/4129215176 shutdown_connections 2024-05-08T10:54:54.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.328+0000 7fc3662df640 1 --2- 172.21.15.33:0/4129215176 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3600cf9e0 0x7fc3600d1e10 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:54.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.328+0000 7fc3662df640 1 --2- 172.21.15.33:0/4129215176 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc3600d4960 0x7fc3600cf4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:54.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.328+0000 7fc3662df640 1 --2- 172.21.15.33:0/4129215176 >> v2:172.21.15.174:3300/0 conn(0x7fc3601613a0 0x7fc3600d17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:54.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.328+0000 7fc3662df640 1 -- 172.21.15.33:0/4129215176 >> 172.21.15.33:0/4129215176 conn(0x7fc3600d3c10 msgr2=0x7fc3600d4020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:54:54.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.328+0000 7fc3662df640 1 -- 172.21.15.33:0/4129215176 shutdown_connections 2024-05-08T10:54:54.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.328+0000 7fc3662df640 1 -- 172.21.15.33:0/4129215176 wait complete. 2024-05-08T10:54:54.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.329+0000 7fc3662df640 1 Processor -- start 2024-05-08T10:54:54.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.329+0000 7fc3662df640 1 -- start start 2024-05-08T10:54:54.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.330+0000 7fc3662df640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc3600cf9e0 0x7fc36006bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:54.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.330+0000 7fc3662df640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc3600d4960 0x7fc36006c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:54.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.330+0000 7fc3662df640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3601613a0 0x7fc3600b82f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:54.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.330+0000 7fc3662df640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc360161780 con 0x7fc3601613a0 2024-05-08T10:54:54.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.330+0000 7fc3662df640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3600d0f80 con 0x7fc3600cf9e0 2024-05-08T10:54:54.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.330+0000 7fc3662df640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc360161900 con 0x7fc3600d4960 2024-05-08T10:54:54.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.330+0000 7fc36487c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3601613a0 0x7fc3600b82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:54.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.330+0000 7fc36487c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3601613a0 0x7fc3600b82f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46516/0 (socket says 172.21.15.33:46516) 2024-05-08T10:54:54.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.330+0000 7fc36487c640 1 -- 172.21.15.33:0/1861557290 learned_addr learned my addr 172.21.15.33:0/1861557290 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:54:54.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.330+0000 7fc357fff640 1 --2- 172.21.15.33:0/1861557290 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc3600d4960 0x7fc36006c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:54.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.330+0000 7fc36487c640 1 -- 172.21.15.33:0/1861557290 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc3600d4960 msgr2=0x7fc36006c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:54.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.330+0000 7fc36487c640 1 --2- 172.21.15.33:0/1861557290 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc3600d4960 0x7fc36006c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:54.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.330+0000 7fc36487c640 1 -- 172.21.15.33:0/1861557290 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc3600cf9e0 msgr2=0x7fc36006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:54.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.330+0000 7fc36487c640 1 --2- 172.21.15.33:0/1861557290 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc3600cf9e0 0x7fc36006bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:54.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.330+0000 7fc36487c640 1 -- 172.21.15.33:0/1861557290 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3600c7730 con 0x7fc3601613a0 2024-05-08T10:54:54.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.330+0000 7fc36487c640 1 --2- 172.21.15.33:0/1861557290 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3601613a0 0x7fc3600b82f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc358034040 tx=0x7fc358004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:54:54.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.331+0000 7fc35d7fa640 1 -- 172.21.15.33:0/1861557290 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc358036050 con 0x7fc3601613a0 2024-05-08T10:54:54.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.331+0000 7fc35d7fa640 1 -- 172.21.15.33:0/1861557290 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc358042070 con 0x7fc3601613a0 2024-05-08T10:54:54.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.331+0000 7fc3662df640 1 -- 172.21.15.33:0/1861557290 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3600b9020 con 0x7fc3601613a0 2024-05-08T10:54:54.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.331+0000 7fc35d7fa640 1 -- 172.21.15.33:0/1861557290 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc358009510 con 0x7fc3601613a0 2024-05-08T10:54:54.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.331+0000 7fc3662df640 1 -- 172.21.15.33:0/1861557290 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3600c7cb0 con 0x7fc3601613a0 2024-05-08T10:54:54.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.332+0000 7fc3662df640 1 -- 172.21.15.33:0/1861557290 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc360069d20 con 0x7fc3601613a0 2024-05-08T10:54:54.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.332+0000 7fc35d7fa640 1 -- 172.21.15.33:0/1861557290 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc358007bd0 con 0x7fc3601613a0 2024-05-08T10:54:54.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.332+0000 7fc35d7fa640 1 --2- 172.21.15.33:0/1861557290 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fc34006b4d0 0x7fc34006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:54.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.333+0000 7fc35d7fa640 1 -- 172.21.15.33:0/1861557290 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc3580ab0d0 con 0x7fc3601613a0 2024-05-08T10:54:54.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.333+0000 7fc35ffff640 1 --2- 172.21.15.33:0/1861557290 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fc34006b4d0 0x7fc34006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:54.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.333+0000 7fc35ffff640 1 --2- 172.21.15.33:0/1861557290 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fc34006b4d0 0x7fc34006d990 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc350006fd0 tx=0x7fc350008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:54:54.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.337+0000 7fc35d7fa640 1 -- 172.21.15.33:0/1861557290 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc358079f50 con 0x7fc3601613a0 2024-05-08T10:54:54.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.516+0000 7fc3662df640 1 -- 172.21.15.33:0/1861557290 --> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc360157da0 con 0x7fc34006b4d0 2024-05-08T10:54:54.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.522+0000 7fc35d7fa640 1 -- 172.21.15.33:0/1861557290 <== mgr.4103 v2:172.21.15.174:6832/261355069 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+240067 (secure 0 0 0) 0x7fc360157da0 con 0x7fc34006b4d0 2024-05-08T10:54:54.522 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:54:54.523 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-05-08T10:54:54.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.525+0000 7fc3662df640 1 -- 172.21.15.33:0/1861557290 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fc34006b4d0 msgr2=0x7fc34006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:54.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.525+0000 7fc3662df640 1 --2- 172.21.15.33:0/1861557290 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fc34006b4d0 0x7fc34006d990 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc350006fd0 tx=0x7fc350008040 comp rx=0 tx=0).stop 2024-05-08T10:54:54.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.525+0000 7fc3662df640 1 -- 172.21.15.33:0/1861557290 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3601613a0 msgr2=0x7fc3600b82f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:54.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.525+0000 7fc3662df640 1 --2- 172.21.15.33:0/1861557290 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3601613a0 0x7fc3600b82f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc358034040 tx=0x7fc358004a40 comp rx=0 tx=0).stop 2024-05-08T10:54:54.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.525+0000 7fc3662df640 1 -- 172.21.15.33:0/1861557290 shutdown_connections 2024-05-08T10:54:54.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.525+0000 7fc3662df640 1 --2- 172.21.15.33:0/1861557290 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fc34006b4d0 0x7fc34006d990 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:54.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.525+0000 7fc3662df640 1 --2- 172.21.15.33:0/1861557290 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3601613a0 0x7fc3600b82f0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:54.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.525+0000 7fc3662df640 1 --2- 172.21.15.33:0/1861557290 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc3600d4960 0x7fc36006c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:54.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.525+0000 7fc3662df640 1 --2- 172.21.15.33:0/1861557290 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc3600cf9e0 0x7fc36006bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:54.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.525+0000 7fc3662df640 1 -- 172.21.15.33:0/1861557290 >> 172.21.15.33:0/1861557290 conn(0x7fc3600d3c10 msgr2=0x7fc36006b370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:54:54.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.525+0000 7fc3662df640 1 -- 172.21.15.33:0/1861557290 shutdown_connections 2024-05-08T10:54:54.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.525+0000 7fc3662df640 1 -- 172.21.15.33:0/1861557290 wait complete. 2024-05-08T10:54:54.533 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-05-08T10:54:52.944678+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219152,"kb_used_data":2412,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755568,"statfs":{"total":773094113280,"available":772869701632,"internally_reserved":0,"allocated":2469888,"data_stored":1564323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.432515"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-05-08T10:54:48.513367+0000","last_change":"2024-05-08T10:54:48.513367+0000","last_active":"2024-05-08T10:54:48.502524+0000","last_peered":"2024-05-08T10:54:48.502524+0000","last_clean":"2024-05-08T10:54:48.502524+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:48.513367+0000","last_undegraded":"2024-05-08T10:54:48.513367+0000","last_fullsized":"2024-05-08T10:54:48.513367+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-05-08T10:54:48.514456+0000","last_change":"2024-05-08T10:54:48.514456+0000","last_active":"2024-05-08T10:54:48.502524+0000","last_peered":"2024-05-08T10:54:48.502524+0000","last_clean":"2024-05-08T10:54:48.502524+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:48.514456+0000","last_undegraded":"2024-05-08T10:54:48.514456+0000","last_fullsized":"2024-05-08T10:54:48.514456+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-05-08T10:54:48.513372+0000","last_change":"2024-05-08T10:54:48.513372+0000","last_active":"2024-05-08T10:54:48.502524+0000","last_peered":"2024-05-08T10:54:48.502524+0000","last_clean":"2024-05-08T10:54:48.502524+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:48.513372+0000","last_undegraded":"2024-05-08T10:54:48.513372+0000","last_fullsized":"2024-05-08T10:54:48.513372+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-05-08T10:54:48.518453+0000","last_change":"2024-05-08T10:54:48.518453+0000","last_active":"2024-05-08T10:54:48.502524+0000","last_peered":"2024-05-08T10:54:48.502524+0000","last_clean":"2024-05-08T10:54:48.502524+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:48.518453+0000","last_undegraded":"2024-05-08T10:54:48.518453+0000","last_fullsized":"2024-05-08T10:54:48.518453+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-05-08T10:54:48.515404+0000","last_change":"2024-05-08T10:54:48.515404+0000","last_active":"2024-05-08T10:54:48.502524+0000","last_peered":"2024-05-08T10:54:48.502524+0000","last_clean":"2024-05-08T10:54:48.502524+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:48.515404+0000","last_undegraded":"2024-05-08T10:54:48.515404+0000","last_fullsized":"2024-05-08T10:54:48.515404+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-05-08T10:54:48.519014+0000","last_change":"2024-05-08T10:54:48.519014+0000","last_active":"2024-05-08T10:54:48.502524+0000","last_peered":"2024-05-08T10:54:48.502524+0000","last_clean":"2024-05-08T10:54:48.502524+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:48.519014+0000","last_undegraded":"2024-05-08T10:54:48.519014+0000","last_fullsized":"2024-05-08T10:54:48.519014+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-05-08T10:54:48.519942+0000","last_change":"2024-05-08T10:54:48.519942+0000","last_active":"2024-05-08T10:54:48.502524+0000","last_peered":"2024-05-08T10:54:48.502524+0000","last_clean":"2024-05-08T10:54:48.502524+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:48.519942+0000","last_undegraded":"2024-05-08T10:54:48.519942+0000","last_fullsized":"2024-05-08T10:54:48.519942+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-05-08T10:54:48.514466+0000","last_change":"2024-05-08T10:54:48.514466+0000","last_active":"2024-05-08T10:54:48.502524+0000","last_peered":"2024-05-08T10:54:48.502524+0000","last_clean":"2024-05-08T10:54:48.502524+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:48.514466+0000","last_undegraded":"2024-05-08T10:54:48.514466+0000","last_fullsized":"2024-05-08T10:54:48.514466+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-05-08T10:54:48.515399+0000","last_change":"2024-05-08T10:54:48.515399+0000","last_active":"2024-05-08T10:54:48.502524+0000","last_peered":"2024-05-08T10:54:48.502524+0000","last_clean":"2024-05-08T10:54:48.502524+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:48.515399+0000","last_undegraded":"2024-05-08T10:54:48.515399+0000","last_fullsized":"2024-05-08T10:54:48.515399+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-05-08T10:54:48.519568+0000","last_change":"2024-05-08T10:54:48.519568+0000","last_active":"2024-05-08T10:54:48.502524+0000","last_peered":"2024-05-08T10:54:48.502524+0000","last_clean":"2024-05-08T10:54:48.502524+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:48.519568+0000","last_undegraded":"2024-05-08T10:54:48.519568+0000","last_fullsized":"2024-05-08T10:54:48.519568+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-05-08T10:54:48.514435+0000","last_change":"2024-05-08T10:54:48.514435+0000","last_active":"2024-05-08T10:54:48.502524+0000","last_peered":"2024-05-08T10:54:48.502524+0000","last_clean":"2024-05-08T10:54:48.502524+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:48.514435+0000","last_undegraded":"2024-05-08T10:54:48.514435+0000","last_fullsized":"2024-05-08T10:54:48.514435+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-05-08T10:54:48.521816+0000","last_change":"2024-05-08T10:54:48.521816+0000","last_active":"2024-05-08T10:54:48.502524+0000","last_peered":"2024-05-08T10:54:48.502524+0000","last_clean":"2024-05-08T10:54:48.502524+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:48.521816+0000","last_undegraded":"2024-05-08T10:54:48.521816+0000","last_fullsized":"2024-05-08T10:54:48.521816+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-05-08T10:54:48.517479+0000","last_change":"2024-05-08T10:54:48.517479+0000","last_active":"2024-05-08T10:54:48.502524+0000","last_peered":"2024-05-08T10:54:48.502524+0000","last_clean":"2024-05-08T10:54:48.502524+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:48.517479+0000","last_undegraded":"2024-05-08T10:54:48.517479+0000","last_fullsized":"2024-05-08T10:54:48.517479+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-05-08T10:54:48.521941+0000","last_change":"2024-05-08T10:54:48.521941+0000","last_active":"2024-05-08T10:54:48.502524+0000","last_peered":"2024-05-08T10:54:48.502524+0000","last_clean":"2024-05-08T10:54:48.502524+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:48.521941+0000","last_undegraded":"2024-05-08T10:54:48.521941+0000","last_fullsized":"2024-05-08T10:54:48.521941+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-05-08T10:54:48.519024+0000","last_change":"2024-05-08T10:54:48.519024+0000","last_active":"2024-05-08T10:54:48.502524+0000","last_peered":"2024-05-08T10:54:48.502524+0000","last_clean":"2024-05-08T10:54:48.502524+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:48.519024+0000","last_undegraded":"2024-05-08T10:54:48.519024+0000","last_fullsized":"2024-05-08T10:54:48.519024+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-05-08T10:54:48.521921+0000","last_change":"2024-05-08T10:54:48.521921+0000","last_active":"2024-05-08T10:54:48.502524+0000","last_peered":"2024-05-08T10:54:48.502524+0000","last_clean":"2024-05-08T10:54:48.502524+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:48.521921+0000","last_undegraded":"2024-05-08T10:54:48.521921+0000","last_fullsized":"2024-05-08T10:54:48.521921+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":164,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-08T10:54:48.517559+0000","last_change":"2024-05-08T10:54:40.015226+0000","last_active":"2024-05-08T10:54:48.517559+0000","last_peered":"2024-05-08T10:54:48.517559+0000","last_clean":"2024-05-08T10:54:48.517559+0000","last_became_active":"2024-05-08T10:54:40.014219+0000","last_became_peered":"2024-05-08T10:54:40.014219+0000","last_unstale":"2024-05-08T10:54:48.517559+0000","last_undegraded":"2024-05-08T10:54:48.517559+0000","last_fullsized":"2024-05-08T10:54:48.517559+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:38.989328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:38.989328+0000","last_clean_scrub_stamp":"2024-05-08T10:54:38.989328+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:10:59.668786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-05-08T10:54:48.519046+0000","last_change":"2024-05-08T10:54:48.519046+0000","last_active":"2024-05-08T10:54:48.502524+0000","last_peered":"2024-05-08T10:54:48.502524+0000","last_clean":"2024-05-08T10:54:48.502524+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:48.519046+0000","last_undegraded":"2024-05-08T10:54:48.519046+0000","last_fullsized":"2024-05-08T10:54:48.519046+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-05-08T10:54:48.515383+0000","last_change":"2024-05-08T10:54:48.515383+0000","last_active":"2024-05-08T10:54:48.502524+0000","last_peered":"2024-05-08T10:54:48.502524+0000","last_clean":"2024-05-08T10:54:48.502524+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:48.515383+0000","last_undegraded":"2024-05-08T10:54:48.515383+0000","last_fullsized":"2024-05-08T10:54:48.515383+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-05-08T10:54:48.521889+0000","last_change":"2024-05-08T10:54:48.521889+0000","last_active":"2024-05-08T10:54:48.502524+0000","last_peered":"2024-05-08T10:54:48.502524+0000","last_clean":"2024-05-08T10:54:48.502524+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:48.521889+0000","last_undegraded":"2024-05-08T10:54:48.521889+0000","last_fullsized":"2024-05-08T10:54:48.521889+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-05-08T10:54:48.518993+0000","last_change":"2024-05-08T10:54:48.518993+0000","last_active":"2024-05-08T10:54:48.502524+0000","last_peered":"2024-05-08T10:54:48.502524+0000","last_clean":"2024-05-08T10:54:48.502524+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:48.518993+0000","last_undegraded":"2024-05-08T10:54:48.518993+0000","last_fullsized":"2024-05-08T10:54:48.518993+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-05-08T10:54:48.519045+0000","last_change":"2024-05-08T10:54:48.519045+0000","last_active":"2024-05-08T10:54:48.502524+0000","last_peered":"2024-05-08T10:54:48.502524+0000","last_clean":"2024-05-08T10:54:48.502524+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:48.519045+0000","last_undegraded":"2024-05-08T10:54:48.519045+0000","last_fullsized":"2024-05-08T10:54:48.519045+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-05-08T10:54:48.516725+0000","last_change":"2024-05-08T10:54:48.516725+0000","last_active":"2024-05-08T10:54:48.502524+0000","last_peered":"2024-05-08T10:54:48.502524+0000","last_clean":"2024-05-08T10:54:48.502524+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:48.516725+0000","last_undegraded":"2024-05-08T10:54:48.516725+0000","last_fullsized":"2024-05-08T10:54:48.516725+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-05-08T10:54:48.519032+0000","last_change":"2024-05-08T10:54:48.519032+0000","last_active":"2024-05-08T10:54:48.502524+0000","last_peered":"2024-05-08T10:54:48.502524+0000","last_clean":"2024-05-08T10:54:48.502524+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:48.519032+0000","last_undegraded":"2024-05-08T10:54:48.519032+0000","last_fullsized":"2024-05-08T10:54:48.519032+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-05-08T10:54:48.514462+0000","last_change":"2024-05-08T10:54:48.514462+0000","last_active":"2024-05-08T10:54:48.502524+0000","last_peered":"2024-05-08T10:54:48.502524+0000","last_clean":"2024-05-08T10:54:48.502524+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:48.514462+0000","last_undegraded":"2024-05-08T10:54:48.514462+0000","last_fullsized":"2024-05-08T10:54:48.514462+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-05-08T10:54:48.515920+0000","last_change":"2024-05-08T10:54:48.515920+0000","last_active":"2024-05-08T10:54:48.502524+0000","last_peered":"2024-05-08T10:54:48.502524+0000","last_clean":"2024-05-08T10:54:48.502524+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:48.515920+0000","last_undegraded":"2024-05-08T10:54:48.515920+0000","last_fullsized":"2024-05-08T10:54:48.515920+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-05-08T10:54:48.519025+0000","last_change":"2024-05-08T10:54:48.519025+0000","last_active":"2024-05-08T10:54:48.502524+0000","last_peered":"2024-05-08T10:54:48.502524+0000","last_clean":"2024-05-08T10:54:48.502524+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:48.519025+0000","last_undegraded":"2024-05-08T10:54:48.519025+0000","last_fullsized":"2024-05-08T10:54:48.519025+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-05-08T10:54:48.519028+0000","last_change":"2024-05-08T10:54:48.519028+0000","last_active":"2024-05-08T10:54:48.502524+0000","last_peered":"2024-05-08T10:54:48.502524+0000","last_clean":"2024-05-08T10:54:48.502524+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:48.519028+0000","last_undegraded":"2024-05-08T10:54:48.519028+0000","last_fullsized":"2024-05-08T10:54:48.519028+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-05-08T10:54:48.515548+0000","last_change":"2024-05-08T10:54:48.515548+0000","last_active":"2024-05-08T10:54:48.502524+0000","last_peered":"2024-05-08T10:54:48.502524+0000","last_clean":"2024-05-08T10:54:48.502524+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:48.515548+0000","last_undegraded":"2024-05-08T10:54:48.515548+0000","last_fullsized":"2024-05-08T10:54:48.515548+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-05-08T10:54:48.515355+0000","last_change":"2024-05-08T10:54:48.515355+0000","last_active":"2024-05-08T10:54:48.502524+0000","last_peered":"2024-05-08T10:54:48.502524+0000","last_clean":"2024-05-08T10:54:48.502524+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:48.515355+0000","last_undegraded":"2024-05-08T10:54:48.515355+0000","last_fullsized":"2024-05-08T10:54:48.515355+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-05-08T10:54:48.517238+0000","last_change":"2024-05-08T10:54:48.517238+0000","last_active":"2024-05-08T10:54:48.502524+0000","last_peered":"2024-05-08T10:54:48.502524+0000","last_clean":"2024-05-08T10:54:48.502524+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:48.517238+0000","last_undegraded":"2024-05-08T10:54:48.517238+0000","last_fullsized":"2024-05-08T10:54:48.517238+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-05-08T10:54:48.513482+0000","last_change":"2024-05-08T10:54:48.513482+0000","last_active":"2024-05-08T10:54:48.502524+0000","last_peered":"2024-05-08T10:54:48.502524+0000","last_clean":"2024-05-08T10:54:48.502524+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:48.513482+0000","last_undegraded":"2024-05-08T10:54:48.513482+0000","last_fullsized":"2024-05-08T10:54:48.513482+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-05-08T10:54:48.515431+0000","last_change":"2024-05-08T10:54:48.515431+0000","last_active":"2024-05-08T10:54:48.502524+0000","last_peered":"2024-05-08T10:54:48.502524+0000","last_clean":"2024-05-08T10:54:48.502524+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:48.515431+0000","last_undegraded":"2024-05-08T10:54:48.515431+0000","last_fullsized":"2024-05-08T10:54:48.515431+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27748,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344092,"statfs":{"total":96636764160,"available":96608350208,"internally_reserved":0,"allocated":749568,"data_stored":636135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27176,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":155648,"data_stored":45767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27180,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":155648,"data_stored":45767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":167936,"data_stored":51584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27180,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":155648,"data_stored":45767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":167936,"data_stored":51584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":167936,"data_stored":51584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28316,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343524,"statfs":{"total":96636764160,"available":96607768576,"internally_reserved":0,"allocated":749568,"data_stored":636135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T10:54:54.537 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T10:54:54.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.680+0000 7f7824c57640 1 Processor -- start 2024-05-08T10:54:54.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.680+0000 7f7824c57640 1 -- start start 2024-05-08T10:54:54.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.681+0000 7f7824c57640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f782015e1d0 0x7f78200cf270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:54.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.681+0000 7f7824c57640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f78200d25e0 0x7f78200b4170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:54.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.681+0000 7f7824c57640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78200d48f0 con 0x7f78200d1a90 2024-05-08T10:54:54.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.681+0000 7f7824c57640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78200b3ce0 con 0x7f782015e1d0 2024-05-08T10:54:54.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.681+0000 7f7824c57640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78200cf900 con 0x7f78200d25e0 2024-05-08T10:54:54.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.681+0000 7f781dd9b640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f78200d1a90 0x7f78200d1ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:45460/0 (socket says 172.21.15.33:45460) 2024-05-08T10:54:54.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.681+0000 7f781dd9b640 1 -- 172.21.15.33:0/3725443307 learned_addr learned my addr 172.21.15.33:0/3725443307 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-05-08T10:54:54.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.681+0000 7f781d59a640 1 -- 172.21.15.33:0/3725443307 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1877542519 0 0) 0x7f78200d48f0 con 0x7f78200d1a90 2024-05-08T10:54:54.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.681+0000 7f781d59a640 1 -- 172.21.15.33:0/3725443307 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7808003520 con 0x7f78200d1a90 2024-05-08T10:54:54.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.681+0000 7f781ed9d640 1 --2- 172.21.15.33:0/3725443307 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f78200d25e0 0x7f78200b4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:54.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.681+0000 7f781e59c640 1 --2- 172.21.15.33:0/3725443307 >> v2:172.21.15.174:3300/0 conn(0x7f782015e1d0 0x7f78200cf270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:54.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.681+0000 7f781d59a640 1 -- 172.21.15.33:0/3725443307 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1872957035 0 0) 0x7f7808003520 con 0x7f78200d1a90 2024-05-08T10:54:54.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.681+0000 7f781d59a640 1 -- 172.21.15.33:0/3725443307 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f78200d25e0 msgr2=0x7f78200b4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:54:54.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.681+0000 7f781d59a640 1 --2- 172.21.15.33:0/3725443307 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f78200d25e0 0x7f78200b4170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:54.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.681+0000 7f781d59a640 1 -- 172.21.15.33:0/3725443307 >> v2:172.21.15.174:3300/0 conn(0x7f782015e1d0 msgr2=0x7f78200cf270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:54:54.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.681+0000 7f781d59a640 1 --2- 172.21.15.33:0/3725443307 >> v2:172.21.15.174:3300/0 conn(0x7f782015e1d0 0x7f78200cf270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:54.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.681+0000 7f781d59a640 1 -- 172.21.15.33:0/3725443307 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78200b3690 con 0x7f78200d1a90 2024-05-08T10:54:54.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.681+0000 7f781d59a640 1 -- 172.21.15.33:0/3725443307 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2948294915 0 0) 0x7f78140019f0 con 0x7f78200d1a90 2024-05-08T10:54:54.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.681+0000 7f781d59a640 1 -- 172.21.15.33:0/3725443307 >> v1:172.21.15.33:6789/0 conn(0x7f78200d1a90 legacy=0x7f78200d1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:54.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.681+0000 7f781d59a640 1 --2- 172.21.15.33:0/3725443307 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f78200d25e0 0x7f78080039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:54.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.681+0000 7f781d59a640 1 --2- 172.21.15.33:0/3725443307 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7808003f80 0x7f7808004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:54.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.681+0000 7f781d59a640 1 --2- 172.21.15.33:0/3725443307 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7808004d40 0x7f78080051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:54.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.681+0000 7f781d59a640 1 -- 172.21.15.33:0/3725443307 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78200b3ce0 con 0x7f7808003f80 2024-05-08T10:54:54.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.681+0000 7f781d59a640 1 -- 172.21.15.33:0/3725443307 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78200cf900 con 0x7f7808004d40 2024-05-08T10:54:54.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.681+0000 7f781d59a640 1 -- 172.21.15.33:0/3725443307 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f780800b9c0 con 0x7f78200d25e0 2024-05-08T10:54:54.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.682+0000 7f781dd9b640 1 --2- 172.21.15.33:0/3725443307 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7808003f80 0x7f7808004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:54.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.682+0000 7f781e59c640 1 --2- 172.21.15.33:0/3725443307 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f78200d25e0 0x7f78080039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:54.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.682+0000 7f781ed9d640 1 --2- 172.21.15.33:0/3725443307 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7808004d40 0x7f78080051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:54.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.682+0000 7f781dd9b640 1 -- 172.21.15.33:0/3725443307 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f78200d25e0 msgr2=0x7f78080039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:54:54.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.682+0000 7f781dd9b640 1 --2- 172.21.15.33:0/3725443307 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f78200d25e0 0x7f78080039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:54.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.682+0000 7f781dd9b640 1 -- 172.21.15.33:0/3725443307 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7808004d40 msgr2=0x7f78080051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:54:54.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.682+0000 7f781dd9b640 1 --2- 172.21.15.33:0/3725443307 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7808004d40 0x7f78080051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:54.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.682+0000 7f781dd9b640 1 -- 172.21.15.33:0/3725443307 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7808003520 con 0x7f7808003f80 2024-05-08T10:54:54.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.682+0000 7f781dd9b640 1 --2- 172.21.15.33:0/3725443307 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7808003f80 0x7f7808004800 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f781400a7c0 tx=0x7f7808005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33717d6571f9e7e8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:54:54.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.683+0000 7f781d59a640 1 -- 172.21.15.33:0/3725443307 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f781400a410 con 0x7f7808003f80 2024-05-08T10:54:54.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.683+0000 7f781d59a640 1 -- 172.21.15.33:0/3725443307 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f781402f070 con 0x7f7808003f80 2024-05-08T10:54:54.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.683+0000 7f781d59a640 1 -- 172.21.15.33:0/3725443307 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f781402bbf0 con 0x7f7808003f80 2024-05-08T10:54:54.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.683+0000 7f7824c57640 1 -- 172.21.15.33:0/3725443307 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7808003f80 msgr2=0x7f7808004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:54.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.683+0000 7f7824c57640 1 --2- 172.21.15.33:0/3725443307 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7808003f80 0x7f7808004800 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f781400a7c0 tx=0x7f7808005830 comp rx=0 tx=0).stop 2024-05-08T10:54:54.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.683+0000 7f781ed9d640 1 -- 172.21.15.33:0/3725443307 reap_dead start 2024-05-08T10:54:54.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.683+0000 7f7824c57640 1 -- 172.21.15.33:0/3725443307 shutdown_connections 2024-05-08T10:54:54.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.683+0000 7f7824c57640 1 -- 172.21.15.33:0/3725443307 >> 172.21.15.33:0/3725443307 conn(0x7f78200d3b90 msgr2=0x7f78200d3fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:54:54.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.683+0000 7f7824c57640 1 -- 172.21.15.33:0/3725443307 shutdown_connections 2024-05-08T10:54:54.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.683+0000 7f7824c57640 1 -- 172.21.15.33:0/3725443307 wait complete. 2024-05-08T10:54:54.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.685+0000 7f7824c57640 1 Processor -- start 2024-05-08T10:54:54.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.685+0000 7f7824c57640 1 -- start start 2024-05-08T10:54:54.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.685+0000 7f7824c57640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7808003f80 0x7f78200b82d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:54.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.686+0000 7f7824c57640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f782015b0b0 0x7f7820151ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:54.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.686+0000 7f7824c57640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f78200b6e40 0x7f78200b72f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:54.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.686+0000 7f7824c57640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f782015e730 con 0x7f78200b6e40 2024-05-08T10:54:54.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.686+0000 7f7824c57640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f782015e5b0 con 0x7f7808003f80 2024-05-08T10:54:54.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.686+0000 7f7824c57640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78200b4170 con 0x7f782015b0b0 2024-05-08T10:54:54.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.686+0000 7f781ed9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f78200b6e40 0x7f78200b72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:54.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.686+0000 7f781ed9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f78200b6e40 0x7f78200b72f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46536/0 (socket says 172.21.15.33:46536) 2024-05-08T10:54:54.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.686+0000 7f781ed9d640 1 -- 172.21.15.33:0/2229623018 learned_addr learned my addr 172.21.15.33:0/2229623018 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:54:54.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.686+0000 7f781dd9b640 1 --2- 172.21.15.33:0/2229623018 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f782015b0b0 0x7f7820151ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:54.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.686+0000 7f781e59c640 1 --2- 172.21.15.33:0/2229623018 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7808003f80 0x7f78200b82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:54.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.686+0000 7f781ed9d640 1 -- 172.21.15.33:0/2229623018 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f782015b0b0 msgr2=0x7f7820151ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:54.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.686+0000 7f781ed9d640 1 --2- 172.21.15.33:0/2229623018 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f782015b0b0 0x7f7820151ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:54.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.686+0000 7f781ed9d640 1 -- 172.21.15.33:0/2229623018 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7808003f80 msgr2=0x7f78200b82d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:54.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.686+0000 7f781ed9d640 1 --2- 172.21.15.33:0/2229623018 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7808003f80 0x7f78200b82d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:54.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.686+0000 7f781ed9d640 1 -- 172.21.15.33:0/2229623018 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78200b8a20 con 0x7f78200b6e40 2024-05-08T10:54:54.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.686+0000 7f781ed9d640 1 --2- 172.21.15.33:0/2229623018 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f78200b6e40 0x7f78200b72f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f78200d2a70 tx=0x7f7818011c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:54:54.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.686+0000 7f780effd640 1 -- 172.21.15.33:0/2229623018 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7818004030 con 0x7f78200b6e40 2024-05-08T10:54:54.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.686+0000 7f780effd640 1 -- 172.21.15.33:0/2229623018 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f781801b070 con 0x7f78200b6e40 2024-05-08T10:54:54.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.686+0000 7f780effd640 1 -- 172.21.15.33:0/2229623018 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7818004430 con 0x7f78200b6e40 2024-05-08T10:54:54.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.686+0000 7f7824c57640 1 -- 172.21.15.33:0/2229623018 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78200b8d00 con 0x7f78200b6e40 2024-05-08T10:54:54.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.686+0000 7f7824c57640 1 -- 172.21.15.33:0/2229623018 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78200b6920 con 0x7f78200b6e40 2024-05-08T10:54:54.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.687+0000 7f7824c57640 1 -- 172.21.15.33:0/2229623018 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78200b6b20 con 0x7f78200b6e40 2024-05-08T10:54:54.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.688+0000 7f780effd640 1 -- 172.21.15.33:0/2229623018 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7818012040 con 0x7f78200b6e40 2024-05-08T10:54:54.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.688+0000 7f780effd640 1 --2- 172.21.15.33:0/2229623018 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f780006b500 0x7f780006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:54.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.689+0000 7f780effd640 1 -- 172.21.15.33:0/2229623018 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7818089e70 con 0x7f78200b6e40 2024-05-08T10:54:54.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.689+0000 7f781e59c640 1 --2- 172.21.15.33:0/2229623018 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f780006b500 0x7f780006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:54.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.689+0000 7f781e59c640 1 --2- 172.21.15.33:0/2229623018 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f780006b500 0x7f780006d9c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7810009c40 tx=0x7f7810009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:54:54.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.693+0000 7f780effd640 1 -- 172.21.15.33:0/2229623018 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f78200b6b20 con 0x7f78200b6e40 2024-05-08T10:54:54.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.868+0000 7f7824c57640 1 -- 172.21.15.33:0/2229623018 --> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7820069d20 con 0x7f780006b500 2024-05-08T10:54:54.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.874+0000 7f780effd640 1 -- 172.21.15.33:0/2229623018 <== mgr.4103 v2:172.21.15.174:6832/261355069 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+240067 (secure 0 0 0) 0x7f7820069d20 con 0x7f780006b500 2024-05-08T10:54:54.873 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:54:54.875 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-05-08T10:54:54.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.877+0000 7f7824c57640 1 -- 172.21.15.33:0/2229623018 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f780006b500 msgr2=0x7f780006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:54.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.877+0000 7f7824c57640 1 --2- 172.21.15.33:0/2229623018 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f780006b500 0x7f780006d9c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7810009c40 tx=0x7f7810009190 comp rx=0 tx=0).stop 2024-05-08T10:54:54.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.877+0000 7f7824c57640 1 -- 172.21.15.33:0/2229623018 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f78200b6e40 msgr2=0x7f78200b72f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:54.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.877+0000 7f7824c57640 1 --2- 172.21.15.33:0/2229623018 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f78200b6e40 0x7f78200b72f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f78200d2a70 tx=0x7f7818011c30 comp rx=0 tx=0).stop 2024-05-08T10:54:54.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.877+0000 7f7824c57640 1 -- 172.21.15.33:0/2229623018 shutdown_connections 2024-05-08T10:54:54.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.877+0000 7f7824c57640 1 --2- 172.21.15.33:0/2229623018 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f780006b500 0x7f780006d9c0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:54.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.877+0000 7f7824c57640 1 --2- 172.21.15.33:0/2229623018 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f78200b6e40 0x7f78200b72f0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:54.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.877+0000 7f7824c57640 1 --2- 172.21.15.33:0/2229623018 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f782015b0b0 0x7f7820151ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:54.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.877+0000 7f7824c57640 1 --2- 172.21.15.33:0/2229623018 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7808003f80 0x7f78200b82d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:54.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.877+0000 7f7824c57640 1 -- 172.21.15.33:0/2229623018 >> 172.21.15.33:0/2229623018 conn(0x7f78200d3b90 msgr2=0x7f78200ce720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:54:54.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.877+0000 7f7824c57640 1 -- 172.21.15.33:0/2229623018 shutdown_connections 2024-05-08T10:54:54.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:54.877+0000 7f7824c57640 1 -- 172.21.15.33:0/2229623018 wait complete. 2024-05-08T10:54:54.885 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-05-08T10:54:52.944678+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219152,"kb_used_data":2412,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755568,"statfs":{"total":773094113280,"available":772869701632,"internally_reserved":0,"allocated":2469888,"data_stored":1564323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.432515"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-05-08T10:54:48.513367+0000","last_change":"2024-05-08T10:54:48.513367+0000","last_active":"2024-05-08T10:54:48.502524+0000","last_peered":"2024-05-08T10:54:48.502524+0000","last_clean":"2024-05-08T10:54:48.502524+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:48.513367+0000","last_undegraded":"2024-05-08T10:54:48.513367+0000","last_fullsized":"2024-05-08T10:54:48.513367+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-05-08T10:54:48.514456+0000","last_change":"2024-05-08T10:54:48.514456+0000","last_active":"2024-05-08T10:54:48.502524+0000","last_peered":"2024-05-08T10:54:48.502524+0000","last_clean":"2024-05-08T10:54:48.502524+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:48.514456+0000","last_undegraded":"2024-05-08T10:54:48.514456+0000","last_fullsized":"2024-05-08T10:54:48.514456+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-05-08T10:54:48.513372+0000","last_change":"2024-05-08T10:54:48.513372+0000","last_active":"2024-05-08T10:54:48.502524+0000","last_peered":"2024-05-08T10:54:48.502524+0000","last_clean":"2024-05-08T10:54:48.502524+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:48.513372+0000","last_undegraded":"2024-05-08T10:54:48.513372+0000","last_fullsized":"2024-05-08T10:54:48.513372+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-05-08T10:54:48.518453+0000","last_change":"2024-05-08T10:54:48.518453+0000","last_active":"2024-05-08T10:54:48.502524+0000","last_peered":"2024-05-08T10:54:48.502524+0000","last_clean":"2024-05-08T10:54:48.502524+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:48.518453+0000","last_undegraded":"2024-05-08T10:54:48.518453+0000","last_fullsized":"2024-05-08T10:54:48.518453+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-05-08T10:54:48.515404+0000","last_change":"2024-05-08T10:54:48.515404+0000","last_active":"2024-05-08T10:54:48.502524+0000","last_peered":"2024-05-08T10:54:48.502524+0000","last_clean":"2024-05-08T10:54:48.502524+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:48.515404+0000","last_undegraded":"2024-05-08T10:54:48.515404+0000","last_fullsized":"2024-05-08T10:54:48.515404+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-05-08T10:54:48.519014+0000","last_change":"2024-05-08T10:54:48.519014+0000","last_active":"2024-05-08T10:54:48.502524+0000","last_peered":"2024-05-08T10:54:48.502524+0000","last_clean":"2024-05-08T10:54:48.502524+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:48.519014+0000","last_undegraded":"2024-05-08T10:54:48.519014+0000","last_fullsized":"2024-05-08T10:54:48.519014+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-05-08T10:54:48.519942+0000","last_change":"2024-05-08T10:54:48.519942+0000","last_active":"2024-05-08T10:54:48.502524+0000","last_peered":"2024-05-08T10:54:48.502524+0000","last_clean":"2024-05-08T10:54:48.502524+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:48.519942+0000","last_undegraded":"2024-05-08T10:54:48.519942+0000","last_fullsized":"2024-05-08T10:54:48.519942+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-05-08T10:54:48.514466+0000","last_change":"2024-05-08T10:54:48.514466+0000","last_active":"2024-05-08T10:54:48.502524+0000","last_peered":"2024-05-08T10:54:48.502524+0000","last_clean":"2024-05-08T10:54:48.502524+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:48.514466+0000","last_undegraded":"2024-05-08T10:54:48.514466+0000","last_fullsized":"2024-05-08T10:54:48.514466+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-05-08T10:54:48.515399+0000","last_change":"2024-05-08T10:54:48.515399+0000","last_active":"2024-05-08T10:54:48.502524+0000","last_peered":"2024-05-08T10:54:48.502524+0000","last_clean":"2024-05-08T10:54:48.502524+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:48.515399+0000","last_undegraded":"2024-05-08T10:54:48.515399+0000","last_fullsized":"2024-05-08T10:54:48.515399+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-05-08T10:54:48.519568+0000","last_change":"2024-05-08T10:54:48.519568+0000","last_active":"2024-05-08T10:54:48.502524+0000","last_peered":"2024-05-08T10:54:48.502524+0000","last_clean":"2024-05-08T10:54:48.502524+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:48.519568+0000","last_undegraded":"2024-05-08T10:54:48.519568+0000","last_fullsized":"2024-05-08T10:54:48.519568+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-05-08T10:54:48.514435+0000","last_change":"2024-05-08T10:54:48.514435+0000","last_active":"2024-05-08T10:54:48.502524+0000","last_peered":"2024-05-08T10:54:48.502524+0000","last_clean":"2024-05-08T10:54:48.502524+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:48.514435+0000","last_undegraded":"2024-05-08T10:54:48.514435+0000","last_fullsized":"2024-05-08T10:54:48.514435+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-05-08T10:54:48.521816+0000","last_change":"2024-05-08T10:54:48.521816+0000","last_active":"2024-05-08T10:54:48.502524+0000","last_peered":"2024-05-08T10:54:48.502524+0000","last_clean":"2024-05-08T10:54:48.502524+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:48.521816+0000","last_undegraded":"2024-05-08T10:54:48.521816+0000","last_fullsized":"2024-05-08T10:54:48.521816+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-05-08T10:54:48.517479+0000","last_change":"2024-05-08T10:54:48.517479+0000","last_active":"2024-05-08T10:54:48.502524+0000","last_peered":"2024-05-08T10:54:48.502524+0000","last_clean":"2024-05-08T10:54:48.502524+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:48.517479+0000","last_undegraded":"2024-05-08T10:54:48.517479+0000","last_fullsized":"2024-05-08T10:54:48.517479+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-05-08T10:54:48.521941+0000","last_change":"2024-05-08T10:54:48.521941+0000","last_active":"2024-05-08T10:54:48.502524+0000","last_peered":"2024-05-08T10:54:48.502524+0000","last_clean":"2024-05-08T10:54:48.502524+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:48.521941+0000","last_undegraded":"2024-05-08T10:54:48.521941+0000","last_fullsized":"2024-05-08T10:54:48.521941+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-05-08T10:54:48.519024+0000","last_change":"2024-05-08T10:54:48.519024+0000","last_active":"2024-05-08T10:54:48.502524+0000","last_peered":"2024-05-08T10:54:48.502524+0000","last_clean":"2024-05-08T10:54:48.502524+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:48.519024+0000","last_undegraded":"2024-05-08T10:54:48.519024+0000","last_fullsized":"2024-05-08T10:54:48.519024+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-05-08T10:54:48.521921+0000","last_change":"2024-05-08T10:54:48.521921+0000","last_active":"2024-05-08T10:54:48.502524+0000","last_peered":"2024-05-08T10:54:48.502524+0000","last_clean":"2024-05-08T10:54:48.502524+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:48.521921+0000","last_undegraded":"2024-05-08T10:54:48.521921+0000","last_fullsized":"2024-05-08T10:54:48.521921+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":164,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-08T10:54:48.517559+0000","last_change":"2024-05-08T10:54:40.015226+0000","last_active":"2024-05-08T10:54:48.517559+0000","last_peered":"2024-05-08T10:54:48.517559+0000","last_clean":"2024-05-08T10:54:48.517559+0000","last_became_active":"2024-05-08T10:54:40.014219+0000","last_became_peered":"2024-05-08T10:54:40.014219+0000","last_unstale":"2024-05-08T10:54:48.517559+0000","last_undegraded":"2024-05-08T10:54:48.517559+0000","last_fullsized":"2024-05-08T10:54:48.517559+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:38.989328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:38.989328+0000","last_clean_scrub_stamp":"2024-05-08T10:54:38.989328+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:10:59.668786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-05-08T10:54:48.519046+0000","last_change":"2024-05-08T10:54:48.519046+0000","last_active":"2024-05-08T10:54:48.502524+0000","last_peered":"2024-05-08T10:54:48.502524+0000","last_clean":"2024-05-08T10:54:48.502524+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:48.519046+0000","last_undegraded":"2024-05-08T10:54:48.519046+0000","last_fullsized":"2024-05-08T10:54:48.519046+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-05-08T10:54:48.515383+0000","last_change":"2024-05-08T10:54:48.515383+0000","last_active":"2024-05-08T10:54:48.502524+0000","last_peered":"2024-05-08T10:54:48.502524+0000","last_clean":"2024-05-08T10:54:48.502524+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:48.515383+0000","last_undegraded":"2024-05-08T10:54:48.515383+0000","last_fullsized":"2024-05-08T10:54:48.515383+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-05-08T10:54:48.521889+0000","last_change":"2024-05-08T10:54:48.521889+0000","last_active":"2024-05-08T10:54:48.502524+0000","last_peered":"2024-05-08T10:54:48.502524+0000","last_clean":"2024-05-08T10:54:48.502524+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:48.521889+0000","last_undegraded":"2024-05-08T10:54:48.521889+0000","last_fullsized":"2024-05-08T10:54:48.521889+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-05-08T10:54:48.518993+0000","last_change":"2024-05-08T10:54:48.518993+0000","last_active":"2024-05-08T10:54:48.502524+0000","last_peered":"2024-05-08T10:54:48.502524+0000","last_clean":"2024-05-08T10:54:48.502524+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:48.518993+0000","last_undegraded":"2024-05-08T10:54:48.518993+0000","last_fullsized":"2024-05-08T10:54:48.518993+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-05-08T10:54:48.519045+0000","last_change":"2024-05-08T10:54:48.519045+0000","last_active":"2024-05-08T10:54:48.502524+0000","last_peered":"2024-05-08T10:54:48.502524+0000","last_clean":"2024-05-08T10:54:48.502524+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:48.519045+0000","last_undegraded":"2024-05-08T10:54:48.519045+0000","last_fullsized":"2024-05-08T10:54:48.519045+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-05-08T10:54:48.516725+0000","last_change":"2024-05-08T10:54:48.516725+0000","last_active":"2024-05-08T10:54:48.502524+0000","last_peered":"2024-05-08T10:54:48.502524+0000","last_clean":"2024-05-08T10:54:48.502524+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:48.516725+0000","last_undegraded":"2024-05-08T10:54:48.516725+0000","last_fullsized":"2024-05-08T10:54:48.516725+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-05-08T10:54:48.519032+0000","last_change":"2024-05-08T10:54:48.519032+0000","last_active":"2024-05-08T10:54:48.502524+0000","last_peered":"2024-05-08T10:54:48.502524+0000","last_clean":"2024-05-08T10:54:48.502524+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:48.519032+0000","last_undegraded":"2024-05-08T10:54:48.519032+0000","last_fullsized":"2024-05-08T10:54:48.519032+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-05-08T10:54:48.514462+0000","last_change":"2024-05-08T10:54:48.514462+0000","last_active":"2024-05-08T10:54:48.502524+0000","last_peered":"2024-05-08T10:54:48.502524+0000","last_clean":"2024-05-08T10:54:48.502524+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:48.514462+0000","last_undegraded":"2024-05-08T10:54:48.514462+0000","last_fullsized":"2024-05-08T10:54:48.514462+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-05-08T10:54:48.515920+0000","last_change":"2024-05-08T10:54:48.515920+0000","last_active":"2024-05-08T10:54:48.502524+0000","last_peered":"2024-05-08T10:54:48.502524+0000","last_clean":"2024-05-08T10:54:48.502524+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:48.515920+0000","last_undegraded":"2024-05-08T10:54:48.515920+0000","last_fullsized":"2024-05-08T10:54:48.515920+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-05-08T10:54:48.519025+0000","last_change":"2024-05-08T10:54:48.519025+0000","last_active":"2024-05-08T10:54:48.502524+0000","last_peered":"2024-05-08T10:54:48.502524+0000","last_clean":"2024-05-08T10:54:48.502524+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:48.519025+0000","last_undegraded":"2024-05-08T10:54:48.519025+0000","last_fullsized":"2024-05-08T10:54:48.519025+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-05-08T10:54:48.519028+0000","last_change":"2024-05-08T10:54:48.519028+0000","last_active":"2024-05-08T10:54:48.502524+0000","last_peered":"2024-05-08T10:54:48.502524+0000","last_clean":"2024-05-08T10:54:48.502524+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:48.519028+0000","last_undegraded":"2024-05-08T10:54:48.519028+0000","last_fullsized":"2024-05-08T10:54:48.519028+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-05-08T10:54:48.515548+0000","last_change":"2024-05-08T10:54:48.515548+0000","last_active":"2024-05-08T10:54:48.502524+0000","last_peered":"2024-05-08T10:54:48.502524+0000","last_clean":"2024-05-08T10:54:48.502524+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:48.515548+0000","last_undegraded":"2024-05-08T10:54:48.515548+0000","last_fullsized":"2024-05-08T10:54:48.515548+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-05-08T10:54:48.515355+0000","last_change":"2024-05-08T10:54:48.515355+0000","last_active":"2024-05-08T10:54:48.502524+0000","last_peered":"2024-05-08T10:54:48.502524+0000","last_clean":"2024-05-08T10:54:48.502524+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:48.515355+0000","last_undegraded":"2024-05-08T10:54:48.515355+0000","last_fullsized":"2024-05-08T10:54:48.515355+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-05-08T10:54:48.517238+0000","last_change":"2024-05-08T10:54:48.517238+0000","last_active":"2024-05-08T10:54:48.502524+0000","last_peered":"2024-05-08T10:54:48.502524+0000","last_clean":"2024-05-08T10:54:48.502524+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:48.517238+0000","last_undegraded":"2024-05-08T10:54:48.517238+0000","last_fullsized":"2024-05-08T10:54:48.517238+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-05-08T10:54:48.513482+0000","last_change":"2024-05-08T10:54:48.513482+0000","last_active":"2024-05-08T10:54:48.502524+0000","last_peered":"2024-05-08T10:54:48.502524+0000","last_clean":"2024-05-08T10:54:48.502524+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:48.513482+0000","last_undegraded":"2024-05-08T10:54:48.513482+0000","last_fullsized":"2024-05-08T10:54:48.513482+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T10:54:49.510210+0000","last_change":"2024-05-08T10:54:49.510210+0000","last_active":"2024-05-08T10:54:49.510210+0000","last_peered":"2024-05-08T10:54:49.510210+0000","last_clean":"2024-05-08T10:54:49.510210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:49.510210+0000","last_undegraded":"2024-05-08T10:54:49.510210+0000","last_fullsized":"2024-05-08T10:54:49.510210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-05-08T10:54:48.515431+0000","last_change":"2024-05-08T10:54:48.515431+0000","last_active":"2024-05-08T10:54:48.502524+0000","last_peered":"2024-05-08T10:54:48.502524+0000","last_clean":"2024-05-08T10:54:48.502524+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T10:54:48.515431+0000","last_undegraded":"2024-05-08T10:54:48.515431+0000","last_fullsized":"2024-05-08T10:54:48.515431+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27748,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344092,"statfs":{"total":96636764160,"available":96608350208,"internally_reserved":0,"allocated":749568,"data_stored":636135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27176,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":155648,"data_stored":45767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27180,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":155648,"data_stored":45767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":167936,"data_stored":51584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27180,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":155648,"data_stored":45767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":167936,"data_stored":51584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":167936,"data_stored":51584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28316,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343524,"statfs":{"total":96636764160,"available":96607768576,"internally_reserved":0,"allocated":749568,"data_stored":636135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T10:54:54.888 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T10:54:55.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.032+0000 7fd15ab53640 1 Processor -- start 2024-05-08T10:54:55.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.032+0000 7fd15ab53640 1 -- start start 2024-05-08T10:54:55.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.032+0000 7fd15ab53640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fd1541613a0 0x7fd1540d17e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:55.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.032+0000 7fd15ab53640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd1540d4960 0x7fd1540cf4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:55.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.032+0000 7fd15ab53640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1540cf9e0 0x7fd1540d1e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:55.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.032+0000 7fd15ab53640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1540cf010 con 0x7fd1541613a0 2024-05-08T10:54:55.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.032+0000 7fd15ab53640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1540ce720 con 0x7fd1540d4960 2024-05-08T10:54:55.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.032+0000 7fd15ab53640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1540d12d0 con 0x7fd1540cf9e0 2024-05-08T10:54:55.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.033+0000 7fd1588ef640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fd1541613a0 0x7fd1540d17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:55.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.033+0000 7fd1588ef640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fd1541613a0 0x7fd1540d17e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46546/0 (socket says 172.21.15.33:46546) 2024-05-08T10:54:55.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.033+0000 7fd1588ef640 1 -- 172.21.15.33:0/3920896129 learned_addr learned my addr 172.21.15.33:0/3920896129 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:54:55.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.033+0000 7fd1588ef640 1 -- 172.21.15.33:0/3920896129 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1540cf9e0 msgr2=0x7fd1540d1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:54:55.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.033+0000 7fd1590f0640 1 --2- 172.21.15.33:0/3920896129 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1540cf9e0 0x7fd1540d1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:55.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.033+0000 7fd1588ef640 1 --2- 172.21.15.33:0/3920896129 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1540cf9e0 0x7fd1540d1e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:55.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.033+0000 7fd1588ef640 1 -- 172.21.15.33:0/3920896129 >> v2:172.21.15.174:3300/0 conn(0x7fd1540d4960 msgr2=0x7fd1540cf4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:54:55.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.033+0000 7fd153fff640 1 --2- 172.21.15.33:0/3920896129 >> v2:172.21.15.174:3300/0 conn(0x7fd1540d4960 0x7fd1540cf4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:55.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.033+0000 7fd1588ef640 1 --2- 172.21.15.33:0/3920896129 >> v2:172.21.15.174:3300/0 conn(0x7fd1540d4960 0x7fd1540cf4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:55.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.033+0000 7fd1588ef640 1 -- 172.21.15.33:0/3920896129 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1540ce9c0 con 0x7fd1541613a0 2024-05-08T10:54:55.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.034+0000 7fd1588ef640 1 --2- 172.21.15.33:0/3920896129 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1541613a0 0x7fd1540d17e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd15408e0c0 tx=0x7fd14c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af6d3d639c006a65 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:54:55.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.034+0000 7fd1537fe640 1 -- 172.21.15.33:0/3920896129 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd14c037070 con 0x7fd1541613a0 2024-05-08T10:54:55.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.034+0000 7fd1537fe640 1 -- 172.21.15.33:0/3920896129 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd14c032440 con 0x7fd1541613a0 2024-05-08T10:54:55.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.034+0000 7fd1537fe640 1 -- 172.21.15.33:0/3920896129 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd14c032810 con 0x7fd1541613a0 2024-05-08T10:54:55.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.034+0000 7fd15ab53640 1 -- 172.21.15.33:0/3920896129 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1541613a0 msgr2=0x7fd1540d17e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:55.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.034+0000 7fd15ab53640 1 --2- 172.21.15.33:0/3920896129 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1541613a0 0x7fd1540d17e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd15408e0c0 tx=0x7fd14c02a1e0 comp rx=0 tx=0).stop 2024-05-08T10:54:55.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.034+0000 7fd15ab53640 1 -- 172.21.15.33:0/3920896129 shutdown_connections 2024-05-08T10:54:55.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.034+0000 7fd15ab53640 1 --2- 172.21.15.33:0/3920896129 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1540cf9e0 0x7fd1540d1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:55.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.034+0000 7fd15ab53640 1 --2- 172.21.15.33:0/3920896129 >> v2:172.21.15.174:3300/0 conn(0x7fd1540d4960 0x7fd1540cf4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:55.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.034+0000 7fd15ab53640 1 --2- 172.21.15.33:0/3920896129 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1541613a0 0x7fd1540d17e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:55.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.034+0000 7fd15ab53640 1 -- 172.21.15.33:0/3920896129 >> 172.21.15.33:0/3920896129 conn(0x7fd1540d3c10 msgr2=0x7fd1540d4020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:54:55.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.034+0000 7fd15ab53640 1 -- 172.21.15.33:0/3920896129 shutdown_connections 2024-05-08T10:54:55.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.034+0000 7fd15ab53640 1 -- 172.21.15.33:0/3920896129 wait complete. 2024-05-08T10:54:55.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.035+0000 7fd15ab53640 1 Processor -- start 2024-05-08T10:54:55.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.036+0000 7fd15ab53640 1 -- start start 2024-05-08T10:54:55.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.036+0000 7fd15ab53640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1540cf9e0 0x7fd154151230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:55.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.036+0000 7fd15ab53640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd1540d4960 0x7fd1540cd6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:55.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.037+0000 7fd15ab53640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1541613a0 0x7fd1540b8b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:55.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.037+0000 7fd15ab53640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd154161780 con 0x7fd1541613a0 2024-05-08T10:54:55.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.037+0000 7fd15ab53640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1540d0f80 con 0x7fd1540d4960 2024-05-08T10:54:55.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.037+0000 7fd15ab53640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd154161900 con 0x7fd1540cf9e0 2024-05-08T10:54:55.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.037+0000 7fd1590f0640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1541613a0 0x7fd1540b8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:55.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.037+0000 7fd1590f0640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1541613a0 0x7fd1540b8b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46548/0 (socket says 172.21.15.33:46548) 2024-05-08T10:54:55.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.037+0000 7fd1590f0640 1 -- 172.21.15.33:0/3343774437 learned_addr learned my addr 172.21.15.33:0/3343774437 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:54:55.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.037+0000 7fd153fff640 1 --2- 172.21.15.33:0/3343774437 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd1540d4960 0x7fd1540cd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:55.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.037+0000 7fd1588ef640 1 --2- 172.21.15.33:0/3343774437 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1540cf9e0 0x7fd154151230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:55.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.037+0000 7fd1590f0640 1 -- 172.21.15.33:0/3343774437 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1540cf9e0 msgr2=0x7fd154151230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:55.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.037+0000 7fd1590f0640 1 --2- 172.21.15.33:0/3343774437 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1540cf9e0 0x7fd154151230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:55.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.037+0000 7fd1590f0640 1 -- 172.21.15.33:0/3343774437 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd1540d4960 msgr2=0x7fd1540cd6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:55.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.037+0000 7fd1590f0640 1 --2- 172.21.15.33:0/3343774437 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd1540d4960 0x7fd1540cd6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:55.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.037+0000 7fd1590f0640 1 -- 172.21.15.33:0/3343774437 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1540c7760 con 0x7fd1541613a0 2024-05-08T10:54:55.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.037+0000 7fd1590f0640 1 --2- 172.21.15.33:0/3343774437 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1541613a0 0x7fd1540b8b50 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd13c00c590 tx=0x7fd13c00ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:54:55.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.037+0000 7fd1517fa640 1 -- 172.21.15.33:0/3343774437 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd13c015070 con 0x7fd1541613a0 2024-05-08T10:54:55.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.037+0000 7fd1517fa640 1 -- 172.21.15.33:0/3343774437 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd13c004220 con 0x7fd1541613a0 2024-05-08T10:54:55.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.037+0000 7fd15ab53640 1 -- 172.21.15.33:0/3343774437 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1540c7a40 con 0x7fd1541613a0 2024-05-08T10:54:55.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.037+0000 7fd1517fa640 1 -- 172.21.15.33:0/3343774437 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd13c003610 con 0x7fd1541613a0 2024-05-08T10:54:55.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.037+0000 7fd15ab53640 1 -- 172.21.15.33:0/3343774437 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1540b8350 con 0x7fd1541613a0 2024-05-08T10:54:55.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.038+0000 7fd15ab53640 1 -- 172.21.15.33:0/3343774437 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd15406c000 con 0x7fd1541613a0 2024-05-08T10:54:55.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.039+0000 7fd1517fa640 1 -- 172.21.15.33:0/3343774437 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd13c0037b0 con 0x7fd1541613a0 2024-05-08T10:54:55.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.039+0000 7fd1517fa640 1 --2- 172.21.15.33:0/3343774437 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fd13406b4d0 0x7fd13406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:55.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.039+0000 7fd1517fa640 1 -- 172.21.15.33:0/3343774437 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd13c089fb0 con 0x7fd1541613a0 2024-05-08T10:54:55.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.040+0000 7fd1588ef640 1 --2- 172.21.15.33:0/3343774437 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fd13406b4d0 0x7fd13406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:55.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.040+0000 7fd1588ef640 1 --2- 172.21.15.33:0/3343774437 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fd13406b4d0 0x7fd13406d990 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd14c034000 tx=0x7fd14c02e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:54:55.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.044+0000 7fd1517fa640 1 -- 172.21.15.33:0/3343774437 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd15406c000 con 0x7fd1541613a0 2024-05-08T10:54:55.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.222+0000 7fd15ab53640 1 -- 172.21.15.33:0/3343774437 --> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd154069d20 con 0x7fd13406b4d0 2024-05-08T10:54:55.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.229+0000 7fd1517fa640 1 -- 172.21.15.33:0/3343774437 <== mgr.4103 v2:172.21.15.174:6832/261355069 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251946 (secure 0 0 0) 0x7fd154069d20 con 0x7fd13406b4d0 2024-05-08T10:54:55.228 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:54:55.229 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-05-08T10:54:55.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.231+0000 7fd15ab53640 1 -- 172.21.15.33:0/3343774437 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fd13406b4d0 msgr2=0x7fd13406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:55.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.231+0000 7fd15ab53640 1 --2- 172.21.15.33:0/3343774437 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fd13406b4d0 0x7fd13406d990 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd14c034000 tx=0x7fd14c02e000 comp rx=0 tx=0).stop 2024-05-08T10:54:55.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.231+0000 7fd15ab53640 1 -- 172.21.15.33:0/3343774437 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1541613a0 msgr2=0x7fd1540b8b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:55.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.231+0000 7fd15ab53640 1 --2- 172.21.15.33:0/3343774437 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1541613a0 0x7fd1540b8b50 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd13c00c590 tx=0x7fd13c00ca50 comp rx=0 tx=0).stop 2024-05-08T10:54:55.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.231+0000 7fd15ab53640 1 -- 172.21.15.33:0/3343774437 shutdown_connections 2024-05-08T10:54:55.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.231+0000 7fd15ab53640 1 --2- 172.21.15.33:0/3343774437 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fd13406b4d0 0x7fd13406d990 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:55.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.231+0000 7fd15ab53640 1 --2- 172.21.15.33:0/3343774437 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1541613a0 0x7fd1540b8b50 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:55.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.231+0000 7fd15ab53640 1 --2- 172.21.15.33:0/3343774437 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd1540d4960 0x7fd1540cd6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:55.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.231+0000 7fd15ab53640 1 --2- 172.21.15.33:0/3343774437 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1540cf9e0 0x7fd154151230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:55.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.231+0000 7fd15ab53640 1 -- 172.21.15.33:0/3343774437 >> 172.21.15.33:0/3343774437 conn(0x7fd1540d3c10 msgr2=0x7fd15406b8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:54:55.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.232+0000 7fd15ab53640 1 -- 172.21.15.33:0/3343774437 shutdown_connections 2024-05-08T10:54:55.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.232+0000 7fd15ab53640 1 -- 172.21.15.33:0/3343774437 wait complete. 2024-05-08T10:54:55.239 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-05-08T10:54:54.945173+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":136,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218968,"kb_used_data":2800,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755752,"statfs":{"total":773094113280,"available":772869890048,"internally_reserved":0,"allocated":2867200,"data_stored":1740428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001369"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.624024+0000","last_change":"2024-05-08T10:54:50.544238+0000","last_active":"2024-05-08T10:54:51.624024+0000","last_peered":"2024-05-08T10:54:51.624024+0000","last_clean":"2024-05-08T10:54:51.624024+0000","last_became_active":"2024-05-08T10:54:50.543590+0000","last_became_peered":"2024-05-08T10:54:50.543590+0000","last_unstale":"2024-05-08T10:54:51.624024+0000","last_undegraded":"2024-05-08T10:54:51.624024+0000","last_fullsized":"2024-05-08T10:54:51.624024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:17:53.754154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.537034+0000","last_change":"2024-05-08T10:54:50.544605+0000","last_active":"2024-05-08T10:54:51.537034+0000","last_peered":"2024-05-08T10:54:51.537034+0000","last_clean":"2024-05-08T10:54:51.537034+0000","last_became_active":"2024-05-08T10:54:50.543971+0000","last_became_peered":"2024-05-08T10:54:50.543971+0000","last_unstale":"2024-05-08T10:54:51.537034+0000","last_undegraded":"2024-05-08T10:54:51.537034+0000","last_fullsized":"2024-05-08T10:54:51.537034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:17:39.617660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272018+0000","last_change":"2024-05-08T10:54:50.541546+0000","last_active":"2024-05-08T10:54:53.272018+0000","last_peered":"2024-05-08T10:54:53.272018+0000","last_clean":"2024-05-08T10:54:53.272018+0000","last_became_active":"2024-05-08T10:54:50.540512+0000","last_became_peered":"2024-05-08T10:54:50.540512+0000","last_unstale":"2024-05-08T10:54:53.272018+0000","last_undegraded":"2024-05-08T10:54:53.272018+0000","last_fullsized":"2024-05-08T10:54:53.272018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:06:27.967756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272230+0000","last_change":"2024-05-08T10:54:50.550769+0000","last_active":"2024-05-08T10:54:53.272230+0000","last_peered":"2024-05-08T10:54:53.272230+0000","last_clean":"2024-05-08T10:54:53.272230+0000","last_became_active":"2024-05-08T10:54:50.550414+0000","last_became_peered":"2024-05-08T10:54:50.550414+0000","last_unstale":"2024-05-08T10:54:53.272230+0000","last_undegraded":"2024-05-08T10:54:53.272230+0000","last_fullsized":"2024-05-08T10:54:53.272230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:34:17.184122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.623876+0000","last_change":"2024-05-08T10:54:50.540125+0000","last_active":"2024-05-08T10:54:51.623876+0000","last_peered":"2024-05-08T10:54:51.623876+0000","last_clean":"2024-05-08T10:54:51.623876+0000","last_became_active":"2024-05-08T10:54:50.539796+0000","last_became_peered":"2024-05-08T10:54:50.539796+0000","last_unstale":"2024-05-08T10:54:51.623876+0000","last_undegraded":"2024-05-08T10:54:51.623876+0000","last_fullsized":"2024-05-08T10:54:51.623876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:28:49.416807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272082+0000","last_change":"2024-05-08T10:54:50.550911+0000","last_active":"2024-05-08T10:54:53.272082+0000","last_peered":"2024-05-08T10:54:53.272082+0000","last_clean":"2024-05-08T10:54:53.272082+0000","last_became_active":"2024-05-08T10:54:50.550594+0000","last_became_peered":"2024-05-08T10:54:50.550594+0000","last_unstale":"2024-05-08T10:54:53.272082+0000","last_undegraded":"2024-05-08T10:54:53.272082+0000","last_fullsized":"2024-05-08T10:54:53.272082+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:27:46.730550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.623675+0000","last_change":"2024-05-08T10:54:50.547034+0000","last_active":"2024-05-08T10:54:51.623675+0000","last_peered":"2024-05-08T10:54:51.623675+0000","last_clean":"2024-05-08T10:54:51.623675+0000","last_became_active":"2024-05-08T10:54:50.546680+0000","last_became_peered":"2024-05-08T10:54:50.546680+0000","last_unstale":"2024-05-08T10:54:51.623675+0000","last_undegraded":"2024-05-08T10:54:51.623675+0000","last_fullsized":"2024-05-08T10:54:51.623675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:14:08.876280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.271747+0000","last_change":"2024-05-08T10:54:50.553200+0000","last_active":"2024-05-08T10:54:53.271747+0000","last_peered":"2024-05-08T10:54:53.271747+0000","last_clean":"2024-05-08T10:54:53.271747+0000","last_became_active":"2024-05-08T10:54:50.552845+0000","last_became_peered":"2024-05-08T10:54:50.552845+0000","last_unstale":"2024-05-08T10:54:53.271747+0000","last_undegraded":"2024-05-08T10:54:53.271747+0000","last_fullsized":"2024-05-08T10:54:53.271747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:46:10.084159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.624104+0000","last_change":"2024-05-08T10:54:50.542398+0000","last_active":"2024-05-08T10:54:51.624104+0000","last_peered":"2024-05-08T10:54:51.624104+0000","last_clean":"2024-05-08T10:54:51.624104+0000","last_became_active":"2024-05-08T10:54:50.542014+0000","last_became_peered":"2024-05-08T10:54:50.542014+0000","last_unstale":"2024-05-08T10:54:51.624104+0000","last_undegraded":"2024-05-08T10:54:51.624104+0000","last_fullsized":"2024-05-08T10:54:51.624104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:36:31.739083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.539523+0000","last_change":"2024-05-08T10:54:50.542033+0000","last_active":"2024-05-08T10:54:51.539523+0000","last_peered":"2024-05-08T10:54:51.539523+0000","last_clean":"2024-05-08T10:54:51.539523+0000","last_became_active":"2024-05-08T10:54:50.541776+0000","last_became_peered":"2024-05-08T10:54:50.541776+0000","last_unstale":"2024-05-08T10:54:51.539523+0000","last_undegraded":"2024-05-08T10:54:51.539523+0000","last_fullsized":"2024-05-08T10:54:51.539523+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:17:39.617660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.538877+0000","last_change":"2024-05-08T10:54:50.541380+0000","last_active":"2024-05-08T10:54:51.538877+0000","last_peered":"2024-05-08T10:54:51.538877+0000","last_clean":"2024-05-08T10:54:51.538877+0000","last_became_active":"2024-05-08T10:54:50.540999+0000","last_became_peered":"2024-05-08T10:54:50.540999+0000","last_unstale":"2024-05-08T10:54:51.538877+0000","last_undegraded":"2024-05-08T10:54:51.538877+0000","last_fullsized":"2024-05-08T10:54:51.538877+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:12:04.365598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.539267+0000","last_change":"2024-05-08T10:54:50.536612+0000","last_active":"2024-05-08T10:54:51.539267+0000","last_peered":"2024-05-08T10:54:51.539267+0000","last_clean":"2024-05-08T10:54:51.539267+0000","last_became_active":"2024-05-08T10:54:50.536347+0000","last_became_peered":"2024-05-08T10:54:50.536347+0000","last_unstale":"2024-05-08T10:54:51.539267+0000","last_undegraded":"2024-05-08T10:54:51.539267+0000","last_fullsized":"2024-05-08T10:54:51.539267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:00:53.753820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272252+0000","last_change":"2024-05-08T10:54:50.542352+0000","last_active":"2024-05-08T10:54:53.272252+0000","last_peered":"2024-05-08T10:54:53.272252+0000","last_clean":"2024-05-08T10:54:53.272252+0000","last_became_active":"2024-05-08T10:54:50.542056+0000","last_became_peered":"2024-05-08T10:54:50.542056+0000","last_unstale":"2024-05-08T10:54:53.272252+0000","last_undegraded":"2024-05-08T10:54:53.272252+0000","last_fullsized":"2024-05-08T10:54:53.272252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:43:52.788984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.271763+0000","last_change":"2024-05-08T10:54:50.540420+0000","last_active":"2024-05-08T10:54:53.271763+0000","last_peered":"2024-05-08T10:54:53.271763+0000","last_clean":"2024-05-08T10:54:53.271763+0000","last_became_active":"2024-05-08T10:54:50.540073+0000","last_became_peered":"2024-05-08T10:54:50.540073+0000","last_unstale":"2024-05-08T10:54:53.271763+0000","last_undegraded":"2024-05-08T10:54:53.271763+0000","last_fullsized":"2024-05-08T10:54:53.271763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:44:24.261973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.536636+0000","last_change":"2024-05-08T10:54:50.531957+0000","last_active":"2024-05-08T10:54:51.536636+0000","last_peered":"2024-05-08T10:54:51.536636+0000","last_clean":"2024-05-08T10:54:51.536636+0000","last_became_active":"2024-05-08T10:54:50.531646+0000","last_became_peered":"2024-05-08T10:54:50.531646+0000","last_unstale":"2024-05-08T10:54:51.536636+0000","last_undegraded":"2024-05-08T10:54:51.536636+0000","last_fullsized":"2024-05-08T10:54:51.536636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:06:27.967756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272153+0000","last_change":"2024-05-08T10:54:50.545714+0000","last_active":"2024-05-08T10:54:53.272153+0000","last_peered":"2024-05-08T10:54:53.272153+0000","last_clean":"2024-05-08T10:54:53.272153+0000","last_became_active":"2024-05-08T10:54:50.545415+0000","last_became_peered":"2024-05-08T10:54:50.545415+0000","last_unstale":"2024-05-08T10:54:53.272153+0000","last_undegraded":"2024-05-08T10:54:53.272153+0000","last_fullsized":"2024-05-08T10:54:53.272153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:40:14.037116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272642+0000","last_change":"2024-05-08T10:54:50.543717+0000","last_active":"2024-05-08T10:54:53.272642+0000","last_peered":"2024-05-08T10:54:53.272642+0000","last_clean":"2024-05-08T10:54:53.272642+0000","last_became_active":"2024-05-08T10:54:50.543465+0000","last_became_peered":"2024-05-08T10:54:50.543465+0000","last_unstale":"2024-05-08T10:54:53.272642+0000","last_undegraded":"2024-05-08T10:54:53.272642+0000","last_fullsized":"2024-05-08T10:54:53.272642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:17:53.754154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:52.206333+0000","last_change":"2024-05-08T10:54:50.535283+0000","last_active":"2024-05-08T10:54:52.206333+0000","last_peered":"2024-05-08T10:54:52.206333+0000","last_clean":"2024-05-08T10:54:52.206333+0000","last_became_active":"2024-05-08T10:54:50.534933+0000","last_became_peered":"2024-05-08T10:54:50.534933+0000","last_unstale":"2024-05-08T10:54:52.206333+0000","last_undegraded":"2024-05-08T10:54:52.206333+0000","last_fullsized":"2024-05-08T10:54:52.206333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:06.987968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.624055+0000","last_change":"2024-05-08T10:54:50.545460+0000","last_active":"2024-05-08T10:54:51.624055+0000","last_peered":"2024-05-08T10:54:51.624055+0000","last_clean":"2024-05-08T10:54:51.624055+0000","last_became_active":"2024-05-08T10:54:50.545182+0000","last_became_peered":"2024-05-08T10:54:50.545182+0000","last_unstale":"2024-05-08T10:54:51.624055+0000","last_undegraded":"2024-05-08T10:54:51.624055+0000","last_fullsized":"2024-05-08T10:54:51.624055+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:35:53.604235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.539432+0000","last_change":"2024-05-08T10:54:50.534702+0000","last_active":"2024-05-08T10:54:51.539432+0000","last_peered":"2024-05-08T10:54:51.539432+0000","last_clean":"2024-05-08T10:54:51.539432+0000","last_became_active":"2024-05-08T10:54:50.534424+0000","last_became_peered":"2024-05-08T10:54:50.534424+0000","last_unstale":"2024-05-08T10:54:51.539432+0000","last_undegraded":"2024-05-08T10:54:51.539432+0000","last_fullsized":"2024-05-08T10:54:51.539432+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:27:46.730550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.271871+0000","last_change":"2024-05-08T10:54:50.542206+0000","last_active":"2024-05-08T10:54:53.271871+0000","last_peered":"2024-05-08T10:54:53.271871+0000","last_clean":"2024-05-08T10:54:53.271871+0000","last_became_active":"2024-05-08T10:54:50.540272+0000","last_became_peered":"2024-05-08T10:54:50.540272+0000","last_unstale":"2024-05-08T10:54:53.271871+0000","last_undegraded":"2024-05-08T10:54:53.271871+0000","last_fullsized":"2024-05-08T10:54:53.271871+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:45:53.748139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272432+0000","last_change":"2024-05-08T10:54:50.546452+0000","last_active":"2024-05-08T10:54:53.272432+0000","last_peered":"2024-05-08T10:54:53.272432+0000","last_clean":"2024-05-08T10:54:53.272432+0000","last_became_active":"2024-05-08T10:54:50.546143+0000","last_became_peered":"2024-05-08T10:54:50.546143+0000","last_unstale":"2024-05-08T10:54:53.272432+0000","last_undegraded":"2024-05-08T10:54:53.272432+0000","last_fullsized":"2024-05-08T10:54:53.272432+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:50:37.863580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.271957+0000","last_change":"2024-05-08T10:54:50.547750+0000","last_active":"2024-05-08T10:54:53.271957+0000","last_peered":"2024-05-08T10:54:53.271957+0000","last_clean":"2024-05-08T10:54:53.271957+0000","last_became_active":"2024-05-08T10:54:50.547492+0000","last_became_peered":"2024-05-08T10:54:50.547492+0000","last_unstale":"2024-05-08T10:54:53.271957+0000","last_undegraded":"2024-05-08T10:54:53.271957+0000","last_fullsized":"2024-05-08T10:54:53.271957+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:06:27.967756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272070+0000","last_change":"2024-05-08T10:54:50.547741+0000","last_active":"2024-05-08T10:54:53.272070+0000","last_peered":"2024-05-08T10:54:53.272070+0000","last_clean":"2024-05-08T10:54:53.272070+0000","last_became_active":"2024-05-08T10:54:50.547475+0000","last_became_peered":"2024-05-08T10:54:50.547475+0000","last_unstale":"2024-05-08T10:54:53.272070+0000","last_undegraded":"2024-05-08T10:54:53.272070+0000","last_fullsized":"2024-05-08T10:54:53.272070+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:17:39.617660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272323+0000","last_change":"2024-05-08T10:54:50.546236+0000","last_active":"2024-05-08T10:54:53.272323+0000","last_peered":"2024-05-08T10:54:53.272323+0000","last_clean":"2024-05-08T10:54:53.272323+0000","last_became_active":"2024-05-08T10:54:50.545968+0000","last_became_peered":"2024-05-08T10:54:50.545968+0000","last_unstale":"2024-05-08T10:54:53.272323+0000","last_undegraded":"2024-05-08T10:54:53.272323+0000","last_fullsized":"2024-05-08T10:54:53.272323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:17:39.617660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.539559+0000","last_change":"2024-05-08T10:54:50.532358+0000","last_active":"2024-05-08T10:54:51.539559+0000","last_peered":"2024-05-08T10:54:51.539559+0000","last_clean":"2024-05-08T10:54:51.539559+0000","last_became_active":"2024-05-08T10:54:50.532084+0000","last_became_peered":"2024-05-08T10:54:50.532084+0000","last_unstale":"2024-05-08T10:54:51.539559+0000","last_undegraded":"2024-05-08T10:54:51.539559+0000","last_fullsized":"2024-05-08T10:54:51.539559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:40:14.037116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.536825+0000","last_change":"2024-05-08T10:54:50.542677+0000","last_active":"2024-05-08T10:54:51.536825+0000","last_peered":"2024-05-08T10:54:51.536825+0000","last_clean":"2024-05-08T10:54:51.536825+0000","last_became_active":"2024-05-08T10:54:50.542364+0000","last_became_peered":"2024-05-08T10:54:50.542364+0000","last_unstale":"2024-05-08T10:54:51.536825+0000","last_undegraded":"2024-05-08T10:54:51.536825+0000","last_fullsized":"2024-05-08T10:54:51.536825+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:27:46.730550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272321+0000","last_change":"2024-05-08T10:54:50.546906+0000","last_active":"2024-05-08T10:54:53.272321+0000","last_peered":"2024-05-08T10:54:53.272321+0000","last_clean":"2024-05-08T10:54:53.272321+0000","last_became_active":"2024-05-08T10:54:50.546627+0000","last_became_peered":"2024-05-08T10:54:50.546627+0000","last_unstale":"2024-05-08T10:54:53.272321+0000","last_undegraded":"2024-05-08T10:54:53.272321+0000","last_fullsized":"2024-05-08T10:54:53.272321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:27:46.730550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.271948+0000","last_change":"2024-05-08T10:54:50.552062+0000","last_active":"2024-05-08T10:54:53.271948+0000","last_peered":"2024-05-08T10:54:53.271948+0000","last_clean":"2024-05-08T10:54:53.271948+0000","last_became_active":"2024-05-08T10:54:50.550966+0000","last_became_peered":"2024-05-08T10:54:50.550966+0000","last_unstale":"2024-05-08T10:54:53.271948+0000","last_undegraded":"2024-05-08T10:54:53.271948+0000","last_fullsized":"2024-05-08T10:54:53.271948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:07:03.513132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272358+0000","last_change":"2024-05-08T10:54:50.550884+0000","last_active":"2024-05-08T10:54:53.272358+0000","last_peered":"2024-05-08T10:54:53.272358+0000","last_clean":"2024-05-08T10:54:53.272358+0000","last_became_active":"2024-05-08T10:54:50.550437+0000","last_became_peered":"2024-05-08T10:54:50.550437+0000","last_unstale":"2024-05-08T10:54:53.272358+0000","last_undegraded":"2024-05-08T10:54:53.272358+0000","last_fullsized":"2024-05-08T10:54:53.272358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:14:08.876280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:52.206355+0000","last_change":"2024-05-08T10:54:50.537512+0000","last_active":"2024-05-08T10:54:52.206355+0000","last_peered":"2024-05-08T10:54:52.206355+0000","last_clean":"2024-05-08T10:54:52.206355+0000","last_became_active":"2024-05-08T10:54:50.537214+0000","last_became_peered":"2024-05-08T10:54:50.537214+0000","last_unstale":"2024-05-08T10:54:52.206355+0000","last_undegraded":"2024-05-08T10:54:52.206355+0000","last_fullsized":"2024-05-08T10:54:52.206355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:31:55.776210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.538582+0000","last_change":"2024-05-08T10:54:50.544340+0000","last_active":"2024-05-08T10:54:51.538582+0000","last_peered":"2024-05-08T10:54:51.538582+0000","last_clean":"2024-05-08T10:54:51.538582+0000","last_became_active":"2024-05-08T10:54:50.544072+0000","last_became_peered":"2024-05-08T10:54:50.544072+0000","last_unstale":"2024-05-08T10:54:51.538582+0000","last_undegraded":"2024-05-08T10:54:51.538582+0000","last_fullsized":"2024-05-08T10:54:51.538582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:07:03.513132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.539220+0000","last_change":"2024-05-08T10:54:50.532176+0000","last_active":"2024-05-08T10:54:51.539220+0000","last_peered":"2024-05-08T10:54:51.539220+0000","last_clean":"2024-05-08T10:54:51.539220+0000","last_became_active":"2024-05-08T10:54:50.531846+0000","last_became_peered":"2024-05-08T10:54:50.531846+0000","last_unstale":"2024-05-08T10:54:51.539220+0000","last_undegraded":"2024-05-08T10:54:51.539220+0000","last_fullsized":"2024-05-08T10:54:51.539220+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:07:13.589112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272439+0000","last_change":"2024-05-08T10:54:49.539056+0000","last_active":"2024-05-08T10:54:53.272439+0000","last_peered":"2024-05-08T10:54:53.272439+0000","last_clean":"2024-05-08T10:54:53.272439+0000","last_became_active":"2024-05-08T10:54:49.538788+0000","last_became_peered":"2024-05-08T10:54:49.538788+0000","last_unstale":"2024-05-08T10:54:53.272439+0000","last_undegraded":"2024-05-08T10:54:53.272439+0000","last_fullsized":"2024-05-08T10:54:53.272439+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:21:53.697233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272029+0000","last_change":"2024-05-08T10:54:50.536315+0000","last_active":"2024-05-08T10:54:53.272029+0000","last_peered":"2024-05-08T10:54:53.272029+0000","last_clean":"2024-05-08T10:54:53.272029+0000","last_became_active":"2024-05-08T10:54:50.536003+0000","last_became_peered":"2024-05-08T10:54:50.536003+0000","last_unstale":"2024-05-08T10:54:53.272029+0000","last_undegraded":"2024-05-08T10:54:53.272029+0000","last_fullsized":"2024-05-08T10:54:53.272029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:12:04.365598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.539075+0000","last_change":"2024-05-08T10:54:49.530966+0000","last_active":"2024-05-08T10:54:51.539075+0000","last_peered":"2024-05-08T10:54:51.539075+0000","last_clean":"2024-05-08T10:54:51.539075+0000","last_became_active":"2024-05-08T10:54:49.530656+0000","last_became_peered":"2024-05-08T10:54:49.530656+0000","last_unstale":"2024-05-08T10:54:51.539075+0000","last_undegraded":"2024-05-08T10:54:51.539075+0000","last_fullsized":"2024-05-08T10:54:51.539075+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:00:52.746134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272492+0000","last_change":"2024-05-08T10:54:49.536057+0000","last_active":"2024-05-08T10:54:53.272492+0000","last_peered":"2024-05-08T10:54:53.272492+0000","last_clean":"2024-05-08T10:54:53.272492+0000","last_became_active":"2024-05-08T10:54:49.535697+0000","last_became_peered":"2024-05-08T10:54:49.535697+0000","last_unstale":"2024-05-08T10:54:53.272492+0000","last_undegraded":"2024-05-08T10:54:53.272492+0000","last_fullsized":"2024-05-08T10:54:53.272492+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:50:17.425844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.271904+0000","last_change":"2024-05-08T10:54:50.551282+0000","last_active":"2024-05-08T10:54:53.271904+0000","last_peered":"2024-05-08T10:54:53.271904+0000","last_clean":"2024-05-08T10:54:53.271904+0000","last_became_active":"2024-05-08T10:54:50.550992+0000","last_became_peered":"2024-05-08T10:54:50.550992+0000","last_unstale":"2024-05-08T10:54:53.271904+0000","last_undegraded":"2024-05-08T10:54:53.271904+0000","last_fullsized":"2024-05-08T10:54:53.271904+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:07:03.513132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272265+0000","last_change":"2024-05-08T10:54:49.533211+0000","last_active":"2024-05-08T10:54:53.272265+0000","last_peered":"2024-05-08T10:54:53.272265+0000","last_clean":"2024-05-08T10:54:53.272265+0000","last_became_active":"2024-05-08T10:54:49.532870+0000","last_became_peered":"2024-05-08T10:54:49.532870+0000","last_unstale":"2024-05-08T10:54:53.272265+0000","last_undegraded":"2024-05-08T10:54:53.272265+0000","last_fullsized":"2024-05-08T10:54:53.272265+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:04:27.826613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.536597+0000","last_change":"2024-05-08T10:54:50.549669+0000","last_active":"2024-05-08T10:54:51.536597+0000","last_peered":"2024-05-08T10:54:51.536597+0000","last_clean":"2024-05-08T10:54:51.536597+0000","last_became_active":"2024-05-08T10:54:50.549148+0000","last_became_peered":"2024-05-08T10:54:50.549148+0000","last_unstale":"2024-05-08T10:54:51.536597+0000","last_undegraded":"2024-05-08T10:54:51.536597+0000","last_fullsized":"2024-05-08T10:54:51.536597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:07:03.513132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.538726+0000","last_change":"2024-05-08T10:54:49.534750+0000","last_active":"2024-05-08T10:54:51.538726+0000","last_peered":"2024-05-08T10:54:51.538726+0000","last_clean":"2024-05-08T10:54:51.538726+0000","last_became_active":"2024-05-08T10:54:49.534448+0000","last_became_peered":"2024-05-08T10:54:49.534448+0000","last_unstale":"2024-05-08T10:54:51.538726+0000","last_undegraded":"2024-05-08T10:54:51.538726+0000","last_fullsized":"2024-05-08T10:54:51.538726+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:35:21.510783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272387+0000","last_change":"2024-05-08T10:54:50.542813+0000","last_active":"2024-05-08T10:54:53.272387+0000","last_peered":"2024-05-08T10:54:53.272387+0000","last_clean":"2024-05-08T10:54:53.272387+0000","last_became_active":"2024-05-08T10:54:50.542521+0000","last_became_peered":"2024-05-08T10:54:50.542521+0000","last_unstale":"2024-05-08T10:54:53.272387+0000","last_undegraded":"2024-05-08T10:54:53.272387+0000","last_fullsized":"2024-05-08T10:54:53.272387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:20:08.620180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272450+0000","last_change":"2024-05-08T10:54:49.534807+0000","last_active":"2024-05-08T10:54:53.272450+0000","last_peered":"2024-05-08T10:54:53.272450+0000","last_clean":"2024-05-08T10:54:53.272450+0000","last_became_active":"2024-05-08T10:54:49.534525+0000","last_became_peered":"2024-05-08T10:54:49.534525+0000","last_unstale":"2024-05-08T10:54:53.272450+0000","last_undegraded":"2024-05-08T10:54:53.272450+0000","last_fullsized":"2024-05-08T10:54:53.272450+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:07:12.581426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272500+0000","last_change":"2024-05-08T10:54:50.549738+0000","last_active":"2024-05-08T10:54:53.272500+0000","last_peered":"2024-05-08T10:54:53.272500+0000","last_clean":"2024-05-08T10:54:53.272500+0000","last_became_active":"2024-05-08T10:54:50.548425+0000","last_became_peered":"2024-05-08T10:54:50.548425+0000","last_unstale":"2024-05-08T10:54:53.272500+0000","last_undegraded":"2024-05-08T10:54:53.272500+0000","last_fullsized":"2024-05-08T10:54:53.272500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:17:39.617660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.536748+0000","last_change":"2024-05-08T10:54:49.540157+0000","last_active":"2024-05-08T10:54:51.536748+0000","last_peered":"2024-05-08T10:54:51.536748+0000","last_clean":"2024-05-08T10:54:51.536748+0000","last_became_active":"2024-05-08T10:54:49.539852+0000","last_became_peered":"2024-05-08T10:54:49.539852+0000","last_unstale":"2024-05-08T10:54:51.536748+0000","last_undegraded":"2024-05-08T10:54:51.536748+0000","last_fullsized":"2024-05-08T10:54:51.536748+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:00:52.746134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.539495+0000","last_change":"2024-05-08T10:54:50.534438+0000","last_active":"2024-05-08T10:54:51.539495+0000","last_peered":"2024-05-08T10:54:51.539495+0000","last_clean":"2024-05-08T10:54:51.539495+0000","last_became_active":"2024-05-08T10:54:50.533971+0000","last_became_peered":"2024-05-08T10:54:50.533971+0000","last_unstale":"2024-05-08T10:54:51.539495+0000","last_undegraded":"2024-05-08T10:54:51.539495+0000","last_fullsized":"2024-05-08T10:54:51.539495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:06.987968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.539367+0000","last_change":"2024-05-08T10:54:49.531309+0000","last_active":"2024-05-08T10:54:51.539367+0000","last_peered":"2024-05-08T10:54:51.539367+0000","last_clean":"2024-05-08T10:54:51.539367+0000","last_became_active":"2024-05-08T10:54:49.530442+0000","last_became_peered":"2024-05-08T10:54:49.530442+0000","last_unstale":"2024-05-08T10:54:51.539367+0000","last_undegraded":"2024-05-08T10:54:51.539367+0000","last_fullsized":"2024-05-08T10:54:51.539367+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:07:12.581426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.623854+0000","last_change":"2024-05-08T10:54:50.549577+0000","last_active":"2024-05-08T10:54:51.623854+0000","last_peered":"2024-05-08T10:54:51.623854+0000","last_clean":"2024-05-08T10:54:51.623854+0000","last_became_active":"2024-05-08T10:54:50.549318+0000","last_became_peered":"2024-05-08T10:54:50.549318+0000","last_unstale":"2024-05-08T10:54:51.623854+0000","last_undegraded":"2024-05-08T10:54:51.623854+0000","last_fullsized":"2024-05-08T10:54:51.623854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:50:37.863580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272014+0000","last_change":"2024-05-08T10:54:49.534151+0000","last_active":"2024-05-08T10:54:53.272014+0000","last_peered":"2024-05-08T10:54:53.272014+0000","last_clean":"2024-05-08T10:54:53.272014+0000","last_became_active":"2024-05-08T10:54:49.533841+0000","last_became_peered":"2024-05-08T10:54:49.533841+0000","last_unstale":"2024-05-08T10:54:53.272014+0000","last_undegraded":"2024-05-08T10:54:53.272014+0000","last_fullsized":"2024-05-08T10:54:53.272014+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:43:52.839891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.271941+0000","last_change":"2024-05-08T10:54:50.539238+0000","last_active":"2024-05-08T10:54:53.271941+0000","last_peered":"2024-05-08T10:54:53.271941+0000","last_clean":"2024-05-08T10:54:53.271941+0000","last_became_active":"2024-05-08T10:54:50.538930+0000","last_became_peered":"2024-05-08T10:54:50.538930+0000","last_unstale":"2024-05-08T10:54:53.271941+0000","last_undegraded":"2024-05-08T10:54:53.271941+0000","last_fullsized":"2024-05-08T10:54:53.271941+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:46:10.084159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272450+0000","last_change":"2024-05-08T10:54:49.537048+0000","last_active":"2024-05-08T10:54:53.272450+0000","last_peered":"2024-05-08T10:54:53.272450+0000","last_clean":"2024-05-08T10:54:53.272450+0000","last_became_active":"2024-05-08T10:54:49.536620+0000","last_became_peered":"2024-05-08T10:54:49.536620+0000","last_unstale":"2024-05-08T10:54:53.272450+0000","last_undegraded":"2024-05-08T10:54:53.272450+0000","last_fullsized":"2024-05-08T10:54:53.272450+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:35:21.510783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.623897+0000","last_change":"2024-05-08T10:54:50.545019+0000","last_active":"2024-05-08T10:54:51.623897+0000","last_peered":"2024-05-08T10:54:51.623897+0000","last_clean":"2024-05-08T10:54:51.623897+0000","last_became_active":"2024-05-08T10:54:50.544710+0000","last_became_peered":"2024-05-08T10:54:50.544710+0000","last_unstale":"2024-05-08T10:54:51.623897+0000","last_undegraded":"2024-05-08T10:54:51.623897+0000","last_fullsized":"2024-05-08T10:54:51.623897+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:08:48.409546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.538557+0000","last_change":"2024-05-08T10:54:49.531681+0000","last_active":"2024-05-08T10:54:51.538557+0000","last_peered":"2024-05-08T10:54:51.538557+0000","last_clean":"2024-05-08T10:54:51.538557+0000","last_became_active":"2024-05-08T10:54:49.531120+0000","last_became_peered":"2024-05-08T10:54:49.531120+0000","last_unstale":"2024-05-08T10:54:51.538557+0000","last_undegraded":"2024-05-08T10:54:51.538557+0000","last_fullsized":"2024-05-08T10:54:51.538557+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:41:42.237766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.538783+0000","last_change":"2024-05-08T10:54:50.544975+0000","last_active":"2024-05-08T10:54:51.538783+0000","last_peered":"2024-05-08T10:54:51.538783+0000","last_clean":"2024-05-08T10:54:51.538783+0000","last_became_active":"2024-05-08T10:54:50.544731+0000","last_became_peered":"2024-05-08T10:54:50.544731+0000","last_unstale":"2024-05-08T10:54:51.538783+0000","last_undegraded":"2024-05-08T10:54:51.538783+0000","last_fullsized":"2024-05-08T10:54:51.538783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:06:27.967756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:52.206041+0000","last_change":"2024-05-08T10:54:49.531598+0000","last_active":"2024-05-08T10:54:52.206041+0000","last_peered":"2024-05-08T10:54:52.206041+0000","last_clean":"2024-05-08T10:54:52.206041+0000","last_became_active":"2024-05-08T10:54:49.531288+0000","last_became_peered":"2024-05-08T10:54:49.531288+0000","last_unstale":"2024-05-08T10:54:52.206041+0000","last_undegraded":"2024-05-08T10:54:52.206041+0000","last_fullsized":"2024-05-08T10:54:52.206041+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:04:27.826613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.623671+0000","last_change":"2024-05-08T10:54:50.543982+0000","last_active":"2024-05-08T10:54:51.623671+0000","last_peered":"2024-05-08T10:54:51.623671+0000","last_clean":"2024-05-08T10:54:51.623671+0000","last_became_active":"2024-05-08T10:54:50.543721+0000","last_became_peered":"2024-05-08T10:54:50.543721+0000","last_unstale":"2024-05-08T10:54:51.623671+0000","last_undegraded":"2024-05-08T10:54:51.623671+0000","last_fullsized":"2024-05-08T10:54:51.623671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:34:17.184122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.538712+0000","last_change":"2024-05-08T10:54:49.535555+0000","last_active":"2024-05-08T10:54:51.538712+0000","last_peered":"2024-05-08T10:54:51.538712+0000","last_clean":"2024-05-08T10:54:51.538712+0000","last_became_active":"2024-05-08T10:54:49.535171+0000","last_became_peered":"2024-05-08T10:54:49.535171+0000","last_unstale":"2024-05-08T10:54:51.538712+0000","last_undegraded":"2024-05-08T10:54:51.538712+0000","last_fullsized":"2024-05-08T10:54:51.538712+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:45:13.454727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.623934+0000","last_change":"2024-05-08T10:54:50.547853+0000","last_active":"2024-05-08T10:54:51.623934+0000","last_peered":"2024-05-08T10:54:51.623934+0000","last_clean":"2024-05-08T10:54:51.623934+0000","last_became_active":"2024-05-08T10:54:50.547647+0000","last_became_peered":"2024-05-08T10:54:50.547647+0000","last_unstale":"2024-05-08T10:54:51.623934+0000","last_undegraded":"2024-05-08T10:54:51.623934+0000","last_fullsized":"2024-05-08T10:54:51.623934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:41:02.815763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:52.206276+0000","last_change":"2024-05-08T10:54:49.528935+0000","last_active":"2024-05-08T10:54:52.206276+0000","last_peered":"2024-05-08T10:54:52.206276+0000","last_clean":"2024-05-08T10:54:52.206276+0000","last_became_active":"2024-05-08T10:54:49.528373+0000","last_became_peered":"2024-05-08T10:54:49.528373+0000","last_unstale":"2024-05-08T10:54:52.206276+0000","last_undegraded":"2024-05-08T10:54:52.206276+0000","last_fullsized":"2024-05-08T10:54:52.206276+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:41:42.237766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.624161+0000","last_change":"2024-05-08T10:54:50.548188+0000","last_active":"2024-05-08T10:54:51.624161+0000","last_peered":"2024-05-08T10:54:51.624161+0000","last_clean":"2024-05-08T10:54:51.624161+0000","last_became_active":"2024-05-08T10:54:50.547738+0000","last_became_peered":"2024-05-08T10:54:50.547738+0000","last_unstale":"2024-05-08T10:54:51.624161+0000","last_undegraded":"2024-05-08T10:54:51.624161+0000","last_fullsized":"2024-05-08T10:54:51.624161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:27:33.078243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.536866+0000","last_change":"2024-05-08T10:54:49.539756+0000","last_active":"2024-05-08T10:54:51.536866+0000","last_peered":"2024-05-08T10:54:51.536866+0000","last_clean":"2024-05-08T10:54:51.536866+0000","last_became_active":"2024-05-08T10:54:49.539459+0000","last_became_peered":"2024-05-08T10:54:49.539459+0000","last_unstale":"2024-05-08T10:54:51.536866+0000","last_undegraded":"2024-05-08T10:54:51.536866+0000","last_fullsized":"2024-05-08T10:54:51.536866+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:40:16.322062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272509+0000","last_change":"2024-05-08T10:54:50.550681+0000","last_active":"2024-05-08T10:54:53.272509+0000","last_peered":"2024-05-08T10:54:53.272509+0000","last_clean":"2024-05-08T10:54:53.272509+0000","last_became_active":"2024-05-08T10:54:50.550395+0000","last_became_peered":"2024-05-08T10:54:50.550395+0000","last_unstale":"2024-05-08T10:54:53.272509+0000","last_undegraded":"2024-05-08T10:54:53.272509+0000","last_fullsized":"2024-05-08T10:54:53.272509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:08:48.409546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:52.206093+0000","last_change":"2024-05-08T10:54:49.534684+0000","last_active":"2024-05-08T10:54:52.206093+0000","last_peered":"2024-05-08T10:54:52.206093+0000","last_clean":"2024-05-08T10:54:52.206093+0000","last_became_active":"2024-05-08T10:54:49.534333+0000","last_became_peered":"2024-05-08T10:54:49.534333+0000","last_unstale":"2024-05-08T10:54:52.206093+0000","last_undegraded":"2024-05-08T10:54:52.206093+0000","last_fullsized":"2024-05-08T10:54:52.206093+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:07:12.581426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.623842+0000","last_change":"2024-05-08T10:54:50.541378+0000","last_active":"2024-05-08T10:54:51.623842+0000","last_peered":"2024-05-08T10:54:51.623842+0000","last_clean":"2024-05-08T10:54:51.623842+0000","last_became_active":"2024-05-08T10:54:50.540987+0000","last_became_peered":"2024-05-08T10:54:50.540987+0000","last_unstale":"2024-05-08T10:54:51.623842+0000","last_undegraded":"2024-05-08T10:54:51.623842+0000","last_fullsized":"2024-05-08T10:54:51.623842+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:20:08.620180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.623580+0000","last_change":"2024-05-08T10:54:40.015226+0000","last_active":"2024-05-08T10:54:51.623580+0000","last_peered":"2024-05-08T10:54:51.623580+0000","last_clean":"2024-05-08T10:54:51.623580+0000","last_became_active":"2024-05-08T10:54:40.014219+0000","last_became_peered":"2024-05-08T10:54:40.014219+0000","last_unstale":"2024-05-08T10:54:51.623580+0000","last_undegraded":"2024-05-08T10:54:51.623580+0000","last_fullsized":"2024-05-08T10:54:51.623580+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:38.989328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:38.989328+0000","last_clean_scrub_stamp":"2024-05-08T10:54:38.989328+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:10:59.668786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.271967+0000","last_change":"2024-05-08T10:54:49.534493+0000","last_active":"2024-05-08T10:54:53.271967+0000","last_peered":"2024-05-08T10:54:53.271967+0000","last_clean":"2024-05-08T10:54:53.271967+0000","last_became_active":"2024-05-08T10:54:49.533772+0000","last_became_peered":"2024-05-08T10:54:49.533772+0000","last_unstale":"2024-05-08T10:54:53.271967+0000","last_undegraded":"2024-05-08T10:54:53.271967+0000","last_fullsized":"2024-05-08T10:54:53.271967+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:41:42.237766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272465+0000","last_change":"2024-05-08T10:54:50.553323+0000","last_active":"2024-05-08T10:54:53.272465+0000","last_peered":"2024-05-08T10:54:53.272465+0000","last_clean":"2024-05-08T10:54:53.272465+0000","last_became_active":"2024-05-08T10:54:50.553046+0000","last_became_peered":"2024-05-08T10:54:50.553046+0000","last_unstale":"2024-05-08T10:54:53.272465+0000","last_undegraded":"2024-05-08T10:54:53.272465+0000","last_fullsized":"2024-05-08T10:54:53.272465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:26:24.924440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.623468+0000","last_change":"2024-05-08T10:54:49.537291+0000","last_active":"2024-05-08T10:54:51.623468+0000","last_peered":"2024-05-08T10:54:51.623468+0000","last_clean":"2024-05-08T10:54:51.623468+0000","last_became_active":"2024-05-08T10:54:49.537026+0000","last_became_peered":"2024-05-08T10:54:49.537026+0000","last_unstale":"2024-05-08T10:54:51.623468+0000","last_undegraded":"2024-05-08T10:54:51.623468+0000","last_fullsized":"2024-05-08T10:54:51.623468+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:35:21.510783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.271682+0000","last_change":"2024-05-08T10:54:50.536808+0000","last_active":"2024-05-08T10:54:53.271682+0000","last_peered":"2024-05-08T10:54:53.271682+0000","last_clean":"2024-05-08T10:54:53.271682+0000","last_became_active":"2024-05-08T10:54:50.536502+0000","last_became_peered":"2024-05-08T10:54:50.536502+0000","last_unstale":"2024-05-08T10:54:53.271682+0000","last_undegraded":"2024-05-08T10:54:53.271682+0000","last_fullsized":"2024-05-08T10:54:53.271682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:08:05.567837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:52.206181+0000","last_change":"2024-05-08T10:54:49.536613+0000","last_active":"2024-05-08T10:54:52.206181+0000","last_peered":"2024-05-08T10:54:52.206181+0000","last_clean":"2024-05-08T10:54:52.206181+0000","last_became_active":"2024-05-08T10:54:49.536290+0000","last_became_peered":"2024-05-08T10:54:49.536290+0000","last_unstale":"2024-05-08T10:54:52.206181+0000","last_undegraded":"2024-05-08T10:54:52.206181+0000","last_fullsized":"2024-05-08T10:54:52.206181+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:50:17.425844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.536784+0000","last_change":"2024-05-08T10:54:50.539387+0000","last_active":"2024-05-08T10:54:51.536784+0000","last_peered":"2024-05-08T10:54:51.536784+0000","last_clean":"2024-05-08T10:54:51.536784+0000","last_became_active":"2024-05-08T10:54:50.539070+0000","last_became_peered":"2024-05-08T10:54:50.539070+0000","last_unstale":"2024-05-08T10:54:51.536784+0000","last_undegraded":"2024-05-08T10:54:51.536784+0000","last_fullsized":"2024-05-08T10:54:51.536784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:12:04.365598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272501+0000","last_change":"2024-05-08T10:54:49.537472+0000","last_active":"2024-05-08T10:54:53.272501+0000","last_peered":"2024-05-08T10:54:53.272501+0000","last_clean":"2024-05-08T10:54:53.272501+0000","last_became_active":"2024-05-08T10:54:49.537140+0000","last_became_peered":"2024-05-08T10:54:49.537140+0000","last_unstale":"2024-05-08T10:54:53.272501+0000","last_undegraded":"2024-05-08T10:54:53.272501+0000","last_fullsized":"2024-05-08T10:54:53.272501+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:00:52.746134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.539458+0000","last_change":"2024-05-08T10:54:50.540453+0000","last_active":"2024-05-08T10:54:51.539458+0000","last_peered":"2024-05-08T10:54:51.539458+0000","last_clean":"2024-05-08T10:54:51.539458+0000","last_became_active":"2024-05-08T10:54:50.540200+0000","last_became_peered":"2024-05-08T10:54:50.540200+0000","last_unstale":"2024-05-08T10:54:51.539458+0000","last_undegraded":"2024-05-08T10:54:51.539458+0000","last_fullsized":"2024-05-08T10:54:51.539458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:40:17.329748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.536732+0000","last_change":"2024-05-08T10:54:49.536666+0000","last_active":"2024-05-08T10:54:51.536732+0000","last_peered":"2024-05-08T10:54:51.536732+0000","last_clean":"2024-05-08T10:54:51.536732+0000","last_became_active":"2024-05-08T10:54:49.536210+0000","last_became_peered":"2024-05-08T10:54:49.536210+0000","last_unstale":"2024-05-08T10:54:51.536732+0000","last_undegraded":"2024-05-08T10:54:51.536732+0000","last_fullsized":"2024-05-08T10:54:51.536732+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:07:12.581426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272494+0000","last_change":"2024-05-08T10:54:50.549051+0000","last_active":"2024-05-08T10:54:53.272494+0000","last_peered":"2024-05-08T10:54:53.272494+0000","last_clean":"2024-05-08T10:54:53.272494+0000","last_became_active":"2024-05-08T10:54:50.548723+0000","last_became_peered":"2024-05-08T10:54:50.548723+0000","last_unstale":"2024-05-08T10:54:53.272494+0000","last_undegraded":"2024-05-08T10:54:53.272494+0000","last_fullsized":"2024-05-08T10:54:53.272494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:41:02.815763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.624047+0000","last_change":"2024-05-08T10:54:49.538497+0000","last_active":"2024-05-08T10:54:51.624047+0000","last_peered":"2024-05-08T10:54:51.624047+0000","last_clean":"2024-05-08T10:54:51.624047+0000","last_became_active":"2024-05-08T10:54:49.537819+0000","last_became_peered":"2024-05-08T10:54:49.537819+0000","last_unstale":"2024-05-08T10:54:51.624047+0000","last_undegraded":"2024-05-08T10:54:51.624047+0000","last_fullsized":"2024-05-08T10:54:51.624047+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:31:54.768524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.536801+0000","last_change":"2024-05-08T10:54:50.533885+0000","last_active":"2024-05-08T10:54:51.536801+0000","last_peered":"2024-05-08T10:54:51.536801+0000","last_clean":"2024-05-08T10:54:51.536801+0000","last_became_active":"2024-05-08T10:54:50.533569+0000","last_became_peered":"2024-05-08T10:54:50.533569+0000","last_unstale":"2024-05-08T10:54:51.536801+0000","last_undegraded":"2024-05-08T10:54:51.536801+0000","last_fullsized":"2024-05-08T10:54:51.536801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:43:52.788984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.536965+0000","last_change":"2024-05-08T10:54:49.533336+0000","last_active":"2024-05-08T10:54:51.536965+0000","last_peered":"2024-05-08T10:54:51.536965+0000","last_clean":"2024-05-08T10:54:51.536965+0000","last_became_active":"2024-05-08T10:54:49.533024+0000","last_became_peered":"2024-05-08T10:54:49.533024+0000","last_unstale":"2024-05-08T10:54:51.536965+0000","last_undegraded":"2024-05-08T10:54:51.536965+0000","last_fullsized":"2024-05-08T10:54:51.536965+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:04:27.826613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272492+0000","last_change":"2024-05-08T10:54:50.544364+0000","last_active":"2024-05-08T10:54:53.272492+0000","last_peered":"2024-05-08T10:54:53.272492+0000","last_clean":"2024-05-08T10:54:53.272492+0000","last_became_active":"2024-05-08T10:54:50.544015+0000","last_became_peered":"2024-05-08T10:54:50.544015+0000","last_unstale":"2024-05-08T10:54:53.272492+0000","last_undegraded":"2024-05-08T10:54:53.272492+0000","last_fullsized":"2024-05-08T10:54:53.272492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:34:17.184122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.538820+0000","last_change":"2024-05-08T10:54:49.538628+0000","last_active":"2024-05-08T10:54:51.538820+0000","last_peered":"2024-05-08T10:54:51.538820+0000","last_clean":"2024-05-08T10:54:51.538820+0000","last_became_active":"2024-05-08T10:54:49.538328+0000","last_became_peered":"2024-05-08T10:54:49.538328+0000","last_unstale":"2024-05-08T10:54:51.538820+0000","last_undegraded":"2024-05-08T10:54:51.538820+0000","last_fullsized":"2024-05-08T10:54:51.538820+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:04:27.826613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272243+0000","last_change":"2024-05-08T10:54:50.542376+0000","last_active":"2024-05-08T10:54:53.272243+0000","last_peered":"2024-05-08T10:54:53.272243+0000","last_clean":"2024-05-08T10:54:53.272243+0000","last_became_active":"2024-05-08T10:54:50.541231+0000","last_became_peered":"2024-05-08T10:54:50.541231+0000","last_unstale":"2024-05-08T10:54:53.272243+0000","last_undegraded":"2024-05-08T10:54:53.272243+0000","last_fullsized":"2024-05-08T10:54:53.272243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:43:52.788984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.623466+0000","last_change":"2024-05-08T10:54:49.538203+0000","last_active":"2024-05-08T10:54:51.623466+0000","last_peered":"2024-05-08T10:54:51.623466+0000","last_clean":"2024-05-08T10:54:51.623466+0000","last_became_active":"2024-05-08T10:54:49.537722+0000","last_became_peered":"2024-05-08T10:54:49.537722+0000","last_unstale":"2024-05-08T10:54:51.623466+0000","last_undegraded":"2024-05-08T10:54:51.623466+0000","last_fullsized":"2024-05-08T10:54:51.623466+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:07:12.581426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.539252+0000","last_change":"2024-05-08T10:54:50.535043+0000","last_active":"2024-05-08T10:54:51.539252+0000","last_peered":"2024-05-08T10:54:51.539252+0000","last_clean":"2024-05-08T10:54:51.539252+0000","last_became_active":"2024-05-08T10:54:50.534704+0000","last_became_peered":"2024-05-08T10:54:50.534704+0000","last_unstale":"2024-05-08T10:54:51.539252+0000","last_undegraded":"2024-05-08T10:54:51.539252+0000","last_fullsized":"2024-05-08T10:54:51.539252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:35:22.518469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.536641+0000","last_change":"2024-05-08T10:54:49.537497+0000","last_active":"2024-05-08T10:54:51.536641+0000","last_peered":"2024-05-08T10:54:51.536641+0000","last_clean":"2024-05-08T10:54:51.536641+0000","last_became_active":"2024-05-08T10:54:49.537216+0000","last_became_peered":"2024-05-08T10:54:49.537216+0000","last_unstale":"2024-05-08T10:54:51.536641+0000","last_undegraded":"2024-05-08T10:54:51.536641+0000","last_fullsized":"2024-05-08T10:54:51.536641+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:41:42.237766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272547+0000","last_change":"2024-05-08T10:54:50.544550+0000","last_active":"2024-05-08T10:54:53.272547+0000","last_peered":"2024-05-08T10:54:53.272547+0000","last_clean":"2024-05-08T10:54:53.272547+0000","last_became_active":"2024-05-08T10:54:50.544247+0000","last_became_peered":"2024-05-08T10:54:50.544247+0000","last_unstale":"2024-05-08T10:54:53.272547+0000","last_undegraded":"2024-05-08T10:54:53.272547+0000","last_fullsized":"2024-05-08T10:54:53.272547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:14:08.876280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.536662+0000","last_change":"2024-05-08T10:54:49.537032+0000","last_active":"2024-05-08T10:54:51.536662+0000","last_peered":"2024-05-08T10:54:51.536662+0000","last_clean":"2024-05-08T10:54:51.536662+0000","last_became_active":"2024-05-08T10:54:49.536742+0000","last_became_peered":"2024-05-08T10:54:49.536742+0000","last_unstale":"2024-05-08T10:54:51.536662+0000","last_undegraded":"2024-05-08T10:54:51.536662+0000","last_fullsized":"2024-05-08T10:54:51.536662+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:35:21.510783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272404+0000","last_change":"2024-05-08T10:54:50.551614+0000","last_active":"2024-05-08T10:54:53.272404+0000","last_peered":"2024-05-08T10:54:53.272404+0000","last_clean":"2024-05-08T10:54:53.272404+0000","last_became_active":"2024-05-08T10:54:50.551296+0000","last_became_peered":"2024-05-08T10:54:50.551296+0000","last_unstale":"2024-05-08T10:54:53.272404+0000","last_undegraded":"2024-05-08T10:54:53.272404+0000","last_fullsized":"2024-05-08T10:54:53.272404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:40:14.037116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.623924+0000","last_change":"2024-05-08T10:54:49.538259+0000","last_active":"2024-05-08T10:54:51.623924+0000","last_peered":"2024-05-08T10:54:51.623924+0000","last_clean":"2024-05-08T10:54:51.623924+0000","last_became_active":"2024-05-08T10:54:49.537732+0000","last_became_peered":"2024-05-08T10:54:49.537732+0000","last_unstale":"2024-05-08T10:54:51.623924+0000","last_undegraded":"2024-05-08T10:54:51.623924+0000","last_fullsized":"2024-05-08T10:54:51.623924+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:40:16.322062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.539024+0000","last_change":"2024-05-08T10:54:50.533790+0000","last_active":"2024-05-08T10:54:51.539024+0000","last_peered":"2024-05-08T10:54:51.539024+0000","last_clean":"2024-05-08T10:54:51.539024+0000","last_became_active":"2024-05-08T10:54:50.533500+0000","last_became_peered":"2024-05-08T10:54:50.533500+0000","last_unstale":"2024-05-08T10:54:51.539024+0000","last_undegraded":"2024-05-08T10:54:51.539024+0000","last_fullsized":"2024-05-08T10:54:51.539024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:43:52.788984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272457+0000","last_change":"2024-05-08T10:54:50.538173+0000","last_active":"2024-05-08T10:54:53.272457+0000","last_peered":"2024-05-08T10:54:53.272457+0000","last_clean":"2024-05-08T10:54:53.272457+0000","last_became_active":"2024-05-08T10:54:50.537276+0000","last_became_peered":"2024-05-08T10:54:50.537276+0000","last_unstale":"2024-05-08T10:54:53.272457+0000","last_undegraded":"2024-05-08T10:54:53.272457+0000","last_fullsized":"2024-05-08T10:54:53.272457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:28:49.416807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.623659+0000","last_change":"2024-05-08T10:54:49.537236+0000","last_active":"2024-05-08T10:54:51.623659+0000","last_peered":"2024-05-08T10:54:51.623659+0000","last_clean":"2024-05-08T10:54:51.623659+0000","last_became_active":"2024-05-08T10:54:49.536918+0000","last_became_peered":"2024-05-08T10:54:49.536918+0000","last_unstale":"2024-05-08T10:54:51.623659+0000","last_undegraded":"2024-05-08T10:54:51.623659+0000","last_fullsized":"2024-05-08T10:54:51.623659+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:00:52.746134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272163+0000","last_change":"2024-05-08T10:54:50.544921+0000","last_active":"2024-05-08T10:54:53.272163+0000","last_peered":"2024-05-08T10:54:53.272163+0000","last_clean":"2024-05-08T10:54:53.272163+0000","last_became_active":"2024-05-08T10:54:50.544572+0000","last_became_peered":"2024-05-08T10:54:50.544572+0000","last_unstale":"2024-05-08T10:54:53.272163+0000","last_undegraded":"2024-05-08T10:54:53.272163+0000","last_fullsized":"2024-05-08T10:54:53.272163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:26:24.924440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.623924+0000","last_change":"2024-05-08T10:54:49.538621+0000","last_active":"2024-05-08T10:54:51.623924+0000","last_peered":"2024-05-08T10:54:51.623924+0000","last_clean":"2024-05-08T10:54:51.623924+0000","last_became_active":"2024-05-08T10:54:49.537823+0000","last_became_peered":"2024-05-08T10:54:49.537823+0000","last_unstale":"2024-05-08T10:54:51.623924+0000","last_undegraded":"2024-05-08T10:54:51.623924+0000","last_fullsized":"2024-05-08T10:54:51.623924+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:05.980282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272301+0000","last_change":"2024-05-08T10:54:50.548758+0000","last_active":"2024-05-08T10:54:53.272301+0000","last_peered":"2024-05-08T10:54:53.272301+0000","last_clean":"2024-05-08T10:54:53.272301+0000","last_became_active":"2024-05-08T10:54:50.548012+0000","last_became_peered":"2024-05-08T10:54:50.548012+0000","last_unstale":"2024-05-08T10:54:53.272301+0000","last_undegraded":"2024-05-08T10:54:53.272301+0000","last_fullsized":"2024-05-08T10:54:53.272301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:27:46.730550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272385+0000","last_change":"2024-05-08T10:54:49.537987+0000","last_active":"2024-05-08T10:54:53.272385+0000","last_peered":"2024-05-08T10:54:53.272385+0000","last_clean":"2024-05-08T10:54:53.272385+0000","last_became_active":"2024-05-08T10:54:49.537700+0000","last_became_peered":"2024-05-08T10:54:49.537700+0000","last_unstale":"2024-05-08T10:54:53.272385+0000","last_undegraded":"2024-05-08T10:54:53.272385+0000","last_fullsized":"2024-05-08T10:54:53.272385+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:04:27.826613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272245+0000","last_change":"2024-05-08T10:54:50.545275+0000","last_active":"2024-05-08T10:54:53.272245+0000","last_peered":"2024-05-08T10:54:53.272245+0000","last_clean":"2024-05-08T10:54:53.272245+0000","last_became_active":"2024-05-08T10:54:50.544915+0000","last_became_peered":"2024-05-08T10:54:50.544915+0000","last_unstale":"2024-05-08T10:54:53.272245+0000","last_undegraded":"2024-05-08T10:54:53.272245+0000","last_fullsized":"2024-05-08T10:54:53.272245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:12:04.365598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272568+0000","last_change":"2024-05-08T10:54:49.540467+0000","last_active":"2024-05-08T10:54:53.272568+0000","last_peered":"2024-05-08T10:54:53.272568+0000","last_clean":"2024-05-08T10:54:53.272568+0000","last_became_active":"2024-05-08T10:54:49.540032+0000","last_became_peered":"2024-05-08T10:54:49.540032+0000","last_unstale":"2024-05-08T10:54:53.272568+0000","last_undegraded":"2024-05-08T10:54:53.272568+0000","last_fullsized":"2024-05-08T10:54:53.272568+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:21:53.697233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":661884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":64724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":71060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":798720,"data_stored":655640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T10:54:55.243 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-05-08T10:54:55.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.385+0000 7fdb8d590640 1 Processor -- start 2024-05-08T10:54:55.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.385+0000 7fdb8d590640 1 -- start start 2024-05-08T10:54:55.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.386+0000 7fdb8d590640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fdb8806ef70 0x7fdb8806bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:55.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.386+0000 7fdb8d590640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fdb8806c0f0 0x7fdb8806d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:55.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.386+0000 7fdb8d590640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb8815ae90 con 0x7fdb8815aab0 2024-05-08T10:54:55.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.386+0000 7fdb8d590640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb880cfd00 con 0x7fdb8806c0f0 2024-05-08T10:54:55.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.386+0000 7fdb8d590640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb880cf460 con 0x7fdb8806ef70 2024-05-08T10:54:55.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.386+0000 7fdb877fe640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fdb8806c0f0 0x7fdb8806d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:55.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.386+0000 7fdb877fe640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fdb8806c0f0 0x7fdb8806d270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46562/0 (socket says 172.21.15.33:46562) 2024-05-08T10:54:55.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.386+0000 7fdb877fe640 1 -- 172.21.15.33:0/3859764431 learned_addr learned my addr 172.21.15.33:0/3859764431 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:54:55.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.387+0000 7fdb867fc640 1 --2- 172.21.15.33:0/3859764431 >> v2:172.21.15.174:3300/0 conn(0x7fdb8806ef70 0x7fdb8806bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:55.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.387+0000 7fdb877fe640 1 -- 172.21.15.33:0/3859764431 >> v2:172.21.15.174:3300/0 conn(0x7fdb8806ef70 msgr2=0x7fdb8806bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:54:55.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.387+0000 7fdb877fe640 1 --2- 172.21.15.33:0/3859764431 >> v2:172.21.15.174:3300/0 conn(0x7fdb8806ef70 0x7fdb8806bbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:55.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.387+0000 7fdb877fe640 1 -- 172.21.15.33:0/3859764431 >> v1:172.21.15.174:6789/0 conn(0x7fdb8815aab0 legacy=0x7fdb880cec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:54:55.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.387+0000 7fdb877fe640 1 -- 172.21.15.33:0/3859764431 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb880cf740 con 0x7fdb8806c0f0 2024-05-08T10:54:55.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.387+0000 7fdb877fe640 1 --2- 172.21.15.33:0/3859764431 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb8806c0f0 0x7fdb8806d270 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fdb880cff70 tx=0x7fdb7802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3a82b0cbca7825b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:54:55.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.388+0000 7fdb85ffb640 1 -- 172.21.15.33:0/3859764431 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb78037070 con 0x7fdb8806c0f0 2024-05-08T10:54:55.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.388+0000 7fdb85ffb640 1 -- 172.21.15.33:0/3859764431 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb78032440 con 0x7fdb8806c0f0 2024-05-08T10:54:55.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.388+0000 7fdb85ffb640 1 -- 172.21.15.33:0/3859764431 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb78032810 con 0x7fdb8806c0f0 2024-05-08T10:54:55.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.388+0000 7fdb8d590640 1 -- 172.21.15.33:0/3859764431 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb8806c0f0 msgr2=0x7fdb8806d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:55.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.388+0000 7fdb8d590640 1 --2- 172.21.15.33:0/3859764431 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb8806c0f0 0x7fdb8806d270 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fdb880cff70 tx=0x7fdb7802a1a0 comp rx=0 tx=0).stop 2024-05-08T10:54:55.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.388+0000 7fdb8d590640 1 -- 172.21.15.33:0/3859764431 shutdown_connections 2024-05-08T10:54:55.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.388+0000 7fdb8d590640 1 --2- 172.21.15.33:0/3859764431 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb8806c0f0 0x7fdb8806d270 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:55.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.388+0000 7fdb8d590640 1 --2- 172.21.15.33:0/3859764431 >> v2:172.21.15.174:3300/0 conn(0x7fdb8806ef70 0x7fdb8806bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:55.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.388+0000 7fdb8d590640 1 -- 172.21.15.33:0/3859764431 >> 172.21.15.33:0/3859764431 conn(0x7fdb880b1a90 msgr2=0x7fdb880b1ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:54:55.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.388+0000 7fdb8d590640 1 -- 172.21.15.33:0/3859764431 shutdown_connections 2024-05-08T10:54:55.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.388+0000 7fdb8d590640 1 -- 172.21.15.33:0/3859764431 wait complete. 2024-05-08T10:54:55.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.389+0000 7fdb8d590640 1 Processor -- start 2024-05-08T10:54:55.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.390+0000 7fdb8d590640 1 -- start start 2024-05-08T10:54:55.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.390+0000 7fdb8d590640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdb8806c0f0 0x7fdb88159a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:55.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.390+0000 7fdb8d590640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdb8806ef70 0x7fdb881e4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:55.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.390+0000 7fdb8d590640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb8815aab0 0x7fdb880c5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:55.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.390+0000 7fdb8d590640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb8806d7b0 con 0x7fdb8815aab0 2024-05-08T10:54:55.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.390+0000 7fdb8d590640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb8806cd50 con 0x7fdb8806c0f0 2024-05-08T10:54:55.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.390+0000 7fdb8d590640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb8806d930 con 0x7fdb8806ef70 2024-05-08T10:54:55.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.390+0000 7fdb877fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb8815aab0 0x7fdb880c5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:55.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.390+0000 7fdb877fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb8815aab0 0x7fdb880c5060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46574/0 (socket says 172.21.15.33:46574) 2024-05-08T10:54:55.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.390+0000 7fdb877fe640 1 -- 172.21.15.33:0/319125232 learned_addr learned my addr 172.21.15.33:0/319125232 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:54:55.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.391+0000 7fdb86ffd640 1 --2- 172.21.15.33:0/319125232 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdb8806c0f0 0x7fdb88159a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:55.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.391+0000 7fdb867fc640 1 --2- 172.21.15.33:0/319125232 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdb8806ef70 0x7fdb881e4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:55.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.391+0000 7fdb877fe640 1 -- 172.21.15.33:0/319125232 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdb8806ef70 msgr2=0x7fdb881e4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:55.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.391+0000 7fdb877fe640 1 --2- 172.21.15.33:0/319125232 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdb8806ef70 0x7fdb881e4370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:55.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.391+0000 7fdb877fe640 1 -- 172.21.15.33:0/319125232 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdb8806c0f0 msgr2=0x7fdb88159a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:55.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.391+0000 7fdb877fe640 1 --2- 172.21.15.33:0/319125232 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdb8806c0f0 0x7fdb88159a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:55.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.391+0000 7fdb877fe640 1 -- 172.21.15.33:0/319125232 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb881e48b0 con 0x7fdb8815aab0 2024-05-08T10:54:55.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.391+0000 7fdb86ffd640 1 --2- 172.21.15.33:0/319125232 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdb8806c0f0 0x7fdb88159a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:54:55.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.391+0000 7fdb867fc640 1 --2- 172.21.15.33:0/319125232 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdb8806ef70 0x7fdb881e4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:54:55.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.391+0000 7fdb877fe640 1 --2- 172.21.15.33:0/319125232 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb8815aab0 0x7fdb880c5060 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fdb780090b0 tx=0x7fdb780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:54:55.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.391+0000 7fdb7f7fe640 1 -- 172.21.15.33:0/319125232 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb78041070 con 0x7fdb8815aab0 2024-05-08T10:54:55.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.391+0000 7fdb7f7fe640 1 -- 172.21.15.33:0/319125232 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb7803c950 con 0x7fdb8815aab0 2024-05-08T10:54:55.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.391+0000 7fdb8d590640 1 -- 172.21.15.33:0/319125232 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb880c5fa0 con 0x7fdb8815aab0 2024-05-08T10:54:55.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.391+0000 7fdb7f7fe640 1 -- 172.21.15.33:0/319125232 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb78037040 con 0x7fdb8815aab0 2024-05-08T10:54:55.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.391+0000 7fdb8d590640 1 -- 172.21.15.33:0/319125232 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb880c6560 con 0x7fdb8815aab0 2024-05-08T10:54:55.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.392+0000 7fdb8d590640 1 -- 172.21.15.33:0/319125232 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb88072870 con 0x7fdb8815aab0 2024-05-08T10:54:55.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.393+0000 7fdb7f7fe640 1 -- 172.21.15.33:0/319125232 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fdb78044070 con 0x7fdb8815aab0 2024-05-08T10:54:55.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.393+0000 7fdb7f7fe640 1 --2- 172.21.15.33:0/319125232 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fdb6806b4d0 0x7fdb6806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:55.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.393+0000 7fdb7f7fe640 1 -- 172.21.15.33:0/319125232 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdb780aae30 con 0x7fdb8815aab0 2024-05-08T10:54:55.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.393+0000 7fdb86ffd640 1 --2- 172.21.15.33:0/319125232 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fdb6806b4d0 0x7fdb6806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:55.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.394+0000 7fdb86ffd640 1 --2- 172.21.15.33:0/319125232 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fdb6806b4d0 0x7fdb6806d990 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdb80007eb0 tx=0x7fdb800073c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:54:55.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.397+0000 7fdb7f7fe640 1 -- 172.21.15.33:0/319125232 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fdb88072870 con 0x7fdb8815aab0 2024-05-08T10:54:55.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.649+0000 7fdb8d590640 1 -- 172.21.15.33:0/319125232 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fdb88069d20 con 0x7fdb8815aab0 2024-05-08T10:54:55.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.649+0000 7fdb7f7fe640 1 -- 172.21.15.33:0/319125232 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1011 (secure 0 0 0) 0x7fdb78079e60 con 0x7fdb8815aab0 2024-05-08T10:54:55.647 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:54:55.647 INFO:teuthology.orchestra.run.smithi033.stdout:{"fsid":"963217b2-c375-4f5a-95cf-88e199dd38ff","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":28,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":20,"num_osds":8,"num_up_osds":8,"osd_up_since":1715165677,"num_in_osds":8,"osd_in_since":1715165668,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592778,"bytes_used":224223232,"bytes_avail":772869890048,"bytes_total":773094113280,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":7,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"b","status":"up:active","gid":4279}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-05-08T10:54:26.712627+0000","services":{}},"progress_events":{}} 2024-05-08T10:54:55.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.651+0000 7fdb8d590640 1 -- 172.21.15.33:0/319125232 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fdb6806b4d0 msgr2=0x7fdb6806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:55.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.651+0000 7fdb8d590640 1 --2- 172.21.15.33:0/319125232 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fdb6806b4d0 0x7fdb6806d990 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdb80007eb0 tx=0x7fdb800073c0 comp rx=0 tx=0).stop 2024-05-08T10:54:55.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.651+0000 7fdb8d590640 1 -- 172.21.15.33:0/319125232 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb8815aab0 msgr2=0x7fdb880c5060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:55.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.651+0000 7fdb8d590640 1 --2- 172.21.15.33:0/319125232 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb8815aab0 0x7fdb880c5060 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fdb780090b0 tx=0x7fdb780046c0 comp rx=0 tx=0).stop 2024-05-08T10:54:55.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.651+0000 7fdb8d590640 1 -- 172.21.15.33:0/319125232 shutdown_connections 2024-05-08T10:54:55.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.651+0000 7fdb8d590640 1 --2- 172.21.15.33:0/319125232 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fdb6806b4d0 0x7fdb6806d990 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:55.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.651+0000 7fdb8d590640 1 --2- 172.21.15.33:0/319125232 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb8815aab0 0x7fdb880c5060 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:55.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.651+0000 7fdb8d590640 1 --2- 172.21.15.33:0/319125232 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdb8806ef70 0x7fdb881e4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:55.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.651+0000 7fdb8d590640 1 --2- 172.21.15.33:0/319125232 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdb8806c0f0 0x7fdb88159a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:55.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.651+0000 7fdb8d590640 1 -- 172.21.15.33:0/319125232 >> 172.21.15.33:0/319125232 conn(0x7fdb880b1a90 msgr2=0x7fdb8806aba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:54:55.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.652+0000 7fdb8d590640 1 -- 172.21.15.33:0/319125232 shutdown_connections 2024-05-08T10:54:55.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.652+0000 7fdb8d590640 1 -- 172.21.15.33:0/319125232 wait complete. 2024-05-08T10:54:55.659 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-05-08T10:54:55.659 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T10:54:55.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.766+0000 7fb178d0a640 1 Processor -- start 2024-05-08T10:54:55.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.766+0000 7fb178d0a640 1 -- start start 2024-05-08T10:54:55.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.767+0000 7fb178d0a640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fb1741613a0 0x7fb1740d17e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:55.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.767+0000 7fb178d0a640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1740d1e10 0x7fb1740d2220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:55.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.767+0000 7fb178d0a640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1740d2760 con 0x7fb1740d4960 2024-05-08T10:54:55.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.767+0000 7fb178d0a640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1740cf010 con 0x7fb1741613a0 2024-05-08T10:54:55.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.767+0000 7fb178d0a640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1740ce720 con 0x7fb1740d1e10 2024-05-08T10:54:55.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.767+0000 7fb17259c640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fb1741613a0 0x7fb1740d17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:55.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.767+0000 7fb17259c640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fb1741613a0 0x7fb1740d17e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37392/0 (socket says 172.21.15.33:37392) 2024-05-08T10:54:55.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.767+0000 7fb171d9b640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fb1740d4960 0x7fb1740cf4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:43482/0 (socket says 172.21.15.33:43482) 2024-05-08T10:54:55.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.767+0000 7fb17259c640 1 -- 172.21.15.33:0/3667126371 learned_addr learned my addr 172.21.15.33:0/3667126371 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:54:55.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.768+0000 7fb17259c640 1 -- 172.21.15.33:0/3667126371 >> v2:172.21.15.174:3300/0 conn(0x7fb1740d1e10 msgr2=0x7fb1740d2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:54:55.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.768+0000 7fb172d9d640 1 --2- 172.21.15.33:0/3667126371 >> v2:172.21.15.174:3300/0 conn(0x7fb1740d1e10 0x7fb1740d2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:55.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.768+0000 7fb17159a640 1 -- 172.21.15.33:0/3667126371 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1060500184 0 0) 0x7fb168001110 con 0x7fb1740d4960 2024-05-08T10:54:55.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.768+0000 7fb17259c640 1 --2- 172.21.15.33:0/3667126371 >> v2:172.21.15.174:3300/0 conn(0x7fb1740d1e10 0x7fb1740d2220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:55.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.768+0000 7fb17259c640 1 -- 172.21.15.33:0/3667126371 >> v1:172.21.15.33:6789/0 conn(0x7fb1740d4960 legacy=0x7fb1740cf4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:55.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.768+0000 7fb17259c640 1 -- 172.21.15.33:0/3667126371 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1740d12d0 con 0x7fb1741613a0 2024-05-08T10:54:55.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.768+0000 7fb17259c640 1 --2- 172.21.15.33:0/3667126371 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1741613a0 0x7fb1740d17e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb1740cac70 tx=0x7fb16402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=857822490e47988d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:54:55.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.768+0000 7fb17159a640 1 -- 172.21.15.33:0/3667126371 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb164037070 con 0x7fb1741613a0 2024-05-08T10:54:55.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.768+0000 7fb17159a640 1 -- 172.21.15.33:0/3667126371 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb164032440 con 0x7fb1741613a0 2024-05-08T10:54:55.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.768+0000 7fb17159a640 1 -- 172.21.15.33:0/3667126371 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb164032810 con 0x7fb1741613a0 2024-05-08T10:54:55.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.769+0000 7fb178d0a640 1 -- 172.21.15.33:0/3667126371 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1741613a0 msgr2=0x7fb1740d17e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:55.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.769+0000 7fb178d0a640 1 --2- 172.21.15.33:0/3667126371 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1741613a0 0x7fb1740d17e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb1740cac70 tx=0x7fb16402a270 comp rx=0 tx=0).stop 2024-05-08T10:54:55.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.769+0000 7fb178d0a640 1 -- 172.21.15.33:0/3667126371 shutdown_connections 2024-05-08T10:54:55.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.769+0000 7fb178d0a640 1 --2- 172.21.15.33:0/3667126371 >> v2:172.21.15.174:3300/0 conn(0x7fb1740d1e10 0x7fb1740d2220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:55.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.769+0000 7fb178d0a640 1 --2- 172.21.15.33:0/3667126371 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1741613a0 0x7fb1740d17e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:55.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.769+0000 7fb178d0a640 1 -- 172.21.15.33:0/3667126371 >> 172.21.15.33:0/3667126371 conn(0x7fb1740d3c10 msgr2=0x7fb1740d4020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:54:55.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.769+0000 7fb178d0a640 1 -- 172.21.15.33:0/3667126371 shutdown_connections 2024-05-08T10:54:55.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.769+0000 7fb178d0a640 1 -- 172.21.15.33:0/3667126371 wait complete. 2024-05-08T10:54:55.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.770+0000 7fb178d0a640 1 Processor -- start 2024-05-08T10:54:55.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.770+0000 7fb178d0a640 1 -- start start 2024-05-08T10:54:55.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.771+0000 7fb178d0a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1740d1e10 0x7fb1740b91c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:55.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.771+0000 7fb178d0a640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb1740d4960 0x7fb1740c8940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:55.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.771+0000 7fb178d0a640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb1741613a0 0x7fb174157630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:55.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.771+0000 7fb178d0a640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1740cfbb0 con 0x7fb1740d1e10 2024-05-08T10:54:55.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.771+0000 7fb178d0a640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1740ceca0 con 0x7fb1741613a0 2024-05-08T10:54:55.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.771+0000 7fb178d0a640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1740d0f80 con 0x7fb1740d4960 2024-05-08T10:54:55.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.771+0000 7fb17259c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1740d1e10 0x7fb1740b91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:55.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.771+0000 7fb17259c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1740d1e10 0x7fb1740b91c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37398/0 (socket says 172.21.15.33:37398) 2024-05-08T10:54:55.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.771+0000 7fb17259c640 1 -- 172.21.15.33:0/1241561892 learned_addr learned my addr 172.21.15.33:0/1241561892 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:54:55.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.772+0000 7fb17259c640 1 -- 172.21.15.33:0/1241561892 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb1740d4960 msgr2=0x7fb1740c8940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:55.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.772+0000 7fb171d9b640 1 --2- 172.21.15.33:0/1241561892 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb1740d4960 0x7fb1740c8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:55.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.772+0000 7fb172d9d640 1 --2- 172.21.15.33:0/1241561892 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb1741613a0 0x7fb174157630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:55.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.772+0000 7fb17259c640 1 --2- 172.21.15.33:0/1241561892 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb1740d4960 0x7fb1740c8940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:55.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.772+0000 7fb17259c640 1 -- 172.21.15.33:0/1241561892 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb1741613a0 msgr2=0x7fb174157630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:55.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.772+0000 7fb17259c640 1 --2- 172.21.15.33:0/1241561892 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb1741613a0 0x7fb174157630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:55.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.772+0000 7fb17259c640 1 -- 172.21.15.33:0/1241561892 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1740c90b0 con 0x7fb1740d1e10 2024-05-08T10:54:55.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.772+0000 7fb17259c640 1 --2- 172.21.15.33:0/1241561892 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1740d1e10 0x7fb1740b91c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb16402a2b0 tx=0x7fb1640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:54:55.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.772+0000 7fb162ffd640 1 -- 172.21.15.33:0/1241561892 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb164037040 con 0x7fb1740d1e10 2024-05-08T10:54:55.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.772+0000 7fb162ffd640 1 -- 172.21.15.33:0/1241561892 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb164042070 con 0x7fb1740d1e10 2024-05-08T10:54:55.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.772+0000 7fb178d0a640 1 -- 172.21.15.33:0/1241561892 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1740c9390 con 0x7fb1740d1e10 2024-05-08T10:54:55.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.772+0000 7fb162ffd640 1 -- 172.21.15.33:0/1241561892 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb164030bb0 con 0x7fb1740d1e10 2024-05-08T10:54:55.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.772+0000 7fb178d0a640 1 -- 172.21.15.33:0/1241561892 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1740c9950 con 0x7fb1740d1e10 2024-05-08T10:54:55.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.773+0000 7fb178d0a640 1 -- 172.21.15.33:0/1241561892 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb174069d20 con 0x7fb1740d1e10 2024-05-08T10:54:55.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.774+0000 7fb162ffd640 1 -- 172.21.15.33:0/1241561892 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb164047460 con 0x7fb1740d1e10 2024-05-08T10:54:55.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.774+0000 7fb162ffd640 1 --2- 172.21.15.33:0/1241561892 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fb15406b4d0 0x7fb15406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:55.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.774+0000 7fb162ffd640 1 -- 172.21.15.33:0/1241561892 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb1640aadc0 con 0x7fb1740d1e10 2024-05-08T10:54:55.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.774+0000 7fb171d9b640 1 --2- 172.21.15.33:0/1241561892 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fb15406b4d0 0x7fb15406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:55.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.775+0000 7fb171d9b640 1 --2- 172.21.15.33:0/1241561892 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fb15406b4d0 0x7fb15406d990 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb1740b7180 tx=0x7fb168009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:54:55.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.778+0000 7fb162ffd640 1 -- 172.21.15.33:0/1241561892 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb164045360 con 0x7fb1740d1e10 2024-05-08T10:54:55.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.956+0000 7fb178d0a640 1 -- 172.21.15.33:0/1241561892 --> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb17408d980 con 0x7fb15406b4d0 2024-05-08T10:54:55.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.963+0000 7fb162ffd640 1 -- 172.21.15.33:0/1241561892 <== mgr.4103 v2:172.21.15.174:6832/261355069 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251946 (secure 0 0 0) 0x7fb17408d980 con 0x7fb15406b4d0 2024-05-08T10:54:55.964 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:54:55.965 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-05-08T10:54:55.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.965+0000 7fb178d0a640 1 -- 172.21.15.33:0/1241561892 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fb15406b4d0 msgr2=0x7fb15406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:55.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.965+0000 7fb178d0a640 1 --2- 172.21.15.33:0/1241561892 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fb15406b4d0 0x7fb15406d990 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb1740b7180 tx=0x7fb168009040 comp rx=0 tx=0).stop 2024-05-08T10:54:55.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.965+0000 7fb178d0a640 1 -- 172.21.15.33:0/1241561892 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1740d1e10 msgr2=0x7fb1740b91c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:55.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.965+0000 7fb178d0a640 1 --2- 172.21.15.33:0/1241561892 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1740d1e10 0x7fb1740b91c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb16402a2b0 tx=0x7fb1640046c0 comp rx=0 tx=0).stop 2024-05-08T10:54:55.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.965+0000 7fb178d0a640 1 -- 172.21.15.33:0/1241561892 shutdown_connections 2024-05-08T10:54:55.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.965+0000 7fb178d0a640 1 --2- 172.21.15.33:0/1241561892 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fb15406b4d0 0x7fb15406d990 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:55.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.965+0000 7fb178d0a640 1 --2- 172.21.15.33:0/1241561892 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb1741613a0 0x7fb174157630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:55.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.965+0000 7fb178d0a640 1 --2- 172.21.15.33:0/1241561892 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb1740d4960 0x7fb1740c8940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:55.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.965+0000 7fb178d0a640 1 --2- 172.21.15.33:0/1241561892 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1740d1e10 0x7fb1740b91c0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:55.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.965+0000 7fb178d0a640 1 -- 172.21.15.33:0/1241561892 >> 172.21.15.33:0/1241561892 conn(0x7fb1740d3c10 msgr2=0x7fb1740b0940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:54:55.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.965+0000 7fb178d0a640 1 -- 172.21.15.33:0/1241561892 shutdown_connections 2024-05-08T10:54:55.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:55.965+0000 7fb178d0a640 1 -- 172.21.15.33:0/1241561892 wait complete. 2024-05-08T10:54:55.973 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-05-08T10:54:54.945173+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":136,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218968,"kb_used_data":2800,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755752,"statfs":{"total":773094113280,"available":772869890048,"internally_reserved":0,"allocated":2867200,"data_stored":1740428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001369"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.624024+0000","last_change":"2024-05-08T10:54:50.544238+0000","last_active":"2024-05-08T10:54:51.624024+0000","last_peered":"2024-05-08T10:54:51.624024+0000","last_clean":"2024-05-08T10:54:51.624024+0000","last_became_active":"2024-05-08T10:54:50.543590+0000","last_became_peered":"2024-05-08T10:54:50.543590+0000","last_unstale":"2024-05-08T10:54:51.624024+0000","last_undegraded":"2024-05-08T10:54:51.624024+0000","last_fullsized":"2024-05-08T10:54:51.624024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:17:53.754154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.537034+0000","last_change":"2024-05-08T10:54:50.544605+0000","last_active":"2024-05-08T10:54:51.537034+0000","last_peered":"2024-05-08T10:54:51.537034+0000","last_clean":"2024-05-08T10:54:51.537034+0000","last_became_active":"2024-05-08T10:54:50.543971+0000","last_became_peered":"2024-05-08T10:54:50.543971+0000","last_unstale":"2024-05-08T10:54:51.537034+0000","last_undegraded":"2024-05-08T10:54:51.537034+0000","last_fullsized":"2024-05-08T10:54:51.537034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:17:39.617660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272018+0000","last_change":"2024-05-08T10:54:50.541546+0000","last_active":"2024-05-08T10:54:53.272018+0000","last_peered":"2024-05-08T10:54:53.272018+0000","last_clean":"2024-05-08T10:54:53.272018+0000","last_became_active":"2024-05-08T10:54:50.540512+0000","last_became_peered":"2024-05-08T10:54:50.540512+0000","last_unstale":"2024-05-08T10:54:53.272018+0000","last_undegraded":"2024-05-08T10:54:53.272018+0000","last_fullsized":"2024-05-08T10:54:53.272018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:06:27.967756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272230+0000","last_change":"2024-05-08T10:54:50.550769+0000","last_active":"2024-05-08T10:54:53.272230+0000","last_peered":"2024-05-08T10:54:53.272230+0000","last_clean":"2024-05-08T10:54:53.272230+0000","last_became_active":"2024-05-08T10:54:50.550414+0000","last_became_peered":"2024-05-08T10:54:50.550414+0000","last_unstale":"2024-05-08T10:54:53.272230+0000","last_undegraded":"2024-05-08T10:54:53.272230+0000","last_fullsized":"2024-05-08T10:54:53.272230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:34:17.184122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.623876+0000","last_change":"2024-05-08T10:54:50.540125+0000","last_active":"2024-05-08T10:54:51.623876+0000","last_peered":"2024-05-08T10:54:51.623876+0000","last_clean":"2024-05-08T10:54:51.623876+0000","last_became_active":"2024-05-08T10:54:50.539796+0000","last_became_peered":"2024-05-08T10:54:50.539796+0000","last_unstale":"2024-05-08T10:54:51.623876+0000","last_undegraded":"2024-05-08T10:54:51.623876+0000","last_fullsized":"2024-05-08T10:54:51.623876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:28:49.416807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272082+0000","last_change":"2024-05-08T10:54:50.550911+0000","last_active":"2024-05-08T10:54:53.272082+0000","last_peered":"2024-05-08T10:54:53.272082+0000","last_clean":"2024-05-08T10:54:53.272082+0000","last_became_active":"2024-05-08T10:54:50.550594+0000","last_became_peered":"2024-05-08T10:54:50.550594+0000","last_unstale":"2024-05-08T10:54:53.272082+0000","last_undegraded":"2024-05-08T10:54:53.272082+0000","last_fullsized":"2024-05-08T10:54:53.272082+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:27:46.730550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.623675+0000","last_change":"2024-05-08T10:54:50.547034+0000","last_active":"2024-05-08T10:54:51.623675+0000","last_peered":"2024-05-08T10:54:51.623675+0000","last_clean":"2024-05-08T10:54:51.623675+0000","last_became_active":"2024-05-08T10:54:50.546680+0000","last_became_peered":"2024-05-08T10:54:50.546680+0000","last_unstale":"2024-05-08T10:54:51.623675+0000","last_undegraded":"2024-05-08T10:54:51.623675+0000","last_fullsized":"2024-05-08T10:54:51.623675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:14:08.876280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.271747+0000","last_change":"2024-05-08T10:54:50.553200+0000","last_active":"2024-05-08T10:54:53.271747+0000","last_peered":"2024-05-08T10:54:53.271747+0000","last_clean":"2024-05-08T10:54:53.271747+0000","last_became_active":"2024-05-08T10:54:50.552845+0000","last_became_peered":"2024-05-08T10:54:50.552845+0000","last_unstale":"2024-05-08T10:54:53.271747+0000","last_undegraded":"2024-05-08T10:54:53.271747+0000","last_fullsized":"2024-05-08T10:54:53.271747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:46:10.084159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.624104+0000","last_change":"2024-05-08T10:54:50.542398+0000","last_active":"2024-05-08T10:54:51.624104+0000","last_peered":"2024-05-08T10:54:51.624104+0000","last_clean":"2024-05-08T10:54:51.624104+0000","last_became_active":"2024-05-08T10:54:50.542014+0000","last_became_peered":"2024-05-08T10:54:50.542014+0000","last_unstale":"2024-05-08T10:54:51.624104+0000","last_undegraded":"2024-05-08T10:54:51.624104+0000","last_fullsized":"2024-05-08T10:54:51.624104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:36:31.739083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.539523+0000","last_change":"2024-05-08T10:54:50.542033+0000","last_active":"2024-05-08T10:54:51.539523+0000","last_peered":"2024-05-08T10:54:51.539523+0000","last_clean":"2024-05-08T10:54:51.539523+0000","last_became_active":"2024-05-08T10:54:50.541776+0000","last_became_peered":"2024-05-08T10:54:50.541776+0000","last_unstale":"2024-05-08T10:54:51.539523+0000","last_undegraded":"2024-05-08T10:54:51.539523+0000","last_fullsized":"2024-05-08T10:54:51.539523+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:17:39.617660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.538877+0000","last_change":"2024-05-08T10:54:50.541380+0000","last_active":"2024-05-08T10:54:51.538877+0000","last_peered":"2024-05-08T10:54:51.538877+0000","last_clean":"2024-05-08T10:54:51.538877+0000","last_became_active":"2024-05-08T10:54:50.540999+0000","last_became_peered":"2024-05-08T10:54:50.540999+0000","last_unstale":"2024-05-08T10:54:51.538877+0000","last_undegraded":"2024-05-08T10:54:51.538877+0000","last_fullsized":"2024-05-08T10:54:51.538877+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:12:04.365598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.539267+0000","last_change":"2024-05-08T10:54:50.536612+0000","last_active":"2024-05-08T10:54:51.539267+0000","last_peered":"2024-05-08T10:54:51.539267+0000","last_clean":"2024-05-08T10:54:51.539267+0000","last_became_active":"2024-05-08T10:54:50.536347+0000","last_became_peered":"2024-05-08T10:54:50.536347+0000","last_unstale":"2024-05-08T10:54:51.539267+0000","last_undegraded":"2024-05-08T10:54:51.539267+0000","last_fullsized":"2024-05-08T10:54:51.539267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:00:53.753820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272252+0000","last_change":"2024-05-08T10:54:50.542352+0000","last_active":"2024-05-08T10:54:53.272252+0000","last_peered":"2024-05-08T10:54:53.272252+0000","last_clean":"2024-05-08T10:54:53.272252+0000","last_became_active":"2024-05-08T10:54:50.542056+0000","last_became_peered":"2024-05-08T10:54:50.542056+0000","last_unstale":"2024-05-08T10:54:53.272252+0000","last_undegraded":"2024-05-08T10:54:53.272252+0000","last_fullsized":"2024-05-08T10:54:53.272252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:43:52.788984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.271763+0000","last_change":"2024-05-08T10:54:50.540420+0000","last_active":"2024-05-08T10:54:53.271763+0000","last_peered":"2024-05-08T10:54:53.271763+0000","last_clean":"2024-05-08T10:54:53.271763+0000","last_became_active":"2024-05-08T10:54:50.540073+0000","last_became_peered":"2024-05-08T10:54:50.540073+0000","last_unstale":"2024-05-08T10:54:53.271763+0000","last_undegraded":"2024-05-08T10:54:53.271763+0000","last_fullsized":"2024-05-08T10:54:53.271763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:44:24.261973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.536636+0000","last_change":"2024-05-08T10:54:50.531957+0000","last_active":"2024-05-08T10:54:51.536636+0000","last_peered":"2024-05-08T10:54:51.536636+0000","last_clean":"2024-05-08T10:54:51.536636+0000","last_became_active":"2024-05-08T10:54:50.531646+0000","last_became_peered":"2024-05-08T10:54:50.531646+0000","last_unstale":"2024-05-08T10:54:51.536636+0000","last_undegraded":"2024-05-08T10:54:51.536636+0000","last_fullsized":"2024-05-08T10:54:51.536636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:06:27.967756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272153+0000","last_change":"2024-05-08T10:54:50.545714+0000","last_active":"2024-05-08T10:54:53.272153+0000","last_peered":"2024-05-08T10:54:53.272153+0000","last_clean":"2024-05-08T10:54:53.272153+0000","last_became_active":"2024-05-08T10:54:50.545415+0000","last_became_peered":"2024-05-08T10:54:50.545415+0000","last_unstale":"2024-05-08T10:54:53.272153+0000","last_undegraded":"2024-05-08T10:54:53.272153+0000","last_fullsized":"2024-05-08T10:54:53.272153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:40:14.037116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272642+0000","last_change":"2024-05-08T10:54:50.543717+0000","last_active":"2024-05-08T10:54:53.272642+0000","last_peered":"2024-05-08T10:54:53.272642+0000","last_clean":"2024-05-08T10:54:53.272642+0000","last_became_active":"2024-05-08T10:54:50.543465+0000","last_became_peered":"2024-05-08T10:54:50.543465+0000","last_unstale":"2024-05-08T10:54:53.272642+0000","last_undegraded":"2024-05-08T10:54:53.272642+0000","last_fullsized":"2024-05-08T10:54:53.272642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:17:53.754154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:52.206333+0000","last_change":"2024-05-08T10:54:50.535283+0000","last_active":"2024-05-08T10:54:52.206333+0000","last_peered":"2024-05-08T10:54:52.206333+0000","last_clean":"2024-05-08T10:54:52.206333+0000","last_became_active":"2024-05-08T10:54:50.534933+0000","last_became_peered":"2024-05-08T10:54:50.534933+0000","last_unstale":"2024-05-08T10:54:52.206333+0000","last_undegraded":"2024-05-08T10:54:52.206333+0000","last_fullsized":"2024-05-08T10:54:52.206333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:06.987968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.624055+0000","last_change":"2024-05-08T10:54:50.545460+0000","last_active":"2024-05-08T10:54:51.624055+0000","last_peered":"2024-05-08T10:54:51.624055+0000","last_clean":"2024-05-08T10:54:51.624055+0000","last_became_active":"2024-05-08T10:54:50.545182+0000","last_became_peered":"2024-05-08T10:54:50.545182+0000","last_unstale":"2024-05-08T10:54:51.624055+0000","last_undegraded":"2024-05-08T10:54:51.624055+0000","last_fullsized":"2024-05-08T10:54:51.624055+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:35:53.604235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.539432+0000","last_change":"2024-05-08T10:54:50.534702+0000","last_active":"2024-05-08T10:54:51.539432+0000","last_peered":"2024-05-08T10:54:51.539432+0000","last_clean":"2024-05-08T10:54:51.539432+0000","last_became_active":"2024-05-08T10:54:50.534424+0000","last_became_peered":"2024-05-08T10:54:50.534424+0000","last_unstale":"2024-05-08T10:54:51.539432+0000","last_undegraded":"2024-05-08T10:54:51.539432+0000","last_fullsized":"2024-05-08T10:54:51.539432+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:27:46.730550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.271871+0000","last_change":"2024-05-08T10:54:50.542206+0000","last_active":"2024-05-08T10:54:53.271871+0000","last_peered":"2024-05-08T10:54:53.271871+0000","last_clean":"2024-05-08T10:54:53.271871+0000","last_became_active":"2024-05-08T10:54:50.540272+0000","last_became_peered":"2024-05-08T10:54:50.540272+0000","last_unstale":"2024-05-08T10:54:53.271871+0000","last_undegraded":"2024-05-08T10:54:53.271871+0000","last_fullsized":"2024-05-08T10:54:53.271871+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:45:53.748139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272432+0000","last_change":"2024-05-08T10:54:50.546452+0000","last_active":"2024-05-08T10:54:53.272432+0000","last_peered":"2024-05-08T10:54:53.272432+0000","last_clean":"2024-05-08T10:54:53.272432+0000","last_became_active":"2024-05-08T10:54:50.546143+0000","last_became_peered":"2024-05-08T10:54:50.546143+0000","last_unstale":"2024-05-08T10:54:53.272432+0000","last_undegraded":"2024-05-08T10:54:53.272432+0000","last_fullsized":"2024-05-08T10:54:53.272432+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:50:37.863580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.271957+0000","last_change":"2024-05-08T10:54:50.547750+0000","last_active":"2024-05-08T10:54:53.271957+0000","last_peered":"2024-05-08T10:54:53.271957+0000","last_clean":"2024-05-08T10:54:53.271957+0000","last_became_active":"2024-05-08T10:54:50.547492+0000","last_became_peered":"2024-05-08T10:54:50.547492+0000","last_unstale":"2024-05-08T10:54:53.271957+0000","last_undegraded":"2024-05-08T10:54:53.271957+0000","last_fullsized":"2024-05-08T10:54:53.271957+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:06:27.967756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272070+0000","last_change":"2024-05-08T10:54:50.547741+0000","last_active":"2024-05-08T10:54:53.272070+0000","last_peered":"2024-05-08T10:54:53.272070+0000","last_clean":"2024-05-08T10:54:53.272070+0000","last_became_active":"2024-05-08T10:54:50.547475+0000","last_became_peered":"2024-05-08T10:54:50.547475+0000","last_unstale":"2024-05-08T10:54:53.272070+0000","last_undegraded":"2024-05-08T10:54:53.272070+0000","last_fullsized":"2024-05-08T10:54:53.272070+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:17:39.617660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272323+0000","last_change":"2024-05-08T10:54:50.546236+0000","last_active":"2024-05-08T10:54:53.272323+0000","last_peered":"2024-05-08T10:54:53.272323+0000","last_clean":"2024-05-08T10:54:53.272323+0000","last_became_active":"2024-05-08T10:54:50.545968+0000","last_became_peered":"2024-05-08T10:54:50.545968+0000","last_unstale":"2024-05-08T10:54:53.272323+0000","last_undegraded":"2024-05-08T10:54:53.272323+0000","last_fullsized":"2024-05-08T10:54:53.272323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:17:39.617660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.539559+0000","last_change":"2024-05-08T10:54:50.532358+0000","last_active":"2024-05-08T10:54:51.539559+0000","last_peered":"2024-05-08T10:54:51.539559+0000","last_clean":"2024-05-08T10:54:51.539559+0000","last_became_active":"2024-05-08T10:54:50.532084+0000","last_became_peered":"2024-05-08T10:54:50.532084+0000","last_unstale":"2024-05-08T10:54:51.539559+0000","last_undegraded":"2024-05-08T10:54:51.539559+0000","last_fullsized":"2024-05-08T10:54:51.539559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:40:14.037116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.536825+0000","last_change":"2024-05-08T10:54:50.542677+0000","last_active":"2024-05-08T10:54:51.536825+0000","last_peered":"2024-05-08T10:54:51.536825+0000","last_clean":"2024-05-08T10:54:51.536825+0000","last_became_active":"2024-05-08T10:54:50.542364+0000","last_became_peered":"2024-05-08T10:54:50.542364+0000","last_unstale":"2024-05-08T10:54:51.536825+0000","last_undegraded":"2024-05-08T10:54:51.536825+0000","last_fullsized":"2024-05-08T10:54:51.536825+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:27:46.730550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272321+0000","last_change":"2024-05-08T10:54:50.546906+0000","last_active":"2024-05-08T10:54:53.272321+0000","last_peered":"2024-05-08T10:54:53.272321+0000","last_clean":"2024-05-08T10:54:53.272321+0000","last_became_active":"2024-05-08T10:54:50.546627+0000","last_became_peered":"2024-05-08T10:54:50.546627+0000","last_unstale":"2024-05-08T10:54:53.272321+0000","last_undegraded":"2024-05-08T10:54:53.272321+0000","last_fullsized":"2024-05-08T10:54:53.272321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:27:46.730550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.271948+0000","last_change":"2024-05-08T10:54:50.552062+0000","last_active":"2024-05-08T10:54:53.271948+0000","last_peered":"2024-05-08T10:54:53.271948+0000","last_clean":"2024-05-08T10:54:53.271948+0000","last_became_active":"2024-05-08T10:54:50.550966+0000","last_became_peered":"2024-05-08T10:54:50.550966+0000","last_unstale":"2024-05-08T10:54:53.271948+0000","last_undegraded":"2024-05-08T10:54:53.271948+0000","last_fullsized":"2024-05-08T10:54:53.271948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:07:03.513132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272358+0000","last_change":"2024-05-08T10:54:50.550884+0000","last_active":"2024-05-08T10:54:53.272358+0000","last_peered":"2024-05-08T10:54:53.272358+0000","last_clean":"2024-05-08T10:54:53.272358+0000","last_became_active":"2024-05-08T10:54:50.550437+0000","last_became_peered":"2024-05-08T10:54:50.550437+0000","last_unstale":"2024-05-08T10:54:53.272358+0000","last_undegraded":"2024-05-08T10:54:53.272358+0000","last_fullsized":"2024-05-08T10:54:53.272358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:14:08.876280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:52.206355+0000","last_change":"2024-05-08T10:54:50.537512+0000","last_active":"2024-05-08T10:54:52.206355+0000","last_peered":"2024-05-08T10:54:52.206355+0000","last_clean":"2024-05-08T10:54:52.206355+0000","last_became_active":"2024-05-08T10:54:50.537214+0000","last_became_peered":"2024-05-08T10:54:50.537214+0000","last_unstale":"2024-05-08T10:54:52.206355+0000","last_undegraded":"2024-05-08T10:54:52.206355+0000","last_fullsized":"2024-05-08T10:54:52.206355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:31:55.776210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.538582+0000","last_change":"2024-05-08T10:54:50.544340+0000","last_active":"2024-05-08T10:54:51.538582+0000","last_peered":"2024-05-08T10:54:51.538582+0000","last_clean":"2024-05-08T10:54:51.538582+0000","last_became_active":"2024-05-08T10:54:50.544072+0000","last_became_peered":"2024-05-08T10:54:50.544072+0000","last_unstale":"2024-05-08T10:54:51.538582+0000","last_undegraded":"2024-05-08T10:54:51.538582+0000","last_fullsized":"2024-05-08T10:54:51.538582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:07:03.513132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.539220+0000","last_change":"2024-05-08T10:54:50.532176+0000","last_active":"2024-05-08T10:54:51.539220+0000","last_peered":"2024-05-08T10:54:51.539220+0000","last_clean":"2024-05-08T10:54:51.539220+0000","last_became_active":"2024-05-08T10:54:50.531846+0000","last_became_peered":"2024-05-08T10:54:50.531846+0000","last_unstale":"2024-05-08T10:54:51.539220+0000","last_undegraded":"2024-05-08T10:54:51.539220+0000","last_fullsized":"2024-05-08T10:54:51.539220+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:07:13.589112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272439+0000","last_change":"2024-05-08T10:54:49.539056+0000","last_active":"2024-05-08T10:54:53.272439+0000","last_peered":"2024-05-08T10:54:53.272439+0000","last_clean":"2024-05-08T10:54:53.272439+0000","last_became_active":"2024-05-08T10:54:49.538788+0000","last_became_peered":"2024-05-08T10:54:49.538788+0000","last_unstale":"2024-05-08T10:54:53.272439+0000","last_undegraded":"2024-05-08T10:54:53.272439+0000","last_fullsized":"2024-05-08T10:54:53.272439+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:21:53.697233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272029+0000","last_change":"2024-05-08T10:54:50.536315+0000","last_active":"2024-05-08T10:54:53.272029+0000","last_peered":"2024-05-08T10:54:53.272029+0000","last_clean":"2024-05-08T10:54:53.272029+0000","last_became_active":"2024-05-08T10:54:50.536003+0000","last_became_peered":"2024-05-08T10:54:50.536003+0000","last_unstale":"2024-05-08T10:54:53.272029+0000","last_undegraded":"2024-05-08T10:54:53.272029+0000","last_fullsized":"2024-05-08T10:54:53.272029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:12:04.365598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.539075+0000","last_change":"2024-05-08T10:54:49.530966+0000","last_active":"2024-05-08T10:54:51.539075+0000","last_peered":"2024-05-08T10:54:51.539075+0000","last_clean":"2024-05-08T10:54:51.539075+0000","last_became_active":"2024-05-08T10:54:49.530656+0000","last_became_peered":"2024-05-08T10:54:49.530656+0000","last_unstale":"2024-05-08T10:54:51.539075+0000","last_undegraded":"2024-05-08T10:54:51.539075+0000","last_fullsized":"2024-05-08T10:54:51.539075+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:00:52.746134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272492+0000","last_change":"2024-05-08T10:54:49.536057+0000","last_active":"2024-05-08T10:54:53.272492+0000","last_peered":"2024-05-08T10:54:53.272492+0000","last_clean":"2024-05-08T10:54:53.272492+0000","last_became_active":"2024-05-08T10:54:49.535697+0000","last_became_peered":"2024-05-08T10:54:49.535697+0000","last_unstale":"2024-05-08T10:54:53.272492+0000","last_undegraded":"2024-05-08T10:54:53.272492+0000","last_fullsized":"2024-05-08T10:54:53.272492+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:50:17.425844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.271904+0000","last_change":"2024-05-08T10:54:50.551282+0000","last_active":"2024-05-08T10:54:53.271904+0000","last_peered":"2024-05-08T10:54:53.271904+0000","last_clean":"2024-05-08T10:54:53.271904+0000","last_became_active":"2024-05-08T10:54:50.550992+0000","last_became_peered":"2024-05-08T10:54:50.550992+0000","last_unstale":"2024-05-08T10:54:53.271904+0000","last_undegraded":"2024-05-08T10:54:53.271904+0000","last_fullsized":"2024-05-08T10:54:53.271904+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:07:03.513132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272265+0000","last_change":"2024-05-08T10:54:49.533211+0000","last_active":"2024-05-08T10:54:53.272265+0000","last_peered":"2024-05-08T10:54:53.272265+0000","last_clean":"2024-05-08T10:54:53.272265+0000","last_became_active":"2024-05-08T10:54:49.532870+0000","last_became_peered":"2024-05-08T10:54:49.532870+0000","last_unstale":"2024-05-08T10:54:53.272265+0000","last_undegraded":"2024-05-08T10:54:53.272265+0000","last_fullsized":"2024-05-08T10:54:53.272265+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:04:27.826613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.536597+0000","last_change":"2024-05-08T10:54:50.549669+0000","last_active":"2024-05-08T10:54:51.536597+0000","last_peered":"2024-05-08T10:54:51.536597+0000","last_clean":"2024-05-08T10:54:51.536597+0000","last_became_active":"2024-05-08T10:54:50.549148+0000","last_became_peered":"2024-05-08T10:54:50.549148+0000","last_unstale":"2024-05-08T10:54:51.536597+0000","last_undegraded":"2024-05-08T10:54:51.536597+0000","last_fullsized":"2024-05-08T10:54:51.536597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:07:03.513132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.538726+0000","last_change":"2024-05-08T10:54:49.534750+0000","last_active":"2024-05-08T10:54:51.538726+0000","last_peered":"2024-05-08T10:54:51.538726+0000","last_clean":"2024-05-08T10:54:51.538726+0000","last_became_active":"2024-05-08T10:54:49.534448+0000","last_became_peered":"2024-05-08T10:54:49.534448+0000","last_unstale":"2024-05-08T10:54:51.538726+0000","last_undegraded":"2024-05-08T10:54:51.538726+0000","last_fullsized":"2024-05-08T10:54:51.538726+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:35:21.510783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272387+0000","last_change":"2024-05-08T10:54:50.542813+0000","last_active":"2024-05-08T10:54:53.272387+0000","last_peered":"2024-05-08T10:54:53.272387+0000","last_clean":"2024-05-08T10:54:53.272387+0000","last_became_active":"2024-05-08T10:54:50.542521+0000","last_became_peered":"2024-05-08T10:54:50.542521+0000","last_unstale":"2024-05-08T10:54:53.272387+0000","last_undegraded":"2024-05-08T10:54:53.272387+0000","last_fullsized":"2024-05-08T10:54:53.272387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:20:08.620180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272450+0000","last_change":"2024-05-08T10:54:49.534807+0000","last_active":"2024-05-08T10:54:53.272450+0000","last_peered":"2024-05-08T10:54:53.272450+0000","last_clean":"2024-05-08T10:54:53.272450+0000","last_became_active":"2024-05-08T10:54:49.534525+0000","last_became_peered":"2024-05-08T10:54:49.534525+0000","last_unstale":"2024-05-08T10:54:53.272450+0000","last_undegraded":"2024-05-08T10:54:53.272450+0000","last_fullsized":"2024-05-08T10:54:53.272450+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:07:12.581426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272500+0000","last_change":"2024-05-08T10:54:50.549738+0000","last_active":"2024-05-08T10:54:53.272500+0000","last_peered":"2024-05-08T10:54:53.272500+0000","last_clean":"2024-05-08T10:54:53.272500+0000","last_became_active":"2024-05-08T10:54:50.548425+0000","last_became_peered":"2024-05-08T10:54:50.548425+0000","last_unstale":"2024-05-08T10:54:53.272500+0000","last_undegraded":"2024-05-08T10:54:53.272500+0000","last_fullsized":"2024-05-08T10:54:53.272500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:17:39.617660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.536748+0000","last_change":"2024-05-08T10:54:49.540157+0000","last_active":"2024-05-08T10:54:51.536748+0000","last_peered":"2024-05-08T10:54:51.536748+0000","last_clean":"2024-05-08T10:54:51.536748+0000","last_became_active":"2024-05-08T10:54:49.539852+0000","last_became_peered":"2024-05-08T10:54:49.539852+0000","last_unstale":"2024-05-08T10:54:51.536748+0000","last_undegraded":"2024-05-08T10:54:51.536748+0000","last_fullsized":"2024-05-08T10:54:51.536748+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:00:52.746134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.539495+0000","last_change":"2024-05-08T10:54:50.534438+0000","last_active":"2024-05-08T10:54:51.539495+0000","last_peered":"2024-05-08T10:54:51.539495+0000","last_clean":"2024-05-08T10:54:51.539495+0000","last_became_active":"2024-05-08T10:54:50.533971+0000","last_became_peered":"2024-05-08T10:54:50.533971+0000","last_unstale":"2024-05-08T10:54:51.539495+0000","last_undegraded":"2024-05-08T10:54:51.539495+0000","last_fullsized":"2024-05-08T10:54:51.539495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:06.987968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.539367+0000","last_change":"2024-05-08T10:54:49.531309+0000","last_active":"2024-05-08T10:54:51.539367+0000","last_peered":"2024-05-08T10:54:51.539367+0000","last_clean":"2024-05-08T10:54:51.539367+0000","last_became_active":"2024-05-08T10:54:49.530442+0000","last_became_peered":"2024-05-08T10:54:49.530442+0000","last_unstale":"2024-05-08T10:54:51.539367+0000","last_undegraded":"2024-05-08T10:54:51.539367+0000","last_fullsized":"2024-05-08T10:54:51.539367+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:07:12.581426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.623854+0000","last_change":"2024-05-08T10:54:50.549577+0000","last_active":"2024-05-08T10:54:51.623854+0000","last_peered":"2024-05-08T10:54:51.623854+0000","last_clean":"2024-05-08T10:54:51.623854+0000","last_became_active":"2024-05-08T10:54:50.549318+0000","last_became_peered":"2024-05-08T10:54:50.549318+0000","last_unstale":"2024-05-08T10:54:51.623854+0000","last_undegraded":"2024-05-08T10:54:51.623854+0000","last_fullsized":"2024-05-08T10:54:51.623854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:50:37.863580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272014+0000","last_change":"2024-05-08T10:54:49.534151+0000","last_active":"2024-05-08T10:54:53.272014+0000","last_peered":"2024-05-08T10:54:53.272014+0000","last_clean":"2024-05-08T10:54:53.272014+0000","last_became_active":"2024-05-08T10:54:49.533841+0000","last_became_peered":"2024-05-08T10:54:49.533841+0000","last_unstale":"2024-05-08T10:54:53.272014+0000","last_undegraded":"2024-05-08T10:54:53.272014+0000","last_fullsized":"2024-05-08T10:54:53.272014+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:43:52.839891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.271941+0000","last_change":"2024-05-08T10:54:50.539238+0000","last_active":"2024-05-08T10:54:53.271941+0000","last_peered":"2024-05-08T10:54:53.271941+0000","last_clean":"2024-05-08T10:54:53.271941+0000","last_became_active":"2024-05-08T10:54:50.538930+0000","last_became_peered":"2024-05-08T10:54:50.538930+0000","last_unstale":"2024-05-08T10:54:53.271941+0000","last_undegraded":"2024-05-08T10:54:53.271941+0000","last_fullsized":"2024-05-08T10:54:53.271941+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:46:10.084159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272450+0000","last_change":"2024-05-08T10:54:49.537048+0000","last_active":"2024-05-08T10:54:53.272450+0000","last_peered":"2024-05-08T10:54:53.272450+0000","last_clean":"2024-05-08T10:54:53.272450+0000","last_became_active":"2024-05-08T10:54:49.536620+0000","last_became_peered":"2024-05-08T10:54:49.536620+0000","last_unstale":"2024-05-08T10:54:53.272450+0000","last_undegraded":"2024-05-08T10:54:53.272450+0000","last_fullsized":"2024-05-08T10:54:53.272450+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:35:21.510783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.623897+0000","last_change":"2024-05-08T10:54:50.545019+0000","last_active":"2024-05-08T10:54:51.623897+0000","last_peered":"2024-05-08T10:54:51.623897+0000","last_clean":"2024-05-08T10:54:51.623897+0000","last_became_active":"2024-05-08T10:54:50.544710+0000","last_became_peered":"2024-05-08T10:54:50.544710+0000","last_unstale":"2024-05-08T10:54:51.623897+0000","last_undegraded":"2024-05-08T10:54:51.623897+0000","last_fullsized":"2024-05-08T10:54:51.623897+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:08:48.409546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.538557+0000","last_change":"2024-05-08T10:54:49.531681+0000","last_active":"2024-05-08T10:54:51.538557+0000","last_peered":"2024-05-08T10:54:51.538557+0000","last_clean":"2024-05-08T10:54:51.538557+0000","last_became_active":"2024-05-08T10:54:49.531120+0000","last_became_peered":"2024-05-08T10:54:49.531120+0000","last_unstale":"2024-05-08T10:54:51.538557+0000","last_undegraded":"2024-05-08T10:54:51.538557+0000","last_fullsized":"2024-05-08T10:54:51.538557+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:41:42.237766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.538783+0000","last_change":"2024-05-08T10:54:50.544975+0000","last_active":"2024-05-08T10:54:51.538783+0000","last_peered":"2024-05-08T10:54:51.538783+0000","last_clean":"2024-05-08T10:54:51.538783+0000","last_became_active":"2024-05-08T10:54:50.544731+0000","last_became_peered":"2024-05-08T10:54:50.544731+0000","last_unstale":"2024-05-08T10:54:51.538783+0000","last_undegraded":"2024-05-08T10:54:51.538783+0000","last_fullsized":"2024-05-08T10:54:51.538783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:06:27.967756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:52.206041+0000","last_change":"2024-05-08T10:54:49.531598+0000","last_active":"2024-05-08T10:54:52.206041+0000","last_peered":"2024-05-08T10:54:52.206041+0000","last_clean":"2024-05-08T10:54:52.206041+0000","last_became_active":"2024-05-08T10:54:49.531288+0000","last_became_peered":"2024-05-08T10:54:49.531288+0000","last_unstale":"2024-05-08T10:54:52.206041+0000","last_undegraded":"2024-05-08T10:54:52.206041+0000","last_fullsized":"2024-05-08T10:54:52.206041+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:04:27.826613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.623671+0000","last_change":"2024-05-08T10:54:50.543982+0000","last_active":"2024-05-08T10:54:51.623671+0000","last_peered":"2024-05-08T10:54:51.623671+0000","last_clean":"2024-05-08T10:54:51.623671+0000","last_became_active":"2024-05-08T10:54:50.543721+0000","last_became_peered":"2024-05-08T10:54:50.543721+0000","last_unstale":"2024-05-08T10:54:51.623671+0000","last_undegraded":"2024-05-08T10:54:51.623671+0000","last_fullsized":"2024-05-08T10:54:51.623671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:34:17.184122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.538712+0000","last_change":"2024-05-08T10:54:49.535555+0000","last_active":"2024-05-08T10:54:51.538712+0000","last_peered":"2024-05-08T10:54:51.538712+0000","last_clean":"2024-05-08T10:54:51.538712+0000","last_became_active":"2024-05-08T10:54:49.535171+0000","last_became_peered":"2024-05-08T10:54:49.535171+0000","last_unstale":"2024-05-08T10:54:51.538712+0000","last_undegraded":"2024-05-08T10:54:51.538712+0000","last_fullsized":"2024-05-08T10:54:51.538712+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:45:13.454727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.623934+0000","last_change":"2024-05-08T10:54:50.547853+0000","last_active":"2024-05-08T10:54:51.623934+0000","last_peered":"2024-05-08T10:54:51.623934+0000","last_clean":"2024-05-08T10:54:51.623934+0000","last_became_active":"2024-05-08T10:54:50.547647+0000","last_became_peered":"2024-05-08T10:54:50.547647+0000","last_unstale":"2024-05-08T10:54:51.623934+0000","last_undegraded":"2024-05-08T10:54:51.623934+0000","last_fullsized":"2024-05-08T10:54:51.623934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:41:02.815763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:52.206276+0000","last_change":"2024-05-08T10:54:49.528935+0000","last_active":"2024-05-08T10:54:52.206276+0000","last_peered":"2024-05-08T10:54:52.206276+0000","last_clean":"2024-05-08T10:54:52.206276+0000","last_became_active":"2024-05-08T10:54:49.528373+0000","last_became_peered":"2024-05-08T10:54:49.528373+0000","last_unstale":"2024-05-08T10:54:52.206276+0000","last_undegraded":"2024-05-08T10:54:52.206276+0000","last_fullsized":"2024-05-08T10:54:52.206276+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:41:42.237766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.624161+0000","last_change":"2024-05-08T10:54:50.548188+0000","last_active":"2024-05-08T10:54:51.624161+0000","last_peered":"2024-05-08T10:54:51.624161+0000","last_clean":"2024-05-08T10:54:51.624161+0000","last_became_active":"2024-05-08T10:54:50.547738+0000","last_became_peered":"2024-05-08T10:54:50.547738+0000","last_unstale":"2024-05-08T10:54:51.624161+0000","last_undegraded":"2024-05-08T10:54:51.624161+0000","last_fullsized":"2024-05-08T10:54:51.624161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:27:33.078243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.536866+0000","last_change":"2024-05-08T10:54:49.539756+0000","last_active":"2024-05-08T10:54:51.536866+0000","last_peered":"2024-05-08T10:54:51.536866+0000","last_clean":"2024-05-08T10:54:51.536866+0000","last_became_active":"2024-05-08T10:54:49.539459+0000","last_became_peered":"2024-05-08T10:54:49.539459+0000","last_unstale":"2024-05-08T10:54:51.536866+0000","last_undegraded":"2024-05-08T10:54:51.536866+0000","last_fullsized":"2024-05-08T10:54:51.536866+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:40:16.322062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272509+0000","last_change":"2024-05-08T10:54:50.550681+0000","last_active":"2024-05-08T10:54:53.272509+0000","last_peered":"2024-05-08T10:54:53.272509+0000","last_clean":"2024-05-08T10:54:53.272509+0000","last_became_active":"2024-05-08T10:54:50.550395+0000","last_became_peered":"2024-05-08T10:54:50.550395+0000","last_unstale":"2024-05-08T10:54:53.272509+0000","last_undegraded":"2024-05-08T10:54:53.272509+0000","last_fullsized":"2024-05-08T10:54:53.272509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:08:48.409546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:52.206093+0000","last_change":"2024-05-08T10:54:49.534684+0000","last_active":"2024-05-08T10:54:52.206093+0000","last_peered":"2024-05-08T10:54:52.206093+0000","last_clean":"2024-05-08T10:54:52.206093+0000","last_became_active":"2024-05-08T10:54:49.534333+0000","last_became_peered":"2024-05-08T10:54:49.534333+0000","last_unstale":"2024-05-08T10:54:52.206093+0000","last_undegraded":"2024-05-08T10:54:52.206093+0000","last_fullsized":"2024-05-08T10:54:52.206093+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:07:12.581426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.623842+0000","last_change":"2024-05-08T10:54:50.541378+0000","last_active":"2024-05-08T10:54:51.623842+0000","last_peered":"2024-05-08T10:54:51.623842+0000","last_clean":"2024-05-08T10:54:51.623842+0000","last_became_active":"2024-05-08T10:54:50.540987+0000","last_became_peered":"2024-05-08T10:54:50.540987+0000","last_unstale":"2024-05-08T10:54:51.623842+0000","last_undegraded":"2024-05-08T10:54:51.623842+0000","last_fullsized":"2024-05-08T10:54:51.623842+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:20:08.620180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.623580+0000","last_change":"2024-05-08T10:54:40.015226+0000","last_active":"2024-05-08T10:54:51.623580+0000","last_peered":"2024-05-08T10:54:51.623580+0000","last_clean":"2024-05-08T10:54:51.623580+0000","last_became_active":"2024-05-08T10:54:40.014219+0000","last_became_peered":"2024-05-08T10:54:40.014219+0000","last_unstale":"2024-05-08T10:54:51.623580+0000","last_undegraded":"2024-05-08T10:54:51.623580+0000","last_fullsized":"2024-05-08T10:54:51.623580+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:38.989328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:38.989328+0000","last_clean_scrub_stamp":"2024-05-08T10:54:38.989328+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:10:59.668786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.271967+0000","last_change":"2024-05-08T10:54:49.534493+0000","last_active":"2024-05-08T10:54:53.271967+0000","last_peered":"2024-05-08T10:54:53.271967+0000","last_clean":"2024-05-08T10:54:53.271967+0000","last_became_active":"2024-05-08T10:54:49.533772+0000","last_became_peered":"2024-05-08T10:54:49.533772+0000","last_unstale":"2024-05-08T10:54:53.271967+0000","last_undegraded":"2024-05-08T10:54:53.271967+0000","last_fullsized":"2024-05-08T10:54:53.271967+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:41:42.237766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272465+0000","last_change":"2024-05-08T10:54:50.553323+0000","last_active":"2024-05-08T10:54:53.272465+0000","last_peered":"2024-05-08T10:54:53.272465+0000","last_clean":"2024-05-08T10:54:53.272465+0000","last_became_active":"2024-05-08T10:54:50.553046+0000","last_became_peered":"2024-05-08T10:54:50.553046+0000","last_unstale":"2024-05-08T10:54:53.272465+0000","last_undegraded":"2024-05-08T10:54:53.272465+0000","last_fullsized":"2024-05-08T10:54:53.272465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:26:24.924440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.623468+0000","last_change":"2024-05-08T10:54:49.537291+0000","last_active":"2024-05-08T10:54:51.623468+0000","last_peered":"2024-05-08T10:54:51.623468+0000","last_clean":"2024-05-08T10:54:51.623468+0000","last_became_active":"2024-05-08T10:54:49.537026+0000","last_became_peered":"2024-05-08T10:54:49.537026+0000","last_unstale":"2024-05-08T10:54:51.623468+0000","last_undegraded":"2024-05-08T10:54:51.623468+0000","last_fullsized":"2024-05-08T10:54:51.623468+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:35:21.510783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.271682+0000","last_change":"2024-05-08T10:54:50.536808+0000","last_active":"2024-05-08T10:54:53.271682+0000","last_peered":"2024-05-08T10:54:53.271682+0000","last_clean":"2024-05-08T10:54:53.271682+0000","last_became_active":"2024-05-08T10:54:50.536502+0000","last_became_peered":"2024-05-08T10:54:50.536502+0000","last_unstale":"2024-05-08T10:54:53.271682+0000","last_undegraded":"2024-05-08T10:54:53.271682+0000","last_fullsized":"2024-05-08T10:54:53.271682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:08:05.567837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:52.206181+0000","last_change":"2024-05-08T10:54:49.536613+0000","last_active":"2024-05-08T10:54:52.206181+0000","last_peered":"2024-05-08T10:54:52.206181+0000","last_clean":"2024-05-08T10:54:52.206181+0000","last_became_active":"2024-05-08T10:54:49.536290+0000","last_became_peered":"2024-05-08T10:54:49.536290+0000","last_unstale":"2024-05-08T10:54:52.206181+0000","last_undegraded":"2024-05-08T10:54:52.206181+0000","last_fullsized":"2024-05-08T10:54:52.206181+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:50:17.425844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.536784+0000","last_change":"2024-05-08T10:54:50.539387+0000","last_active":"2024-05-08T10:54:51.536784+0000","last_peered":"2024-05-08T10:54:51.536784+0000","last_clean":"2024-05-08T10:54:51.536784+0000","last_became_active":"2024-05-08T10:54:50.539070+0000","last_became_peered":"2024-05-08T10:54:50.539070+0000","last_unstale":"2024-05-08T10:54:51.536784+0000","last_undegraded":"2024-05-08T10:54:51.536784+0000","last_fullsized":"2024-05-08T10:54:51.536784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:12:04.365598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272501+0000","last_change":"2024-05-08T10:54:49.537472+0000","last_active":"2024-05-08T10:54:53.272501+0000","last_peered":"2024-05-08T10:54:53.272501+0000","last_clean":"2024-05-08T10:54:53.272501+0000","last_became_active":"2024-05-08T10:54:49.537140+0000","last_became_peered":"2024-05-08T10:54:49.537140+0000","last_unstale":"2024-05-08T10:54:53.272501+0000","last_undegraded":"2024-05-08T10:54:53.272501+0000","last_fullsized":"2024-05-08T10:54:53.272501+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:00:52.746134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.539458+0000","last_change":"2024-05-08T10:54:50.540453+0000","last_active":"2024-05-08T10:54:51.539458+0000","last_peered":"2024-05-08T10:54:51.539458+0000","last_clean":"2024-05-08T10:54:51.539458+0000","last_became_active":"2024-05-08T10:54:50.540200+0000","last_became_peered":"2024-05-08T10:54:50.540200+0000","last_unstale":"2024-05-08T10:54:51.539458+0000","last_undegraded":"2024-05-08T10:54:51.539458+0000","last_fullsized":"2024-05-08T10:54:51.539458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:40:17.329748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.536732+0000","last_change":"2024-05-08T10:54:49.536666+0000","last_active":"2024-05-08T10:54:51.536732+0000","last_peered":"2024-05-08T10:54:51.536732+0000","last_clean":"2024-05-08T10:54:51.536732+0000","last_became_active":"2024-05-08T10:54:49.536210+0000","last_became_peered":"2024-05-08T10:54:49.536210+0000","last_unstale":"2024-05-08T10:54:51.536732+0000","last_undegraded":"2024-05-08T10:54:51.536732+0000","last_fullsized":"2024-05-08T10:54:51.536732+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:07:12.581426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272494+0000","last_change":"2024-05-08T10:54:50.549051+0000","last_active":"2024-05-08T10:54:53.272494+0000","last_peered":"2024-05-08T10:54:53.272494+0000","last_clean":"2024-05-08T10:54:53.272494+0000","last_became_active":"2024-05-08T10:54:50.548723+0000","last_became_peered":"2024-05-08T10:54:50.548723+0000","last_unstale":"2024-05-08T10:54:53.272494+0000","last_undegraded":"2024-05-08T10:54:53.272494+0000","last_fullsized":"2024-05-08T10:54:53.272494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:41:02.815763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.624047+0000","last_change":"2024-05-08T10:54:49.538497+0000","last_active":"2024-05-08T10:54:51.624047+0000","last_peered":"2024-05-08T10:54:51.624047+0000","last_clean":"2024-05-08T10:54:51.624047+0000","last_became_active":"2024-05-08T10:54:49.537819+0000","last_became_peered":"2024-05-08T10:54:49.537819+0000","last_unstale":"2024-05-08T10:54:51.624047+0000","last_undegraded":"2024-05-08T10:54:51.624047+0000","last_fullsized":"2024-05-08T10:54:51.624047+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:31:54.768524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.536801+0000","last_change":"2024-05-08T10:54:50.533885+0000","last_active":"2024-05-08T10:54:51.536801+0000","last_peered":"2024-05-08T10:54:51.536801+0000","last_clean":"2024-05-08T10:54:51.536801+0000","last_became_active":"2024-05-08T10:54:50.533569+0000","last_became_peered":"2024-05-08T10:54:50.533569+0000","last_unstale":"2024-05-08T10:54:51.536801+0000","last_undegraded":"2024-05-08T10:54:51.536801+0000","last_fullsized":"2024-05-08T10:54:51.536801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:43:52.788984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.536965+0000","last_change":"2024-05-08T10:54:49.533336+0000","last_active":"2024-05-08T10:54:51.536965+0000","last_peered":"2024-05-08T10:54:51.536965+0000","last_clean":"2024-05-08T10:54:51.536965+0000","last_became_active":"2024-05-08T10:54:49.533024+0000","last_became_peered":"2024-05-08T10:54:49.533024+0000","last_unstale":"2024-05-08T10:54:51.536965+0000","last_undegraded":"2024-05-08T10:54:51.536965+0000","last_fullsized":"2024-05-08T10:54:51.536965+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:04:27.826613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272492+0000","last_change":"2024-05-08T10:54:50.544364+0000","last_active":"2024-05-08T10:54:53.272492+0000","last_peered":"2024-05-08T10:54:53.272492+0000","last_clean":"2024-05-08T10:54:53.272492+0000","last_became_active":"2024-05-08T10:54:50.544015+0000","last_became_peered":"2024-05-08T10:54:50.544015+0000","last_unstale":"2024-05-08T10:54:53.272492+0000","last_undegraded":"2024-05-08T10:54:53.272492+0000","last_fullsized":"2024-05-08T10:54:53.272492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:34:17.184122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.538820+0000","last_change":"2024-05-08T10:54:49.538628+0000","last_active":"2024-05-08T10:54:51.538820+0000","last_peered":"2024-05-08T10:54:51.538820+0000","last_clean":"2024-05-08T10:54:51.538820+0000","last_became_active":"2024-05-08T10:54:49.538328+0000","last_became_peered":"2024-05-08T10:54:49.538328+0000","last_unstale":"2024-05-08T10:54:51.538820+0000","last_undegraded":"2024-05-08T10:54:51.538820+0000","last_fullsized":"2024-05-08T10:54:51.538820+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:04:27.826613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272243+0000","last_change":"2024-05-08T10:54:50.542376+0000","last_active":"2024-05-08T10:54:53.272243+0000","last_peered":"2024-05-08T10:54:53.272243+0000","last_clean":"2024-05-08T10:54:53.272243+0000","last_became_active":"2024-05-08T10:54:50.541231+0000","last_became_peered":"2024-05-08T10:54:50.541231+0000","last_unstale":"2024-05-08T10:54:53.272243+0000","last_undegraded":"2024-05-08T10:54:53.272243+0000","last_fullsized":"2024-05-08T10:54:53.272243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:43:52.788984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.623466+0000","last_change":"2024-05-08T10:54:49.538203+0000","last_active":"2024-05-08T10:54:51.623466+0000","last_peered":"2024-05-08T10:54:51.623466+0000","last_clean":"2024-05-08T10:54:51.623466+0000","last_became_active":"2024-05-08T10:54:49.537722+0000","last_became_peered":"2024-05-08T10:54:49.537722+0000","last_unstale":"2024-05-08T10:54:51.623466+0000","last_undegraded":"2024-05-08T10:54:51.623466+0000","last_fullsized":"2024-05-08T10:54:51.623466+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:07:12.581426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.539252+0000","last_change":"2024-05-08T10:54:50.535043+0000","last_active":"2024-05-08T10:54:51.539252+0000","last_peered":"2024-05-08T10:54:51.539252+0000","last_clean":"2024-05-08T10:54:51.539252+0000","last_became_active":"2024-05-08T10:54:50.534704+0000","last_became_peered":"2024-05-08T10:54:50.534704+0000","last_unstale":"2024-05-08T10:54:51.539252+0000","last_undegraded":"2024-05-08T10:54:51.539252+0000","last_fullsized":"2024-05-08T10:54:51.539252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:35:22.518469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.536641+0000","last_change":"2024-05-08T10:54:49.537497+0000","last_active":"2024-05-08T10:54:51.536641+0000","last_peered":"2024-05-08T10:54:51.536641+0000","last_clean":"2024-05-08T10:54:51.536641+0000","last_became_active":"2024-05-08T10:54:49.537216+0000","last_became_peered":"2024-05-08T10:54:49.537216+0000","last_unstale":"2024-05-08T10:54:51.536641+0000","last_undegraded":"2024-05-08T10:54:51.536641+0000","last_fullsized":"2024-05-08T10:54:51.536641+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:41:42.237766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272547+0000","last_change":"2024-05-08T10:54:50.544550+0000","last_active":"2024-05-08T10:54:53.272547+0000","last_peered":"2024-05-08T10:54:53.272547+0000","last_clean":"2024-05-08T10:54:53.272547+0000","last_became_active":"2024-05-08T10:54:50.544247+0000","last_became_peered":"2024-05-08T10:54:50.544247+0000","last_unstale":"2024-05-08T10:54:53.272547+0000","last_undegraded":"2024-05-08T10:54:53.272547+0000","last_fullsized":"2024-05-08T10:54:53.272547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:14:08.876280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.536662+0000","last_change":"2024-05-08T10:54:49.537032+0000","last_active":"2024-05-08T10:54:51.536662+0000","last_peered":"2024-05-08T10:54:51.536662+0000","last_clean":"2024-05-08T10:54:51.536662+0000","last_became_active":"2024-05-08T10:54:49.536742+0000","last_became_peered":"2024-05-08T10:54:49.536742+0000","last_unstale":"2024-05-08T10:54:51.536662+0000","last_undegraded":"2024-05-08T10:54:51.536662+0000","last_fullsized":"2024-05-08T10:54:51.536662+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:35:21.510783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272404+0000","last_change":"2024-05-08T10:54:50.551614+0000","last_active":"2024-05-08T10:54:53.272404+0000","last_peered":"2024-05-08T10:54:53.272404+0000","last_clean":"2024-05-08T10:54:53.272404+0000","last_became_active":"2024-05-08T10:54:50.551296+0000","last_became_peered":"2024-05-08T10:54:50.551296+0000","last_unstale":"2024-05-08T10:54:53.272404+0000","last_undegraded":"2024-05-08T10:54:53.272404+0000","last_fullsized":"2024-05-08T10:54:53.272404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:40:14.037116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.623924+0000","last_change":"2024-05-08T10:54:49.538259+0000","last_active":"2024-05-08T10:54:51.623924+0000","last_peered":"2024-05-08T10:54:51.623924+0000","last_clean":"2024-05-08T10:54:51.623924+0000","last_became_active":"2024-05-08T10:54:49.537732+0000","last_became_peered":"2024-05-08T10:54:49.537732+0000","last_unstale":"2024-05-08T10:54:51.623924+0000","last_undegraded":"2024-05-08T10:54:51.623924+0000","last_fullsized":"2024-05-08T10:54:51.623924+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:40:16.322062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.539024+0000","last_change":"2024-05-08T10:54:50.533790+0000","last_active":"2024-05-08T10:54:51.539024+0000","last_peered":"2024-05-08T10:54:51.539024+0000","last_clean":"2024-05-08T10:54:51.539024+0000","last_became_active":"2024-05-08T10:54:50.533500+0000","last_became_peered":"2024-05-08T10:54:50.533500+0000","last_unstale":"2024-05-08T10:54:51.539024+0000","last_undegraded":"2024-05-08T10:54:51.539024+0000","last_fullsized":"2024-05-08T10:54:51.539024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:43:52.788984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272457+0000","last_change":"2024-05-08T10:54:50.538173+0000","last_active":"2024-05-08T10:54:53.272457+0000","last_peered":"2024-05-08T10:54:53.272457+0000","last_clean":"2024-05-08T10:54:53.272457+0000","last_became_active":"2024-05-08T10:54:50.537276+0000","last_became_peered":"2024-05-08T10:54:50.537276+0000","last_unstale":"2024-05-08T10:54:53.272457+0000","last_undegraded":"2024-05-08T10:54:53.272457+0000","last_fullsized":"2024-05-08T10:54:53.272457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:28:49.416807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.623659+0000","last_change":"2024-05-08T10:54:49.537236+0000","last_active":"2024-05-08T10:54:51.623659+0000","last_peered":"2024-05-08T10:54:51.623659+0000","last_clean":"2024-05-08T10:54:51.623659+0000","last_became_active":"2024-05-08T10:54:49.536918+0000","last_became_peered":"2024-05-08T10:54:49.536918+0000","last_unstale":"2024-05-08T10:54:51.623659+0000","last_undegraded":"2024-05-08T10:54:51.623659+0000","last_fullsized":"2024-05-08T10:54:51.623659+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:00:52.746134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272163+0000","last_change":"2024-05-08T10:54:50.544921+0000","last_active":"2024-05-08T10:54:53.272163+0000","last_peered":"2024-05-08T10:54:53.272163+0000","last_clean":"2024-05-08T10:54:53.272163+0000","last_became_active":"2024-05-08T10:54:50.544572+0000","last_became_peered":"2024-05-08T10:54:50.544572+0000","last_unstale":"2024-05-08T10:54:53.272163+0000","last_undegraded":"2024-05-08T10:54:53.272163+0000","last_fullsized":"2024-05-08T10:54:53.272163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:26:24.924440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.623924+0000","last_change":"2024-05-08T10:54:49.538621+0000","last_active":"2024-05-08T10:54:51.623924+0000","last_peered":"2024-05-08T10:54:51.623924+0000","last_clean":"2024-05-08T10:54:51.623924+0000","last_became_active":"2024-05-08T10:54:49.537823+0000","last_became_peered":"2024-05-08T10:54:49.537823+0000","last_unstale":"2024-05-08T10:54:51.623924+0000","last_undegraded":"2024-05-08T10:54:51.623924+0000","last_fullsized":"2024-05-08T10:54:51.623924+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:05.980282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272301+0000","last_change":"2024-05-08T10:54:50.548758+0000","last_active":"2024-05-08T10:54:53.272301+0000","last_peered":"2024-05-08T10:54:53.272301+0000","last_clean":"2024-05-08T10:54:53.272301+0000","last_became_active":"2024-05-08T10:54:50.548012+0000","last_became_peered":"2024-05-08T10:54:50.548012+0000","last_unstale":"2024-05-08T10:54:53.272301+0000","last_undegraded":"2024-05-08T10:54:53.272301+0000","last_fullsized":"2024-05-08T10:54:53.272301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:27:46.730550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272385+0000","last_change":"2024-05-08T10:54:49.537987+0000","last_active":"2024-05-08T10:54:53.272385+0000","last_peered":"2024-05-08T10:54:53.272385+0000","last_clean":"2024-05-08T10:54:53.272385+0000","last_became_active":"2024-05-08T10:54:49.537700+0000","last_became_peered":"2024-05-08T10:54:49.537700+0000","last_unstale":"2024-05-08T10:54:53.272385+0000","last_undegraded":"2024-05-08T10:54:53.272385+0000","last_fullsized":"2024-05-08T10:54:53.272385+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:04:27.826613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272245+0000","last_change":"2024-05-08T10:54:50.545275+0000","last_active":"2024-05-08T10:54:53.272245+0000","last_peered":"2024-05-08T10:54:53.272245+0000","last_clean":"2024-05-08T10:54:53.272245+0000","last_became_active":"2024-05-08T10:54:50.544915+0000","last_became_peered":"2024-05-08T10:54:50.544915+0000","last_unstale":"2024-05-08T10:54:53.272245+0000","last_undegraded":"2024-05-08T10:54:53.272245+0000","last_fullsized":"2024-05-08T10:54:53.272245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:12:04.365598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272568+0000","last_change":"2024-05-08T10:54:49.540467+0000","last_active":"2024-05-08T10:54:53.272568+0000","last_peered":"2024-05-08T10:54:53.272568+0000","last_clean":"2024-05-08T10:54:53.272568+0000","last_became_active":"2024-05-08T10:54:49.540032+0000","last_became_peered":"2024-05-08T10:54:49.540032+0000","last_unstale":"2024-05-08T10:54:53.272568+0000","last_undegraded":"2024-05-08T10:54:53.272568+0000","last_fullsized":"2024-05-08T10:54:53.272568+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:21:53.697233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":661884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":64724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":71060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":798720,"data_stored":655640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T10:54:56.496 INFO:tasks.ceph.mds.b.smithi174.stderr:2024-05-08T10:54:56.499+0000 7f4bfdda5640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-08T10:54:58.977 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T10:54:59.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.097+0000 7fc466148640 1 Processor -- start 2024-05-08T10:54:59.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.097+0000 7fc466148640 1 -- start start 2024-05-08T10:54:59.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.098+0000 7fc466148640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fc46015df50 0x7fc4600d1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:59.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.098+0000 7fc466148640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc46015e330 con 0x7fc4600d0b90 2024-05-08T10:54:59.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.098+0000 7fc466148640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4600d2380 con 0x7fc4600d1d50 2024-05-08T10:54:59.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.098+0000 7fc466148640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4600c79c0 con 0x7fc46015df50 2024-05-08T10:54:59.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.098+0000 7fc45f7fe640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fc46015df50 0x7fc4600d1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:59.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.098+0000 7fc45ffff640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fc4600d0b90 0x7fc4600c7e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:43488/0 (socket says 172.21.15.33:43488) 2024-05-08T10:54:59.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.098+0000 7fc45ffff640 1 -- 172.21.15.33:0/802511276 learned_addr learned my addr 172.21.15.33:0/802511276 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-05-08T10:54:59.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.098+0000 7fc45f7fe640 1 -- 172.21.15.33:0/802511276 >> v1:172.21.15.174:6789/0 conn(0x7fc4600d1d50 legacy=0x7fc4600d0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:54:59.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.098+0000 7fc45f7fe640 1 -- 172.21.15.33:0/802511276 >> v1:172.21.15.33:6789/0 conn(0x7fc4600d0b90 legacy=0x7fc4600c7e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:59.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.098+0000 7fc45e7fc640 1 -- 172.21.15.33:0/802511276 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1512680445 0 0) 0x7fc46015e330 con 0x7fc4600d0b90 2024-05-08T10:54:59.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.098+0000 7fc45f7fe640 1 -- 172.21.15.33:0/802511276 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4600d2660 con 0x7fc46015df50 2024-05-08T10:54:59.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.099+0000 7fc45f7fe640 1 --2- 172.21.15.33:0/802511276 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc46015df50 0x7fc4600d1810 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc4500097a0 tx=0x7fc45002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66f2ebab10d25246 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:54:59.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.099+0000 7fc45e7fc640 1 -- 172.21.15.33:0/802511276 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc450037070 con 0x7fc46015df50 2024-05-08T10:54:59.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.099+0000 7fc45e7fc640 1 -- 172.21.15.33:0/802511276 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc45002ae50 con 0x7fc46015df50 2024-05-08T10:54:59.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.099+0000 7fc45e7fc640 1 -- 172.21.15.33:0/802511276 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc450032660 con 0x7fc46015df50 2024-05-08T10:54:59.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.100+0000 7fc466148640 1 -- 172.21.15.33:0/802511276 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc46015df50 msgr2=0x7fc4600d1810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:59.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.100+0000 7fc466148640 1 --2- 172.21.15.33:0/802511276 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc46015df50 0x7fc4600d1810 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc4500097a0 tx=0x7fc45002a140 comp rx=0 tx=0).stop 2024-05-08T10:54:59.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.100+0000 7fc466148640 1 -- 172.21.15.33:0/802511276 shutdown_connections 2024-05-08T10:54:59.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.100+0000 7fc466148640 1 --2- 172.21.15.33:0/802511276 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc46015df50 0x7fc4600d1810 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:59.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.100+0000 7fc466148640 1 -- 172.21.15.33:0/802511276 >> 172.21.15.33:0/802511276 conn(0x7fc46009cf20 msgr2=0x7fc4600d3c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:54:59.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.100+0000 7fc466148640 1 -- 172.21.15.33:0/802511276 shutdown_connections 2024-05-08T10:54:59.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.100+0000 7fc466148640 1 -- 172.21.15.33:0/802511276 wait complete. 2024-05-08T10:54:59.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.101+0000 7fc466148640 1 Processor -- start 2024-05-08T10:54:59.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.101+0000 7fc466148640 1 -- start start 2024-05-08T10:54:59.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.102+0000 7fc466148640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc4600d0b90 0x7fc4600c9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:59.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.102+0000 7fc466148640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc4600d1d50 0x7fc460152b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:59.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.102+0000 7fc466148640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc46015df50 0x7fc460153070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:59.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.102+0000 7fc466148640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4600c8560 con 0x7fc4600d1d50 2024-05-08T10:54:59.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.102+0000 7fc466148640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4600d1280 con 0x7fc4600d0b90 2024-05-08T10:54:59.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.102+0000 7fc466148640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4600c86e0 con 0x7fc46015df50 2024-05-08T10:54:59.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.102+0000 7fc45effd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc4600d1d50 0x7fc460152b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:59.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.102+0000 7fc45effd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc4600d1d50 0x7fc460152b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37412/0 (socket says 172.21.15.33:37412) 2024-05-08T10:54:59.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.102+0000 7fc45effd640 1 -- 172.21.15.33:0/102850590 learned_addr learned my addr 172.21.15.33:0/102850590 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:54:59.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.102+0000 7fc45f7fe640 1 --2- 172.21.15.33:0/102850590 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc4600d0b90 0x7fc4600c9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:59.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.102+0000 7fc45ffff640 1 --2- 172.21.15.33:0/102850590 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc46015df50 0x7fc460153070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:59.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.103+0000 7fc45effd640 1 -- 172.21.15.33:0/102850590 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc46015df50 msgr2=0x7fc460153070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:59.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.103+0000 7fc45effd640 1 --2- 172.21.15.33:0/102850590 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc46015df50 0x7fc460153070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:59.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.103+0000 7fc45effd640 1 -- 172.21.15.33:0/102850590 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc4600d0b90 msgr2=0x7fc4600c9fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:59.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.103+0000 7fc45effd640 1 --2- 172.21.15.33:0/102850590 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc4600d0b90 0x7fc4600c9fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:59.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.103+0000 7fc45effd640 1 -- 172.21.15.33:0/102850590 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4600a19f0 con 0x7fc4600d1d50 2024-05-08T10:54:59.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.103+0000 7fc45ffff640 1 --2- 172.21.15.33:0/102850590 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc46015df50 0x7fc460153070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:54:59.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.103+0000 7fc45effd640 1 --2- 172.21.15.33:0/102850590 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc4600d1d50 0x7fc460152b30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc45400c430 tx=0x7fc45400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:54:59.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.103+0000 7fc447fff640 1 -- 172.21.15.33:0/102850590 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc454011790 con 0x7fc4600d1d50 2024-05-08T10:54:59.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.103+0000 7fc447fff640 1 -- 172.21.15.33:0/102850590 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc454017070 con 0x7fc4600d1d50 2024-05-08T10:54:59.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.103+0000 7fc466148640 1 -- 172.21.15.33:0/102850590 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4600a0e70 con 0x7fc4600d1d50 2024-05-08T10:54:59.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.103+0000 7fc447fff640 1 -- 172.21.15.33:0/102850590 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc454011bb0 con 0x7fc4600d1d50 2024-05-08T10:54:59.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.103+0000 7fc466148640 1 -- 172.21.15.33:0/102850590 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4600a1430 con 0x7fc4600d1d50 2024-05-08T10:54:59.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.104+0000 7fc466148640 1 -- 172.21.15.33:0/102850590 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc460069d20 con 0x7fc4600d1d50 2024-05-08T10:54:59.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.105+0000 7fc447fff640 1 -- 172.21.15.33:0/102850590 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc45401c460 con 0x7fc4600d1d50 2024-05-08T10:54:59.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.105+0000 7fc447fff640 1 --2- 172.21.15.33:0/102850590 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fc44c06b4d0 0x7fc44c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:59.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.105+0000 7fc447fff640 1 -- 172.21.15.33:0/102850590 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc45408a0e0 con 0x7fc4600d1d50 2024-05-08T10:54:59.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.105+0000 7fc45f7fe640 1 --2- 172.21.15.33:0/102850590 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fc44c06b4d0 0x7fc44c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:59.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.106+0000 7fc45f7fe640 1 --2- 172.21.15.33:0/102850590 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fc44c06b4d0 0x7fc44c06d990 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc450034000 tx=0x7fc45002e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:54:59.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.109+0000 7fc447fff640 1 -- 172.21.15.33:0/102850590 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc454058f60 con 0x7fc4600d1d50 2024-05-08T10:54:59.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.288+0000 7fc466148640 1 -- 172.21.15.33:0/102850590 --> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc4600cdf70 con 0x7fc44c06b4d0 2024-05-08T10:54:59.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.295+0000 7fc447fff640 1 -- 172.21.15.33:0/102850590 <== mgr.4103 v2:172.21.15.174:6832/261355069 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251946 (secure 0 0 0) 0x7fc4600cdf70 con 0x7fc44c06b4d0 2024-05-08T10:54:59.294 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:54:59.295 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-05-08T10:54:59.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.298+0000 7fc466148640 1 -- 172.21.15.33:0/102850590 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fc44c06b4d0 msgr2=0x7fc44c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:59.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.298+0000 7fc466148640 1 --2- 172.21.15.33:0/102850590 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fc44c06b4d0 0x7fc44c06d990 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc450034000 tx=0x7fc45002e000 comp rx=0 tx=0).stop 2024-05-08T10:54:59.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.298+0000 7fc466148640 1 -- 172.21.15.33:0/102850590 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc4600d1d50 msgr2=0x7fc460152b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:59.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.298+0000 7fc466148640 1 --2- 172.21.15.33:0/102850590 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc4600d1d50 0x7fc460152b30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc45400c430 tx=0x7fc45400c8f0 comp rx=0 tx=0).stop 2024-05-08T10:54:59.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.298+0000 7fc466148640 1 -- 172.21.15.33:0/102850590 shutdown_connections 2024-05-08T10:54:59.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.298+0000 7fc466148640 1 --2- 172.21.15.33:0/102850590 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fc44c06b4d0 0x7fc44c06d990 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:59.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.298+0000 7fc466148640 1 --2- 172.21.15.33:0/102850590 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc46015df50 0x7fc460153070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:59.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.298+0000 7fc466148640 1 --2- 172.21.15.33:0/102850590 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc4600d1d50 0x7fc460152b30 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:59.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.298+0000 7fc466148640 1 --2- 172.21.15.33:0/102850590 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc4600d0b90 0x7fc4600c9fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:59.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.298+0000 7fc466148640 1 -- 172.21.15.33:0/102850590 >> 172.21.15.33:0/102850590 conn(0x7fc46009cf20 msgr2=0x7fc46006b350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:54:59.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.298+0000 7fc466148640 1 -- 172.21.15.33:0/102850590 shutdown_connections 2024-05-08T10:54:59.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.298+0000 7fc466148640 1 -- 172.21.15.33:0/102850590 wait complete. 2024-05-08T10:54:59.306 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-05-08T10:54:58.946315+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":136,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218968,"kb_used_data":2800,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755752,"statfs":{"total":773094113280,"available":772869890048,"internally_reserved":0,"allocated":2867200,"data_stored":1740428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.426900"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.624024+0000","last_change":"2024-05-08T10:54:50.544238+0000","last_active":"2024-05-08T10:54:51.624024+0000","last_peered":"2024-05-08T10:54:51.624024+0000","last_clean":"2024-05-08T10:54:51.624024+0000","last_became_active":"2024-05-08T10:54:50.543590+0000","last_became_peered":"2024-05-08T10:54:50.543590+0000","last_unstale":"2024-05-08T10:54:51.624024+0000","last_undegraded":"2024-05-08T10:54:51.624024+0000","last_fullsized":"2024-05-08T10:54:51.624024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:17:53.754154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.537034+0000","last_change":"2024-05-08T10:54:50.544605+0000","last_active":"2024-05-08T10:54:51.537034+0000","last_peered":"2024-05-08T10:54:51.537034+0000","last_clean":"2024-05-08T10:54:51.537034+0000","last_became_active":"2024-05-08T10:54:50.543971+0000","last_became_peered":"2024-05-08T10:54:50.543971+0000","last_unstale":"2024-05-08T10:54:51.537034+0000","last_undegraded":"2024-05-08T10:54:51.537034+0000","last_fullsized":"2024-05-08T10:54:51.537034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:17:39.617660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272018+0000","last_change":"2024-05-08T10:54:50.541546+0000","last_active":"2024-05-08T10:54:53.272018+0000","last_peered":"2024-05-08T10:54:53.272018+0000","last_clean":"2024-05-08T10:54:53.272018+0000","last_became_active":"2024-05-08T10:54:50.540512+0000","last_became_peered":"2024-05-08T10:54:50.540512+0000","last_unstale":"2024-05-08T10:54:53.272018+0000","last_undegraded":"2024-05-08T10:54:53.272018+0000","last_fullsized":"2024-05-08T10:54:53.272018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:06:27.967756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272230+0000","last_change":"2024-05-08T10:54:50.550769+0000","last_active":"2024-05-08T10:54:53.272230+0000","last_peered":"2024-05-08T10:54:53.272230+0000","last_clean":"2024-05-08T10:54:53.272230+0000","last_became_active":"2024-05-08T10:54:50.550414+0000","last_became_peered":"2024-05-08T10:54:50.550414+0000","last_unstale":"2024-05-08T10:54:53.272230+0000","last_undegraded":"2024-05-08T10:54:53.272230+0000","last_fullsized":"2024-05-08T10:54:53.272230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:34:17.184122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.623876+0000","last_change":"2024-05-08T10:54:50.540125+0000","last_active":"2024-05-08T10:54:51.623876+0000","last_peered":"2024-05-08T10:54:51.623876+0000","last_clean":"2024-05-08T10:54:51.623876+0000","last_became_active":"2024-05-08T10:54:50.539796+0000","last_became_peered":"2024-05-08T10:54:50.539796+0000","last_unstale":"2024-05-08T10:54:51.623876+0000","last_undegraded":"2024-05-08T10:54:51.623876+0000","last_fullsized":"2024-05-08T10:54:51.623876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:28:49.416807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272082+0000","last_change":"2024-05-08T10:54:50.550911+0000","last_active":"2024-05-08T10:54:53.272082+0000","last_peered":"2024-05-08T10:54:53.272082+0000","last_clean":"2024-05-08T10:54:53.272082+0000","last_became_active":"2024-05-08T10:54:50.550594+0000","last_became_peered":"2024-05-08T10:54:50.550594+0000","last_unstale":"2024-05-08T10:54:53.272082+0000","last_undegraded":"2024-05-08T10:54:53.272082+0000","last_fullsized":"2024-05-08T10:54:53.272082+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:27:46.730550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.623675+0000","last_change":"2024-05-08T10:54:50.547034+0000","last_active":"2024-05-08T10:54:51.623675+0000","last_peered":"2024-05-08T10:54:51.623675+0000","last_clean":"2024-05-08T10:54:51.623675+0000","last_became_active":"2024-05-08T10:54:50.546680+0000","last_became_peered":"2024-05-08T10:54:50.546680+0000","last_unstale":"2024-05-08T10:54:51.623675+0000","last_undegraded":"2024-05-08T10:54:51.623675+0000","last_fullsized":"2024-05-08T10:54:51.623675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:14:08.876280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.271747+0000","last_change":"2024-05-08T10:54:50.553200+0000","last_active":"2024-05-08T10:54:53.271747+0000","last_peered":"2024-05-08T10:54:53.271747+0000","last_clean":"2024-05-08T10:54:53.271747+0000","last_became_active":"2024-05-08T10:54:50.552845+0000","last_became_peered":"2024-05-08T10:54:50.552845+0000","last_unstale":"2024-05-08T10:54:53.271747+0000","last_undegraded":"2024-05-08T10:54:53.271747+0000","last_fullsized":"2024-05-08T10:54:53.271747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:46:10.084159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.624104+0000","last_change":"2024-05-08T10:54:50.542398+0000","last_active":"2024-05-08T10:54:51.624104+0000","last_peered":"2024-05-08T10:54:51.624104+0000","last_clean":"2024-05-08T10:54:51.624104+0000","last_became_active":"2024-05-08T10:54:50.542014+0000","last_became_peered":"2024-05-08T10:54:50.542014+0000","last_unstale":"2024-05-08T10:54:51.624104+0000","last_undegraded":"2024-05-08T10:54:51.624104+0000","last_fullsized":"2024-05-08T10:54:51.624104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:36:31.739083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.539523+0000","last_change":"2024-05-08T10:54:50.542033+0000","last_active":"2024-05-08T10:54:51.539523+0000","last_peered":"2024-05-08T10:54:51.539523+0000","last_clean":"2024-05-08T10:54:51.539523+0000","last_became_active":"2024-05-08T10:54:50.541776+0000","last_became_peered":"2024-05-08T10:54:50.541776+0000","last_unstale":"2024-05-08T10:54:51.539523+0000","last_undegraded":"2024-05-08T10:54:51.539523+0000","last_fullsized":"2024-05-08T10:54:51.539523+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:17:39.617660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.538877+0000","last_change":"2024-05-08T10:54:50.541380+0000","last_active":"2024-05-08T10:54:51.538877+0000","last_peered":"2024-05-08T10:54:51.538877+0000","last_clean":"2024-05-08T10:54:51.538877+0000","last_became_active":"2024-05-08T10:54:50.540999+0000","last_became_peered":"2024-05-08T10:54:50.540999+0000","last_unstale":"2024-05-08T10:54:51.538877+0000","last_undegraded":"2024-05-08T10:54:51.538877+0000","last_fullsized":"2024-05-08T10:54:51.538877+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:12:04.365598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.539267+0000","last_change":"2024-05-08T10:54:50.536612+0000","last_active":"2024-05-08T10:54:51.539267+0000","last_peered":"2024-05-08T10:54:51.539267+0000","last_clean":"2024-05-08T10:54:51.539267+0000","last_became_active":"2024-05-08T10:54:50.536347+0000","last_became_peered":"2024-05-08T10:54:50.536347+0000","last_unstale":"2024-05-08T10:54:51.539267+0000","last_undegraded":"2024-05-08T10:54:51.539267+0000","last_fullsized":"2024-05-08T10:54:51.539267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:00:53.753820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272252+0000","last_change":"2024-05-08T10:54:50.542352+0000","last_active":"2024-05-08T10:54:53.272252+0000","last_peered":"2024-05-08T10:54:53.272252+0000","last_clean":"2024-05-08T10:54:53.272252+0000","last_became_active":"2024-05-08T10:54:50.542056+0000","last_became_peered":"2024-05-08T10:54:50.542056+0000","last_unstale":"2024-05-08T10:54:53.272252+0000","last_undegraded":"2024-05-08T10:54:53.272252+0000","last_fullsized":"2024-05-08T10:54:53.272252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:43:52.788984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.271763+0000","last_change":"2024-05-08T10:54:50.540420+0000","last_active":"2024-05-08T10:54:53.271763+0000","last_peered":"2024-05-08T10:54:53.271763+0000","last_clean":"2024-05-08T10:54:53.271763+0000","last_became_active":"2024-05-08T10:54:50.540073+0000","last_became_peered":"2024-05-08T10:54:50.540073+0000","last_unstale":"2024-05-08T10:54:53.271763+0000","last_undegraded":"2024-05-08T10:54:53.271763+0000","last_fullsized":"2024-05-08T10:54:53.271763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:44:24.261973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.536636+0000","last_change":"2024-05-08T10:54:50.531957+0000","last_active":"2024-05-08T10:54:51.536636+0000","last_peered":"2024-05-08T10:54:51.536636+0000","last_clean":"2024-05-08T10:54:51.536636+0000","last_became_active":"2024-05-08T10:54:50.531646+0000","last_became_peered":"2024-05-08T10:54:50.531646+0000","last_unstale":"2024-05-08T10:54:51.536636+0000","last_undegraded":"2024-05-08T10:54:51.536636+0000","last_fullsized":"2024-05-08T10:54:51.536636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:06:27.967756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272153+0000","last_change":"2024-05-08T10:54:50.545714+0000","last_active":"2024-05-08T10:54:53.272153+0000","last_peered":"2024-05-08T10:54:53.272153+0000","last_clean":"2024-05-08T10:54:53.272153+0000","last_became_active":"2024-05-08T10:54:50.545415+0000","last_became_peered":"2024-05-08T10:54:50.545415+0000","last_unstale":"2024-05-08T10:54:53.272153+0000","last_undegraded":"2024-05-08T10:54:53.272153+0000","last_fullsized":"2024-05-08T10:54:53.272153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:40:14.037116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272642+0000","last_change":"2024-05-08T10:54:50.543717+0000","last_active":"2024-05-08T10:54:53.272642+0000","last_peered":"2024-05-08T10:54:53.272642+0000","last_clean":"2024-05-08T10:54:53.272642+0000","last_became_active":"2024-05-08T10:54:50.543465+0000","last_became_peered":"2024-05-08T10:54:50.543465+0000","last_unstale":"2024-05-08T10:54:53.272642+0000","last_undegraded":"2024-05-08T10:54:53.272642+0000","last_fullsized":"2024-05-08T10:54:53.272642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:17:53.754154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:52.206333+0000","last_change":"2024-05-08T10:54:50.535283+0000","last_active":"2024-05-08T10:54:52.206333+0000","last_peered":"2024-05-08T10:54:52.206333+0000","last_clean":"2024-05-08T10:54:52.206333+0000","last_became_active":"2024-05-08T10:54:50.534933+0000","last_became_peered":"2024-05-08T10:54:50.534933+0000","last_unstale":"2024-05-08T10:54:52.206333+0000","last_undegraded":"2024-05-08T10:54:52.206333+0000","last_fullsized":"2024-05-08T10:54:52.206333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:06.987968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.624055+0000","last_change":"2024-05-08T10:54:50.545460+0000","last_active":"2024-05-08T10:54:51.624055+0000","last_peered":"2024-05-08T10:54:51.624055+0000","last_clean":"2024-05-08T10:54:51.624055+0000","last_became_active":"2024-05-08T10:54:50.545182+0000","last_became_peered":"2024-05-08T10:54:50.545182+0000","last_unstale":"2024-05-08T10:54:51.624055+0000","last_undegraded":"2024-05-08T10:54:51.624055+0000","last_fullsized":"2024-05-08T10:54:51.624055+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:35:53.604235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.539432+0000","last_change":"2024-05-08T10:54:50.534702+0000","last_active":"2024-05-08T10:54:51.539432+0000","last_peered":"2024-05-08T10:54:51.539432+0000","last_clean":"2024-05-08T10:54:51.539432+0000","last_became_active":"2024-05-08T10:54:50.534424+0000","last_became_peered":"2024-05-08T10:54:50.534424+0000","last_unstale":"2024-05-08T10:54:51.539432+0000","last_undegraded":"2024-05-08T10:54:51.539432+0000","last_fullsized":"2024-05-08T10:54:51.539432+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:27:46.730550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.271871+0000","last_change":"2024-05-08T10:54:50.542206+0000","last_active":"2024-05-08T10:54:53.271871+0000","last_peered":"2024-05-08T10:54:53.271871+0000","last_clean":"2024-05-08T10:54:53.271871+0000","last_became_active":"2024-05-08T10:54:50.540272+0000","last_became_peered":"2024-05-08T10:54:50.540272+0000","last_unstale":"2024-05-08T10:54:53.271871+0000","last_undegraded":"2024-05-08T10:54:53.271871+0000","last_fullsized":"2024-05-08T10:54:53.271871+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:45:53.748139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272432+0000","last_change":"2024-05-08T10:54:50.546452+0000","last_active":"2024-05-08T10:54:53.272432+0000","last_peered":"2024-05-08T10:54:53.272432+0000","last_clean":"2024-05-08T10:54:53.272432+0000","last_became_active":"2024-05-08T10:54:50.546143+0000","last_became_peered":"2024-05-08T10:54:50.546143+0000","last_unstale":"2024-05-08T10:54:53.272432+0000","last_undegraded":"2024-05-08T10:54:53.272432+0000","last_fullsized":"2024-05-08T10:54:53.272432+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:50:37.863580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.271957+0000","last_change":"2024-05-08T10:54:50.547750+0000","last_active":"2024-05-08T10:54:53.271957+0000","last_peered":"2024-05-08T10:54:53.271957+0000","last_clean":"2024-05-08T10:54:53.271957+0000","last_became_active":"2024-05-08T10:54:50.547492+0000","last_became_peered":"2024-05-08T10:54:50.547492+0000","last_unstale":"2024-05-08T10:54:53.271957+0000","last_undegraded":"2024-05-08T10:54:53.271957+0000","last_fullsized":"2024-05-08T10:54:53.271957+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:06:27.967756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272070+0000","last_change":"2024-05-08T10:54:50.547741+0000","last_active":"2024-05-08T10:54:53.272070+0000","last_peered":"2024-05-08T10:54:53.272070+0000","last_clean":"2024-05-08T10:54:53.272070+0000","last_became_active":"2024-05-08T10:54:50.547475+0000","last_became_peered":"2024-05-08T10:54:50.547475+0000","last_unstale":"2024-05-08T10:54:53.272070+0000","last_undegraded":"2024-05-08T10:54:53.272070+0000","last_fullsized":"2024-05-08T10:54:53.272070+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:17:39.617660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272323+0000","last_change":"2024-05-08T10:54:50.546236+0000","last_active":"2024-05-08T10:54:53.272323+0000","last_peered":"2024-05-08T10:54:53.272323+0000","last_clean":"2024-05-08T10:54:53.272323+0000","last_became_active":"2024-05-08T10:54:50.545968+0000","last_became_peered":"2024-05-08T10:54:50.545968+0000","last_unstale":"2024-05-08T10:54:53.272323+0000","last_undegraded":"2024-05-08T10:54:53.272323+0000","last_fullsized":"2024-05-08T10:54:53.272323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:17:39.617660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.539559+0000","last_change":"2024-05-08T10:54:50.532358+0000","last_active":"2024-05-08T10:54:51.539559+0000","last_peered":"2024-05-08T10:54:51.539559+0000","last_clean":"2024-05-08T10:54:51.539559+0000","last_became_active":"2024-05-08T10:54:50.532084+0000","last_became_peered":"2024-05-08T10:54:50.532084+0000","last_unstale":"2024-05-08T10:54:51.539559+0000","last_undegraded":"2024-05-08T10:54:51.539559+0000","last_fullsized":"2024-05-08T10:54:51.539559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:40:14.037116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.536825+0000","last_change":"2024-05-08T10:54:50.542677+0000","last_active":"2024-05-08T10:54:51.536825+0000","last_peered":"2024-05-08T10:54:51.536825+0000","last_clean":"2024-05-08T10:54:51.536825+0000","last_became_active":"2024-05-08T10:54:50.542364+0000","last_became_peered":"2024-05-08T10:54:50.542364+0000","last_unstale":"2024-05-08T10:54:51.536825+0000","last_undegraded":"2024-05-08T10:54:51.536825+0000","last_fullsized":"2024-05-08T10:54:51.536825+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:27:46.730550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272321+0000","last_change":"2024-05-08T10:54:50.546906+0000","last_active":"2024-05-08T10:54:53.272321+0000","last_peered":"2024-05-08T10:54:53.272321+0000","last_clean":"2024-05-08T10:54:53.272321+0000","last_became_active":"2024-05-08T10:54:50.546627+0000","last_became_peered":"2024-05-08T10:54:50.546627+0000","last_unstale":"2024-05-08T10:54:53.272321+0000","last_undegraded":"2024-05-08T10:54:53.272321+0000","last_fullsized":"2024-05-08T10:54:53.272321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:27:46.730550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.271948+0000","last_change":"2024-05-08T10:54:50.552062+0000","last_active":"2024-05-08T10:54:53.271948+0000","last_peered":"2024-05-08T10:54:53.271948+0000","last_clean":"2024-05-08T10:54:53.271948+0000","last_became_active":"2024-05-08T10:54:50.550966+0000","last_became_peered":"2024-05-08T10:54:50.550966+0000","last_unstale":"2024-05-08T10:54:53.271948+0000","last_undegraded":"2024-05-08T10:54:53.271948+0000","last_fullsized":"2024-05-08T10:54:53.271948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:07:03.513132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272358+0000","last_change":"2024-05-08T10:54:50.550884+0000","last_active":"2024-05-08T10:54:53.272358+0000","last_peered":"2024-05-08T10:54:53.272358+0000","last_clean":"2024-05-08T10:54:53.272358+0000","last_became_active":"2024-05-08T10:54:50.550437+0000","last_became_peered":"2024-05-08T10:54:50.550437+0000","last_unstale":"2024-05-08T10:54:53.272358+0000","last_undegraded":"2024-05-08T10:54:53.272358+0000","last_fullsized":"2024-05-08T10:54:53.272358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:14:08.876280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:52.206355+0000","last_change":"2024-05-08T10:54:50.537512+0000","last_active":"2024-05-08T10:54:52.206355+0000","last_peered":"2024-05-08T10:54:52.206355+0000","last_clean":"2024-05-08T10:54:52.206355+0000","last_became_active":"2024-05-08T10:54:50.537214+0000","last_became_peered":"2024-05-08T10:54:50.537214+0000","last_unstale":"2024-05-08T10:54:52.206355+0000","last_undegraded":"2024-05-08T10:54:52.206355+0000","last_fullsized":"2024-05-08T10:54:52.206355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:31:55.776210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.538582+0000","last_change":"2024-05-08T10:54:50.544340+0000","last_active":"2024-05-08T10:54:51.538582+0000","last_peered":"2024-05-08T10:54:51.538582+0000","last_clean":"2024-05-08T10:54:51.538582+0000","last_became_active":"2024-05-08T10:54:50.544072+0000","last_became_peered":"2024-05-08T10:54:50.544072+0000","last_unstale":"2024-05-08T10:54:51.538582+0000","last_undegraded":"2024-05-08T10:54:51.538582+0000","last_fullsized":"2024-05-08T10:54:51.538582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:07:03.513132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.539220+0000","last_change":"2024-05-08T10:54:50.532176+0000","last_active":"2024-05-08T10:54:51.539220+0000","last_peered":"2024-05-08T10:54:51.539220+0000","last_clean":"2024-05-08T10:54:51.539220+0000","last_became_active":"2024-05-08T10:54:50.531846+0000","last_became_peered":"2024-05-08T10:54:50.531846+0000","last_unstale":"2024-05-08T10:54:51.539220+0000","last_undegraded":"2024-05-08T10:54:51.539220+0000","last_fullsized":"2024-05-08T10:54:51.539220+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:07:13.589112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272439+0000","last_change":"2024-05-08T10:54:49.539056+0000","last_active":"2024-05-08T10:54:53.272439+0000","last_peered":"2024-05-08T10:54:53.272439+0000","last_clean":"2024-05-08T10:54:53.272439+0000","last_became_active":"2024-05-08T10:54:49.538788+0000","last_became_peered":"2024-05-08T10:54:49.538788+0000","last_unstale":"2024-05-08T10:54:53.272439+0000","last_undegraded":"2024-05-08T10:54:53.272439+0000","last_fullsized":"2024-05-08T10:54:53.272439+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:21:53.697233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272029+0000","last_change":"2024-05-08T10:54:50.536315+0000","last_active":"2024-05-08T10:54:53.272029+0000","last_peered":"2024-05-08T10:54:53.272029+0000","last_clean":"2024-05-08T10:54:53.272029+0000","last_became_active":"2024-05-08T10:54:50.536003+0000","last_became_peered":"2024-05-08T10:54:50.536003+0000","last_unstale":"2024-05-08T10:54:53.272029+0000","last_undegraded":"2024-05-08T10:54:53.272029+0000","last_fullsized":"2024-05-08T10:54:53.272029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:12:04.365598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.539075+0000","last_change":"2024-05-08T10:54:49.530966+0000","last_active":"2024-05-08T10:54:51.539075+0000","last_peered":"2024-05-08T10:54:51.539075+0000","last_clean":"2024-05-08T10:54:51.539075+0000","last_became_active":"2024-05-08T10:54:49.530656+0000","last_became_peered":"2024-05-08T10:54:49.530656+0000","last_unstale":"2024-05-08T10:54:51.539075+0000","last_undegraded":"2024-05-08T10:54:51.539075+0000","last_fullsized":"2024-05-08T10:54:51.539075+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:00:52.746134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272492+0000","last_change":"2024-05-08T10:54:49.536057+0000","last_active":"2024-05-08T10:54:53.272492+0000","last_peered":"2024-05-08T10:54:53.272492+0000","last_clean":"2024-05-08T10:54:53.272492+0000","last_became_active":"2024-05-08T10:54:49.535697+0000","last_became_peered":"2024-05-08T10:54:49.535697+0000","last_unstale":"2024-05-08T10:54:53.272492+0000","last_undegraded":"2024-05-08T10:54:53.272492+0000","last_fullsized":"2024-05-08T10:54:53.272492+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:50:17.425844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.271904+0000","last_change":"2024-05-08T10:54:50.551282+0000","last_active":"2024-05-08T10:54:53.271904+0000","last_peered":"2024-05-08T10:54:53.271904+0000","last_clean":"2024-05-08T10:54:53.271904+0000","last_became_active":"2024-05-08T10:54:50.550992+0000","last_became_peered":"2024-05-08T10:54:50.550992+0000","last_unstale":"2024-05-08T10:54:53.271904+0000","last_undegraded":"2024-05-08T10:54:53.271904+0000","last_fullsized":"2024-05-08T10:54:53.271904+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:07:03.513132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272265+0000","last_change":"2024-05-08T10:54:49.533211+0000","last_active":"2024-05-08T10:54:53.272265+0000","last_peered":"2024-05-08T10:54:53.272265+0000","last_clean":"2024-05-08T10:54:53.272265+0000","last_became_active":"2024-05-08T10:54:49.532870+0000","last_became_peered":"2024-05-08T10:54:49.532870+0000","last_unstale":"2024-05-08T10:54:53.272265+0000","last_undegraded":"2024-05-08T10:54:53.272265+0000","last_fullsized":"2024-05-08T10:54:53.272265+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:04:27.826613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.536597+0000","last_change":"2024-05-08T10:54:50.549669+0000","last_active":"2024-05-08T10:54:51.536597+0000","last_peered":"2024-05-08T10:54:51.536597+0000","last_clean":"2024-05-08T10:54:51.536597+0000","last_became_active":"2024-05-08T10:54:50.549148+0000","last_became_peered":"2024-05-08T10:54:50.549148+0000","last_unstale":"2024-05-08T10:54:51.536597+0000","last_undegraded":"2024-05-08T10:54:51.536597+0000","last_fullsized":"2024-05-08T10:54:51.536597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:07:03.513132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.538726+0000","last_change":"2024-05-08T10:54:49.534750+0000","last_active":"2024-05-08T10:54:51.538726+0000","last_peered":"2024-05-08T10:54:51.538726+0000","last_clean":"2024-05-08T10:54:51.538726+0000","last_became_active":"2024-05-08T10:54:49.534448+0000","last_became_peered":"2024-05-08T10:54:49.534448+0000","last_unstale":"2024-05-08T10:54:51.538726+0000","last_undegraded":"2024-05-08T10:54:51.538726+0000","last_fullsized":"2024-05-08T10:54:51.538726+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:35:21.510783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272387+0000","last_change":"2024-05-08T10:54:50.542813+0000","last_active":"2024-05-08T10:54:53.272387+0000","last_peered":"2024-05-08T10:54:53.272387+0000","last_clean":"2024-05-08T10:54:53.272387+0000","last_became_active":"2024-05-08T10:54:50.542521+0000","last_became_peered":"2024-05-08T10:54:50.542521+0000","last_unstale":"2024-05-08T10:54:53.272387+0000","last_undegraded":"2024-05-08T10:54:53.272387+0000","last_fullsized":"2024-05-08T10:54:53.272387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:20:08.620180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272450+0000","last_change":"2024-05-08T10:54:49.534807+0000","last_active":"2024-05-08T10:54:53.272450+0000","last_peered":"2024-05-08T10:54:53.272450+0000","last_clean":"2024-05-08T10:54:53.272450+0000","last_became_active":"2024-05-08T10:54:49.534525+0000","last_became_peered":"2024-05-08T10:54:49.534525+0000","last_unstale":"2024-05-08T10:54:53.272450+0000","last_undegraded":"2024-05-08T10:54:53.272450+0000","last_fullsized":"2024-05-08T10:54:53.272450+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:07:12.581426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272500+0000","last_change":"2024-05-08T10:54:50.549738+0000","last_active":"2024-05-08T10:54:53.272500+0000","last_peered":"2024-05-08T10:54:53.272500+0000","last_clean":"2024-05-08T10:54:53.272500+0000","last_became_active":"2024-05-08T10:54:50.548425+0000","last_became_peered":"2024-05-08T10:54:50.548425+0000","last_unstale":"2024-05-08T10:54:53.272500+0000","last_undegraded":"2024-05-08T10:54:53.272500+0000","last_fullsized":"2024-05-08T10:54:53.272500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:17:39.617660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.536748+0000","last_change":"2024-05-08T10:54:49.540157+0000","last_active":"2024-05-08T10:54:51.536748+0000","last_peered":"2024-05-08T10:54:51.536748+0000","last_clean":"2024-05-08T10:54:51.536748+0000","last_became_active":"2024-05-08T10:54:49.539852+0000","last_became_peered":"2024-05-08T10:54:49.539852+0000","last_unstale":"2024-05-08T10:54:51.536748+0000","last_undegraded":"2024-05-08T10:54:51.536748+0000","last_fullsized":"2024-05-08T10:54:51.536748+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:00:52.746134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.539495+0000","last_change":"2024-05-08T10:54:50.534438+0000","last_active":"2024-05-08T10:54:51.539495+0000","last_peered":"2024-05-08T10:54:51.539495+0000","last_clean":"2024-05-08T10:54:51.539495+0000","last_became_active":"2024-05-08T10:54:50.533971+0000","last_became_peered":"2024-05-08T10:54:50.533971+0000","last_unstale":"2024-05-08T10:54:51.539495+0000","last_undegraded":"2024-05-08T10:54:51.539495+0000","last_fullsized":"2024-05-08T10:54:51.539495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:06.987968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.539367+0000","last_change":"2024-05-08T10:54:49.531309+0000","last_active":"2024-05-08T10:54:51.539367+0000","last_peered":"2024-05-08T10:54:51.539367+0000","last_clean":"2024-05-08T10:54:51.539367+0000","last_became_active":"2024-05-08T10:54:49.530442+0000","last_became_peered":"2024-05-08T10:54:49.530442+0000","last_unstale":"2024-05-08T10:54:51.539367+0000","last_undegraded":"2024-05-08T10:54:51.539367+0000","last_fullsized":"2024-05-08T10:54:51.539367+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:07:12.581426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.623854+0000","last_change":"2024-05-08T10:54:50.549577+0000","last_active":"2024-05-08T10:54:51.623854+0000","last_peered":"2024-05-08T10:54:51.623854+0000","last_clean":"2024-05-08T10:54:51.623854+0000","last_became_active":"2024-05-08T10:54:50.549318+0000","last_became_peered":"2024-05-08T10:54:50.549318+0000","last_unstale":"2024-05-08T10:54:51.623854+0000","last_undegraded":"2024-05-08T10:54:51.623854+0000","last_fullsized":"2024-05-08T10:54:51.623854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:50:37.863580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272014+0000","last_change":"2024-05-08T10:54:49.534151+0000","last_active":"2024-05-08T10:54:53.272014+0000","last_peered":"2024-05-08T10:54:53.272014+0000","last_clean":"2024-05-08T10:54:53.272014+0000","last_became_active":"2024-05-08T10:54:49.533841+0000","last_became_peered":"2024-05-08T10:54:49.533841+0000","last_unstale":"2024-05-08T10:54:53.272014+0000","last_undegraded":"2024-05-08T10:54:53.272014+0000","last_fullsized":"2024-05-08T10:54:53.272014+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:43:52.839891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.271941+0000","last_change":"2024-05-08T10:54:50.539238+0000","last_active":"2024-05-08T10:54:53.271941+0000","last_peered":"2024-05-08T10:54:53.271941+0000","last_clean":"2024-05-08T10:54:53.271941+0000","last_became_active":"2024-05-08T10:54:50.538930+0000","last_became_peered":"2024-05-08T10:54:50.538930+0000","last_unstale":"2024-05-08T10:54:53.271941+0000","last_undegraded":"2024-05-08T10:54:53.271941+0000","last_fullsized":"2024-05-08T10:54:53.271941+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:46:10.084159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272450+0000","last_change":"2024-05-08T10:54:49.537048+0000","last_active":"2024-05-08T10:54:53.272450+0000","last_peered":"2024-05-08T10:54:53.272450+0000","last_clean":"2024-05-08T10:54:53.272450+0000","last_became_active":"2024-05-08T10:54:49.536620+0000","last_became_peered":"2024-05-08T10:54:49.536620+0000","last_unstale":"2024-05-08T10:54:53.272450+0000","last_undegraded":"2024-05-08T10:54:53.272450+0000","last_fullsized":"2024-05-08T10:54:53.272450+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:35:21.510783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.623897+0000","last_change":"2024-05-08T10:54:50.545019+0000","last_active":"2024-05-08T10:54:51.623897+0000","last_peered":"2024-05-08T10:54:51.623897+0000","last_clean":"2024-05-08T10:54:51.623897+0000","last_became_active":"2024-05-08T10:54:50.544710+0000","last_became_peered":"2024-05-08T10:54:50.544710+0000","last_unstale":"2024-05-08T10:54:51.623897+0000","last_undegraded":"2024-05-08T10:54:51.623897+0000","last_fullsized":"2024-05-08T10:54:51.623897+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:08:48.409546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.538557+0000","last_change":"2024-05-08T10:54:49.531681+0000","last_active":"2024-05-08T10:54:51.538557+0000","last_peered":"2024-05-08T10:54:51.538557+0000","last_clean":"2024-05-08T10:54:51.538557+0000","last_became_active":"2024-05-08T10:54:49.531120+0000","last_became_peered":"2024-05-08T10:54:49.531120+0000","last_unstale":"2024-05-08T10:54:51.538557+0000","last_undegraded":"2024-05-08T10:54:51.538557+0000","last_fullsized":"2024-05-08T10:54:51.538557+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:41:42.237766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.538783+0000","last_change":"2024-05-08T10:54:50.544975+0000","last_active":"2024-05-08T10:54:51.538783+0000","last_peered":"2024-05-08T10:54:51.538783+0000","last_clean":"2024-05-08T10:54:51.538783+0000","last_became_active":"2024-05-08T10:54:50.544731+0000","last_became_peered":"2024-05-08T10:54:50.544731+0000","last_unstale":"2024-05-08T10:54:51.538783+0000","last_undegraded":"2024-05-08T10:54:51.538783+0000","last_fullsized":"2024-05-08T10:54:51.538783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:06:27.967756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:52.206041+0000","last_change":"2024-05-08T10:54:49.531598+0000","last_active":"2024-05-08T10:54:52.206041+0000","last_peered":"2024-05-08T10:54:52.206041+0000","last_clean":"2024-05-08T10:54:52.206041+0000","last_became_active":"2024-05-08T10:54:49.531288+0000","last_became_peered":"2024-05-08T10:54:49.531288+0000","last_unstale":"2024-05-08T10:54:52.206041+0000","last_undegraded":"2024-05-08T10:54:52.206041+0000","last_fullsized":"2024-05-08T10:54:52.206041+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:04:27.826613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.623671+0000","last_change":"2024-05-08T10:54:50.543982+0000","last_active":"2024-05-08T10:54:51.623671+0000","last_peered":"2024-05-08T10:54:51.623671+0000","last_clean":"2024-05-08T10:54:51.623671+0000","last_became_active":"2024-05-08T10:54:50.543721+0000","last_became_peered":"2024-05-08T10:54:50.543721+0000","last_unstale":"2024-05-08T10:54:51.623671+0000","last_undegraded":"2024-05-08T10:54:51.623671+0000","last_fullsized":"2024-05-08T10:54:51.623671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:34:17.184122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.538712+0000","last_change":"2024-05-08T10:54:49.535555+0000","last_active":"2024-05-08T10:54:51.538712+0000","last_peered":"2024-05-08T10:54:51.538712+0000","last_clean":"2024-05-08T10:54:51.538712+0000","last_became_active":"2024-05-08T10:54:49.535171+0000","last_became_peered":"2024-05-08T10:54:49.535171+0000","last_unstale":"2024-05-08T10:54:51.538712+0000","last_undegraded":"2024-05-08T10:54:51.538712+0000","last_fullsized":"2024-05-08T10:54:51.538712+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:45:13.454727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.623934+0000","last_change":"2024-05-08T10:54:50.547853+0000","last_active":"2024-05-08T10:54:51.623934+0000","last_peered":"2024-05-08T10:54:51.623934+0000","last_clean":"2024-05-08T10:54:51.623934+0000","last_became_active":"2024-05-08T10:54:50.547647+0000","last_became_peered":"2024-05-08T10:54:50.547647+0000","last_unstale":"2024-05-08T10:54:51.623934+0000","last_undegraded":"2024-05-08T10:54:51.623934+0000","last_fullsized":"2024-05-08T10:54:51.623934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:41:02.815763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:52.206276+0000","last_change":"2024-05-08T10:54:49.528935+0000","last_active":"2024-05-08T10:54:52.206276+0000","last_peered":"2024-05-08T10:54:52.206276+0000","last_clean":"2024-05-08T10:54:52.206276+0000","last_became_active":"2024-05-08T10:54:49.528373+0000","last_became_peered":"2024-05-08T10:54:49.528373+0000","last_unstale":"2024-05-08T10:54:52.206276+0000","last_undegraded":"2024-05-08T10:54:52.206276+0000","last_fullsized":"2024-05-08T10:54:52.206276+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:41:42.237766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.624161+0000","last_change":"2024-05-08T10:54:50.548188+0000","last_active":"2024-05-08T10:54:51.624161+0000","last_peered":"2024-05-08T10:54:51.624161+0000","last_clean":"2024-05-08T10:54:51.624161+0000","last_became_active":"2024-05-08T10:54:50.547738+0000","last_became_peered":"2024-05-08T10:54:50.547738+0000","last_unstale":"2024-05-08T10:54:51.624161+0000","last_undegraded":"2024-05-08T10:54:51.624161+0000","last_fullsized":"2024-05-08T10:54:51.624161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:27:33.078243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.536866+0000","last_change":"2024-05-08T10:54:49.539756+0000","last_active":"2024-05-08T10:54:51.536866+0000","last_peered":"2024-05-08T10:54:51.536866+0000","last_clean":"2024-05-08T10:54:51.536866+0000","last_became_active":"2024-05-08T10:54:49.539459+0000","last_became_peered":"2024-05-08T10:54:49.539459+0000","last_unstale":"2024-05-08T10:54:51.536866+0000","last_undegraded":"2024-05-08T10:54:51.536866+0000","last_fullsized":"2024-05-08T10:54:51.536866+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:40:16.322062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272509+0000","last_change":"2024-05-08T10:54:50.550681+0000","last_active":"2024-05-08T10:54:53.272509+0000","last_peered":"2024-05-08T10:54:53.272509+0000","last_clean":"2024-05-08T10:54:53.272509+0000","last_became_active":"2024-05-08T10:54:50.550395+0000","last_became_peered":"2024-05-08T10:54:50.550395+0000","last_unstale":"2024-05-08T10:54:53.272509+0000","last_undegraded":"2024-05-08T10:54:53.272509+0000","last_fullsized":"2024-05-08T10:54:53.272509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:08:48.409546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:52.206093+0000","last_change":"2024-05-08T10:54:49.534684+0000","last_active":"2024-05-08T10:54:52.206093+0000","last_peered":"2024-05-08T10:54:52.206093+0000","last_clean":"2024-05-08T10:54:52.206093+0000","last_became_active":"2024-05-08T10:54:49.534333+0000","last_became_peered":"2024-05-08T10:54:49.534333+0000","last_unstale":"2024-05-08T10:54:52.206093+0000","last_undegraded":"2024-05-08T10:54:52.206093+0000","last_fullsized":"2024-05-08T10:54:52.206093+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:07:12.581426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.623842+0000","last_change":"2024-05-08T10:54:50.541378+0000","last_active":"2024-05-08T10:54:51.623842+0000","last_peered":"2024-05-08T10:54:51.623842+0000","last_clean":"2024-05-08T10:54:51.623842+0000","last_became_active":"2024-05-08T10:54:50.540987+0000","last_became_peered":"2024-05-08T10:54:50.540987+0000","last_unstale":"2024-05-08T10:54:51.623842+0000","last_undegraded":"2024-05-08T10:54:51.623842+0000","last_fullsized":"2024-05-08T10:54:51.623842+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:20:08.620180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.623580+0000","last_change":"2024-05-08T10:54:40.015226+0000","last_active":"2024-05-08T10:54:51.623580+0000","last_peered":"2024-05-08T10:54:51.623580+0000","last_clean":"2024-05-08T10:54:51.623580+0000","last_became_active":"2024-05-08T10:54:40.014219+0000","last_became_peered":"2024-05-08T10:54:40.014219+0000","last_unstale":"2024-05-08T10:54:51.623580+0000","last_undegraded":"2024-05-08T10:54:51.623580+0000","last_fullsized":"2024-05-08T10:54:51.623580+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:38.989328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:38.989328+0000","last_clean_scrub_stamp":"2024-05-08T10:54:38.989328+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:10:59.668786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.271967+0000","last_change":"2024-05-08T10:54:49.534493+0000","last_active":"2024-05-08T10:54:53.271967+0000","last_peered":"2024-05-08T10:54:53.271967+0000","last_clean":"2024-05-08T10:54:53.271967+0000","last_became_active":"2024-05-08T10:54:49.533772+0000","last_became_peered":"2024-05-08T10:54:49.533772+0000","last_unstale":"2024-05-08T10:54:53.271967+0000","last_undegraded":"2024-05-08T10:54:53.271967+0000","last_fullsized":"2024-05-08T10:54:53.271967+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:41:42.237766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272465+0000","last_change":"2024-05-08T10:54:50.553323+0000","last_active":"2024-05-08T10:54:53.272465+0000","last_peered":"2024-05-08T10:54:53.272465+0000","last_clean":"2024-05-08T10:54:53.272465+0000","last_became_active":"2024-05-08T10:54:50.553046+0000","last_became_peered":"2024-05-08T10:54:50.553046+0000","last_unstale":"2024-05-08T10:54:53.272465+0000","last_undegraded":"2024-05-08T10:54:53.272465+0000","last_fullsized":"2024-05-08T10:54:53.272465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:26:24.924440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.623468+0000","last_change":"2024-05-08T10:54:49.537291+0000","last_active":"2024-05-08T10:54:51.623468+0000","last_peered":"2024-05-08T10:54:51.623468+0000","last_clean":"2024-05-08T10:54:51.623468+0000","last_became_active":"2024-05-08T10:54:49.537026+0000","last_became_peered":"2024-05-08T10:54:49.537026+0000","last_unstale":"2024-05-08T10:54:51.623468+0000","last_undegraded":"2024-05-08T10:54:51.623468+0000","last_fullsized":"2024-05-08T10:54:51.623468+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:35:21.510783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.271682+0000","last_change":"2024-05-08T10:54:50.536808+0000","last_active":"2024-05-08T10:54:53.271682+0000","last_peered":"2024-05-08T10:54:53.271682+0000","last_clean":"2024-05-08T10:54:53.271682+0000","last_became_active":"2024-05-08T10:54:50.536502+0000","last_became_peered":"2024-05-08T10:54:50.536502+0000","last_unstale":"2024-05-08T10:54:53.271682+0000","last_undegraded":"2024-05-08T10:54:53.271682+0000","last_fullsized":"2024-05-08T10:54:53.271682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:08:05.567837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:52.206181+0000","last_change":"2024-05-08T10:54:49.536613+0000","last_active":"2024-05-08T10:54:52.206181+0000","last_peered":"2024-05-08T10:54:52.206181+0000","last_clean":"2024-05-08T10:54:52.206181+0000","last_became_active":"2024-05-08T10:54:49.536290+0000","last_became_peered":"2024-05-08T10:54:49.536290+0000","last_unstale":"2024-05-08T10:54:52.206181+0000","last_undegraded":"2024-05-08T10:54:52.206181+0000","last_fullsized":"2024-05-08T10:54:52.206181+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:50:17.425844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.536784+0000","last_change":"2024-05-08T10:54:50.539387+0000","last_active":"2024-05-08T10:54:51.536784+0000","last_peered":"2024-05-08T10:54:51.536784+0000","last_clean":"2024-05-08T10:54:51.536784+0000","last_became_active":"2024-05-08T10:54:50.539070+0000","last_became_peered":"2024-05-08T10:54:50.539070+0000","last_unstale":"2024-05-08T10:54:51.536784+0000","last_undegraded":"2024-05-08T10:54:51.536784+0000","last_fullsized":"2024-05-08T10:54:51.536784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:12:04.365598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272501+0000","last_change":"2024-05-08T10:54:49.537472+0000","last_active":"2024-05-08T10:54:53.272501+0000","last_peered":"2024-05-08T10:54:53.272501+0000","last_clean":"2024-05-08T10:54:53.272501+0000","last_became_active":"2024-05-08T10:54:49.537140+0000","last_became_peered":"2024-05-08T10:54:49.537140+0000","last_unstale":"2024-05-08T10:54:53.272501+0000","last_undegraded":"2024-05-08T10:54:53.272501+0000","last_fullsized":"2024-05-08T10:54:53.272501+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:00:52.746134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.539458+0000","last_change":"2024-05-08T10:54:50.540453+0000","last_active":"2024-05-08T10:54:51.539458+0000","last_peered":"2024-05-08T10:54:51.539458+0000","last_clean":"2024-05-08T10:54:51.539458+0000","last_became_active":"2024-05-08T10:54:50.540200+0000","last_became_peered":"2024-05-08T10:54:50.540200+0000","last_unstale":"2024-05-08T10:54:51.539458+0000","last_undegraded":"2024-05-08T10:54:51.539458+0000","last_fullsized":"2024-05-08T10:54:51.539458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:40:17.329748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.536732+0000","last_change":"2024-05-08T10:54:49.536666+0000","last_active":"2024-05-08T10:54:51.536732+0000","last_peered":"2024-05-08T10:54:51.536732+0000","last_clean":"2024-05-08T10:54:51.536732+0000","last_became_active":"2024-05-08T10:54:49.536210+0000","last_became_peered":"2024-05-08T10:54:49.536210+0000","last_unstale":"2024-05-08T10:54:51.536732+0000","last_undegraded":"2024-05-08T10:54:51.536732+0000","last_fullsized":"2024-05-08T10:54:51.536732+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:07:12.581426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272494+0000","last_change":"2024-05-08T10:54:50.549051+0000","last_active":"2024-05-08T10:54:53.272494+0000","last_peered":"2024-05-08T10:54:53.272494+0000","last_clean":"2024-05-08T10:54:53.272494+0000","last_became_active":"2024-05-08T10:54:50.548723+0000","last_became_peered":"2024-05-08T10:54:50.548723+0000","last_unstale":"2024-05-08T10:54:53.272494+0000","last_undegraded":"2024-05-08T10:54:53.272494+0000","last_fullsized":"2024-05-08T10:54:53.272494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:41:02.815763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.624047+0000","last_change":"2024-05-08T10:54:49.538497+0000","last_active":"2024-05-08T10:54:51.624047+0000","last_peered":"2024-05-08T10:54:51.624047+0000","last_clean":"2024-05-08T10:54:51.624047+0000","last_became_active":"2024-05-08T10:54:49.537819+0000","last_became_peered":"2024-05-08T10:54:49.537819+0000","last_unstale":"2024-05-08T10:54:51.624047+0000","last_undegraded":"2024-05-08T10:54:51.624047+0000","last_fullsized":"2024-05-08T10:54:51.624047+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:31:54.768524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.536801+0000","last_change":"2024-05-08T10:54:50.533885+0000","last_active":"2024-05-08T10:54:51.536801+0000","last_peered":"2024-05-08T10:54:51.536801+0000","last_clean":"2024-05-08T10:54:51.536801+0000","last_became_active":"2024-05-08T10:54:50.533569+0000","last_became_peered":"2024-05-08T10:54:50.533569+0000","last_unstale":"2024-05-08T10:54:51.536801+0000","last_undegraded":"2024-05-08T10:54:51.536801+0000","last_fullsized":"2024-05-08T10:54:51.536801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:43:52.788984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.536965+0000","last_change":"2024-05-08T10:54:49.533336+0000","last_active":"2024-05-08T10:54:51.536965+0000","last_peered":"2024-05-08T10:54:51.536965+0000","last_clean":"2024-05-08T10:54:51.536965+0000","last_became_active":"2024-05-08T10:54:49.533024+0000","last_became_peered":"2024-05-08T10:54:49.533024+0000","last_unstale":"2024-05-08T10:54:51.536965+0000","last_undegraded":"2024-05-08T10:54:51.536965+0000","last_fullsized":"2024-05-08T10:54:51.536965+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:04:27.826613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272492+0000","last_change":"2024-05-08T10:54:50.544364+0000","last_active":"2024-05-08T10:54:53.272492+0000","last_peered":"2024-05-08T10:54:53.272492+0000","last_clean":"2024-05-08T10:54:53.272492+0000","last_became_active":"2024-05-08T10:54:50.544015+0000","last_became_peered":"2024-05-08T10:54:50.544015+0000","last_unstale":"2024-05-08T10:54:53.272492+0000","last_undegraded":"2024-05-08T10:54:53.272492+0000","last_fullsized":"2024-05-08T10:54:53.272492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:34:17.184122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.538820+0000","last_change":"2024-05-08T10:54:49.538628+0000","last_active":"2024-05-08T10:54:51.538820+0000","last_peered":"2024-05-08T10:54:51.538820+0000","last_clean":"2024-05-08T10:54:51.538820+0000","last_became_active":"2024-05-08T10:54:49.538328+0000","last_became_peered":"2024-05-08T10:54:49.538328+0000","last_unstale":"2024-05-08T10:54:51.538820+0000","last_undegraded":"2024-05-08T10:54:51.538820+0000","last_fullsized":"2024-05-08T10:54:51.538820+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:04:27.826613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272243+0000","last_change":"2024-05-08T10:54:50.542376+0000","last_active":"2024-05-08T10:54:53.272243+0000","last_peered":"2024-05-08T10:54:53.272243+0000","last_clean":"2024-05-08T10:54:53.272243+0000","last_became_active":"2024-05-08T10:54:50.541231+0000","last_became_peered":"2024-05-08T10:54:50.541231+0000","last_unstale":"2024-05-08T10:54:53.272243+0000","last_undegraded":"2024-05-08T10:54:53.272243+0000","last_fullsized":"2024-05-08T10:54:53.272243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:43:52.788984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.623466+0000","last_change":"2024-05-08T10:54:49.538203+0000","last_active":"2024-05-08T10:54:51.623466+0000","last_peered":"2024-05-08T10:54:51.623466+0000","last_clean":"2024-05-08T10:54:51.623466+0000","last_became_active":"2024-05-08T10:54:49.537722+0000","last_became_peered":"2024-05-08T10:54:49.537722+0000","last_unstale":"2024-05-08T10:54:51.623466+0000","last_undegraded":"2024-05-08T10:54:51.623466+0000","last_fullsized":"2024-05-08T10:54:51.623466+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:07:12.581426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.539252+0000","last_change":"2024-05-08T10:54:50.535043+0000","last_active":"2024-05-08T10:54:51.539252+0000","last_peered":"2024-05-08T10:54:51.539252+0000","last_clean":"2024-05-08T10:54:51.539252+0000","last_became_active":"2024-05-08T10:54:50.534704+0000","last_became_peered":"2024-05-08T10:54:50.534704+0000","last_unstale":"2024-05-08T10:54:51.539252+0000","last_undegraded":"2024-05-08T10:54:51.539252+0000","last_fullsized":"2024-05-08T10:54:51.539252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:35:22.518469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.536641+0000","last_change":"2024-05-08T10:54:49.537497+0000","last_active":"2024-05-08T10:54:51.536641+0000","last_peered":"2024-05-08T10:54:51.536641+0000","last_clean":"2024-05-08T10:54:51.536641+0000","last_became_active":"2024-05-08T10:54:49.537216+0000","last_became_peered":"2024-05-08T10:54:49.537216+0000","last_unstale":"2024-05-08T10:54:51.536641+0000","last_undegraded":"2024-05-08T10:54:51.536641+0000","last_fullsized":"2024-05-08T10:54:51.536641+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:41:42.237766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272547+0000","last_change":"2024-05-08T10:54:50.544550+0000","last_active":"2024-05-08T10:54:53.272547+0000","last_peered":"2024-05-08T10:54:53.272547+0000","last_clean":"2024-05-08T10:54:53.272547+0000","last_became_active":"2024-05-08T10:54:50.544247+0000","last_became_peered":"2024-05-08T10:54:50.544247+0000","last_unstale":"2024-05-08T10:54:53.272547+0000","last_undegraded":"2024-05-08T10:54:53.272547+0000","last_fullsized":"2024-05-08T10:54:53.272547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:14:08.876280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.536662+0000","last_change":"2024-05-08T10:54:49.537032+0000","last_active":"2024-05-08T10:54:51.536662+0000","last_peered":"2024-05-08T10:54:51.536662+0000","last_clean":"2024-05-08T10:54:51.536662+0000","last_became_active":"2024-05-08T10:54:49.536742+0000","last_became_peered":"2024-05-08T10:54:49.536742+0000","last_unstale":"2024-05-08T10:54:51.536662+0000","last_undegraded":"2024-05-08T10:54:51.536662+0000","last_fullsized":"2024-05-08T10:54:51.536662+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:35:21.510783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272404+0000","last_change":"2024-05-08T10:54:50.551614+0000","last_active":"2024-05-08T10:54:53.272404+0000","last_peered":"2024-05-08T10:54:53.272404+0000","last_clean":"2024-05-08T10:54:53.272404+0000","last_became_active":"2024-05-08T10:54:50.551296+0000","last_became_peered":"2024-05-08T10:54:50.551296+0000","last_unstale":"2024-05-08T10:54:53.272404+0000","last_undegraded":"2024-05-08T10:54:53.272404+0000","last_fullsized":"2024-05-08T10:54:53.272404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:40:14.037116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.623924+0000","last_change":"2024-05-08T10:54:49.538259+0000","last_active":"2024-05-08T10:54:51.623924+0000","last_peered":"2024-05-08T10:54:51.623924+0000","last_clean":"2024-05-08T10:54:51.623924+0000","last_became_active":"2024-05-08T10:54:49.537732+0000","last_became_peered":"2024-05-08T10:54:49.537732+0000","last_unstale":"2024-05-08T10:54:51.623924+0000","last_undegraded":"2024-05-08T10:54:51.623924+0000","last_fullsized":"2024-05-08T10:54:51.623924+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:40:16.322062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.539024+0000","last_change":"2024-05-08T10:54:50.533790+0000","last_active":"2024-05-08T10:54:51.539024+0000","last_peered":"2024-05-08T10:54:51.539024+0000","last_clean":"2024-05-08T10:54:51.539024+0000","last_became_active":"2024-05-08T10:54:50.533500+0000","last_became_peered":"2024-05-08T10:54:50.533500+0000","last_unstale":"2024-05-08T10:54:51.539024+0000","last_undegraded":"2024-05-08T10:54:51.539024+0000","last_fullsized":"2024-05-08T10:54:51.539024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:43:52.788984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272457+0000","last_change":"2024-05-08T10:54:50.538173+0000","last_active":"2024-05-08T10:54:53.272457+0000","last_peered":"2024-05-08T10:54:53.272457+0000","last_clean":"2024-05-08T10:54:53.272457+0000","last_became_active":"2024-05-08T10:54:50.537276+0000","last_became_peered":"2024-05-08T10:54:50.537276+0000","last_unstale":"2024-05-08T10:54:53.272457+0000","last_undegraded":"2024-05-08T10:54:53.272457+0000","last_fullsized":"2024-05-08T10:54:53.272457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:28:49.416807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.623659+0000","last_change":"2024-05-08T10:54:49.537236+0000","last_active":"2024-05-08T10:54:51.623659+0000","last_peered":"2024-05-08T10:54:51.623659+0000","last_clean":"2024-05-08T10:54:51.623659+0000","last_became_active":"2024-05-08T10:54:49.536918+0000","last_became_peered":"2024-05-08T10:54:49.536918+0000","last_unstale":"2024-05-08T10:54:51.623659+0000","last_undegraded":"2024-05-08T10:54:51.623659+0000","last_fullsized":"2024-05-08T10:54:51.623659+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:00:52.746134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272163+0000","last_change":"2024-05-08T10:54:50.544921+0000","last_active":"2024-05-08T10:54:53.272163+0000","last_peered":"2024-05-08T10:54:53.272163+0000","last_clean":"2024-05-08T10:54:53.272163+0000","last_became_active":"2024-05-08T10:54:50.544572+0000","last_became_peered":"2024-05-08T10:54:50.544572+0000","last_unstale":"2024-05-08T10:54:53.272163+0000","last_undegraded":"2024-05-08T10:54:53.272163+0000","last_fullsized":"2024-05-08T10:54:53.272163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:26:24.924440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.623924+0000","last_change":"2024-05-08T10:54:49.538621+0000","last_active":"2024-05-08T10:54:51.623924+0000","last_peered":"2024-05-08T10:54:51.623924+0000","last_clean":"2024-05-08T10:54:51.623924+0000","last_became_active":"2024-05-08T10:54:49.537823+0000","last_became_peered":"2024-05-08T10:54:49.537823+0000","last_unstale":"2024-05-08T10:54:51.623924+0000","last_undegraded":"2024-05-08T10:54:51.623924+0000","last_fullsized":"2024-05-08T10:54:51.623924+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:05.980282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272301+0000","last_change":"2024-05-08T10:54:50.548758+0000","last_active":"2024-05-08T10:54:53.272301+0000","last_peered":"2024-05-08T10:54:53.272301+0000","last_clean":"2024-05-08T10:54:53.272301+0000","last_became_active":"2024-05-08T10:54:50.548012+0000","last_became_peered":"2024-05-08T10:54:50.548012+0000","last_unstale":"2024-05-08T10:54:53.272301+0000","last_undegraded":"2024-05-08T10:54:53.272301+0000","last_fullsized":"2024-05-08T10:54:53.272301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:27:46.730550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272385+0000","last_change":"2024-05-08T10:54:49.537987+0000","last_active":"2024-05-08T10:54:53.272385+0000","last_peered":"2024-05-08T10:54:53.272385+0000","last_clean":"2024-05-08T10:54:53.272385+0000","last_became_active":"2024-05-08T10:54:49.537700+0000","last_became_peered":"2024-05-08T10:54:49.537700+0000","last_unstale":"2024-05-08T10:54:53.272385+0000","last_undegraded":"2024-05-08T10:54:53.272385+0000","last_fullsized":"2024-05-08T10:54:53.272385+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:04:27.826613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272245+0000","last_change":"2024-05-08T10:54:50.545275+0000","last_active":"2024-05-08T10:54:53.272245+0000","last_peered":"2024-05-08T10:54:53.272245+0000","last_clean":"2024-05-08T10:54:53.272245+0000","last_became_active":"2024-05-08T10:54:50.544915+0000","last_became_peered":"2024-05-08T10:54:50.544915+0000","last_unstale":"2024-05-08T10:54:53.272245+0000","last_undegraded":"2024-05-08T10:54:53.272245+0000","last_fullsized":"2024-05-08T10:54:53.272245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:12:04.365598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272568+0000","last_change":"2024-05-08T10:54:49.540467+0000","last_active":"2024-05-08T10:54:53.272568+0000","last_peered":"2024-05-08T10:54:53.272568+0000","last_clean":"2024-05-08T10:54:53.272568+0000","last_became_active":"2024-05-08T10:54:49.540032+0000","last_became_peered":"2024-05-08T10:54:49.540032+0000","last_unstale":"2024-05-08T10:54:53.272568+0000","last_undegraded":"2024-05-08T10:54:53.272568+0000","last_fullsized":"2024-05-08T10:54:53.272568+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:21:53.697233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":661884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":64724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":71060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":798720,"data_stored":655640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T10:54:59.310 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-08T10:54:59.310 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-05-08T10:54:59.310 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-05-08T10:54:59.310 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-05-08T10:54:59.311 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-05-08T10:54:59.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.453+0000 7f97c5f22640 1 Processor -- start 2024-05-08T10:54:59.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.453+0000 7f97c5f22640 1 -- start start 2024-05-08T10:54:59.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.454+0000 7f97c5f22640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f97c006ee30 0x7f97c00d0b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:59.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.454+0000 7f97c5f22640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f97c0162410 0x7f97c006e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:59.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.454+0000 7f97c5f22640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97c0162980 con 0x7f97c006f210 2024-05-08T10:54:59.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.454+0000 7f97c5f22640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97c00b1250 con 0x7f97c006ee30 2024-05-08T10:54:59.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.454+0000 7f97c5f22640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97c00cfd70 con 0x7f97c0162410 2024-05-08T10:54:59.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.454+0000 7f97bf7fe640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f97c006ee30 0x7f97c00d0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:59.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.454+0000 7f97bf7fe640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f97c006ee30 0x7f97c00d0b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37424/0 (socket says 172.21.15.33:37424) 2024-05-08T10:54:59.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.454+0000 7f97bf7fe640 1 -- 172.21.15.33:0/1971245167 learned_addr learned my addr 172.21.15.33:0/1971245167 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:54:59.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.454+0000 7f97bf7fe640 1 -- 172.21.15.33:0/1971245167 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f97c0162410 msgr2=0x7f97c006e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:54:59.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.454+0000 7f97bf7fe640 1 --2- 172.21.15.33:0/1971245167 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f97c0162410 0x7f97c006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:59.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.454+0000 7f97bf7fe640 1 -- 172.21.15.33:0/1971245167 >> v1:172.21.15.174:6789/0 conn(0x7f97c006f210 legacy=0x7f97c006bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:54:59.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.454+0000 7f97bf7fe640 1 -- 172.21.15.33:0/1971245167 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97c00d0050 con 0x7f97c006ee30 2024-05-08T10:54:59.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.455+0000 7f97bf7fe640 1 --2- 172.21.15.33:0/1971245167 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f97c006ee30 0x7f97c00d0b30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f97b0009870 tx=0x7f97b002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=456b5fea031fc572 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:54:59.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.455+0000 7f97be7fc640 1 -- 172.21.15.33:0/1971245167 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b0037070 con 0x7f97c006ee30 2024-05-08T10:54:59.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.455+0000 7f97be7fc640 1 -- 172.21.15.33:0/1971245167 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97b0032440 con 0x7f97c006ee30 2024-05-08T10:54:59.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.455+0000 7f97be7fc640 1 -- 172.21.15.33:0/1971245167 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b0032810 con 0x7f97c006ee30 2024-05-08T10:54:59.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.456+0000 7f97c5f22640 1 -- 172.21.15.33:0/1971245167 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f97c006ee30 msgr2=0x7f97c00d0b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:59.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.456+0000 7f97c5f22640 1 --2- 172.21.15.33:0/1971245167 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f97c006ee30 0x7f97c00d0b30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f97b0009870 tx=0x7f97b002a210 comp rx=0 tx=0).stop 2024-05-08T10:54:59.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.456+0000 7f97c5f22640 1 -- 172.21.15.33:0/1971245167 shutdown_connections 2024-05-08T10:54:59.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.456+0000 7f97c5f22640 1 --2- 172.21.15.33:0/1971245167 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f97c0162410 0x7f97c006e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:59.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.456+0000 7f97c5f22640 1 --2- 172.21.15.33:0/1971245167 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f97c006ee30 0x7f97c00d0b30 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:59.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.456+0000 7f97c5f22640 1 -- 172.21.15.33:0/1971245167 >> 172.21.15.33:0/1971245167 conn(0x7f97c00d1990 msgr2=0x7f97c00d1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:54:59.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.456+0000 7f97c5f22640 1 -- 172.21.15.33:0/1971245167 shutdown_connections 2024-05-08T10:54:59.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.456+0000 7f97c5f22640 1 -- 172.21.15.33:0/1971245167 wait complete. 2024-05-08T10:54:59.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.457+0000 7f97c5f22640 1 Processor -- start 2024-05-08T10:54:59.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.457+0000 7f97c5f22640 1 -- start start 2024-05-08T10:54:59.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.458+0000 7f97c5f22640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f97c006ee30 0x7f97c00b0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:59.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.458+0000 7f97c5f22640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f97c006f210 0x7f97c0152730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:59.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.458+0000 7f97c5f22640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f97c0162410 0x7f97c015ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:59.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.458+0000 7f97c5f22640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97c006f6a0 con 0x7f97c006f210 2024-05-08T10:54:59.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.458+0000 7f97c5f22640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97c00d0610 con 0x7f97c006ee30 2024-05-08T10:54:59.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.458+0000 7f97c5f22640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97c015f220 con 0x7f97c0162410 2024-05-08T10:54:59.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.458+0000 7f97beffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f97c006f210 0x7f97c0152730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:59.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.458+0000 7f97beffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f97c006f210 0x7f97c0152730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37434/0 (socket says 172.21.15.33:37434) 2024-05-08T10:54:59.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.458+0000 7f97beffd640 1 -- 172.21.15.33:0/2762476695 learned_addr learned my addr 172.21.15.33:0/2762476695 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:54:59.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.458+0000 7f97bf7fe640 1 --2- 172.21.15.33:0/2762476695 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f97c006ee30 0x7f97c00b0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:59.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.458+0000 7f97bffff640 1 --2- 172.21.15.33:0/2762476695 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f97c0162410 0x7f97c015ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:59.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.458+0000 7f97beffd640 1 -- 172.21.15.33:0/2762476695 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f97c0162410 msgr2=0x7f97c015ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:59.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.458+0000 7f97beffd640 1 --2- 172.21.15.33:0/2762476695 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f97c0162410 0x7f97c015ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:59.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.458+0000 7f97beffd640 1 -- 172.21.15.33:0/2762476695 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f97c006ee30 msgr2=0x7f97c00b0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:59.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.458+0000 7f97beffd640 1 --2- 172.21.15.33:0/2762476695 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f97c006ee30 0x7f97c00b0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:59.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.458+0000 7f97beffd640 1 -- 172.21.15.33:0/2762476695 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97c00ae760 con 0x7f97c006f210 2024-05-08T10:54:59.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.458+0000 7f97beffd640 1 --2- 172.21.15.33:0/2762476695 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f97c006f210 0x7f97c0152730 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f97b400b410 tx=0x7f97b400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:54:59.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.458+0000 7f97a7fff640 1 -- 172.21.15.33:0/2762476695 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b4015020 con 0x7f97c006f210 2024-05-08T10:54:59.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.459+0000 7f97a7fff640 1 -- 172.21.15.33:0/2762476695 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97b4011850 con 0x7f97c006f210 2024-05-08T10:54:59.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.459+0000 7f97c5f22640 1 -- 172.21.15.33:0/2762476695 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97c00b02b0 con 0x7f97c006f210 2024-05-08T10:54:59.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.459+0000 7f97a7fff640 1 -- 172.21.15.33:0/2762476695 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b4011c40 con 0x7f97c006f210 2024-05-08T10:54:59.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.459+0000 7f97c5f22640 1 -- 172.21.15.33:0/2762476695 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97c01f7970 con 0x7f97c006f210 2024-05-08T10:54:59.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.460+0000 7f97c5f22640 1 -- 172.21.15.33:0/2762476695 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97c0069d20 con 0x7f97c006f210 2024-05-08T10:54:59.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.460+0000 7f97a7fff640 1 -- 172.21.15.33:0/2762476695 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f97b4018020 con 0x7f97c006f210 2024-05-08T10:54:59.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.460+0000 7f97a7fff640 1 --2- 172.21.15.33:0/2762476695 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f97ac06b4d0 0x7f97ac06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:59.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.461+0000 7f97a7fff640 1 -- 172.21.15.33:0/2762476695 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f97b408a0b0 con 0x7f97c006f210 2024-05-08T10:54:59.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.461+0000 7f97bf7fe640 1 --2- 172.21.15.33:0/2762476695 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f97ac06b4d0 0x7f97ac06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:59.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.461+0000 7f97bf7fe640 1 --2- 172.21.15.33:0/2762476695 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f97ac06b4d0 0x7f97ac06d990 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f97b0034000 tx=0x7f97b002e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:54:59.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.465+0000 7f97a7fff640 1 -- 172.21.15.33:0/2762476695 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f97b401f020 con 0x7f97c006f210 2024-05-08T10:54:59.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.697+0000 7f97c5f22640 1 -- 172.21.15.33:0/2762476695 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f97c0067710 con 0x7f97c006f210 2024-05-08T10:54:59.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.700+0000 7f97a7fff640 1 -- 172.21.15.33:0/2762476695 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+171788 (secure 0 0 0) 0x7f97b4058f30 con 0x7f97c006f210 2024-05-08T10:54:59.699 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:54:59.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.702+0000 7f97c5f22640 1 -- 172.21.15.33:0/2762476695 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f97ac06b4d0 msgr2=0x7f97ac06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:59.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.702+0000 7f97c5f22640 1 --2- 172.21.15.33:0/2762476695 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f97ac06b4d0 0x7f97ac06d990 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f97b0034000 tx=0x7f97b002e000 comp rx=0 tx=0).stop 2024-05-08T10:54:59.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.702+0000 7f97c5f22640 1 -- 172.21.15.33:0/2762476695 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f97c006f210 msgr2=0x7f97c0152730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:59.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.702+0000 7f97c5f22640 1 --2- 172.21.15.33:0/2762476695 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f97c006f210 0x7f97c0152730 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f97b400b410 tx=0x7f97b400b8d0 comp rx=0 tx=0).stop 2024-05-08T10:54:59.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.702+0000 7f97c5f22640 1 -- 172.21.15.33:0/2762476695 shutdown_connections 2024-05-08T10:54:59.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.702+0000 7f97c5f22640 1 --2- 172.21.15.33:0/2762476695 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f97ac06b4d0 0x7f97ac06d990 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:59.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.702+0000 7f97c5f22640 1 --2- 172.21.15.33:0/2762476695 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f97c0162410 0x7f97c015ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:59.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.702+0000 7f97c5f22640 1 --2- 172.21.15.33:0/2762476695 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f97c006f210 0x7f97c0152730 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:59.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.702+0000 7f97c5f22640 1 --2- 172.21.15.33:0/2762476695 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f97c006ee30 0x7f97c00b0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:59.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.702+0000 7f97c5f22640 1 -- 172.21.15.33:0/2762476695 >> 172.21.15.33:0/2762476695 conn(0x7f97c00d1990 msgr2=0x7f97c01608b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:54:59.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.702+0000 7f97c5f22640 1 -- 172.21.15.33:0/2762476695 shutdown_connections 2024-05-08T10:54:59.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.702+0000 7f97c5f22640 1 -- 172.21.15.33:0/2762476695 wait complete. 2024-05-08T10:54:59.711 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":5,"flags":0,"active_gid":4103,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":261355069},{"type":"v1","addr":"172.21.15.174:6833","nonce":261355069}]},"active_addr":"172.21.15.174:6833/261355069","active_change":"2024-05-08T10:54:30.934415+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4105,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.174:0","nonce":2010593148}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.174:0","nonce":200883455}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.174:0","nonce":4043589048}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.174:0","nonce":3714779194}]}]} 2024-05-08T10:54:59.717 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-05-08T10:54:59.717 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-05-08T10:54:59.718 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T10:54:59.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.824+0000 7f8111509640 1 Processor -- start 2024-05-08T10:54:59.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.824+0000 7f8111509640 1 -- start start 2024-05-08T10:54:59.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.825+0000 7f8111509640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f810c15dc00 0x7f810c0d0690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:59.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.825+0000 7f8111509640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f810c06e960 0x7f810c06f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:59.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.825+0000 7f8111509640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f810c15dfe0 0x7f810c06f630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:59.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.825+0000 7f8111509640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f810c0d0f90 con 0x7f810c15dfe0 2024-05-08T10:54:59.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.825+0000 7f8111509640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f810c06bd30 con 0x7f810c06e960 2024-05-08T10:54:59.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.825+0000 7f8111509640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f810c06c010 con 0x7f810c15dc00 2024-05-08T10:54:59.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.825+0000 7f810b7fe640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f810c15dfe0 0x7f810c06f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:59.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.825+0000 7f810b7fe640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f810c15dfe0 0x7f810c06f630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37448/0 (socket says 172.21.15.33:37448) 2024-05-08T10:54:59.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.825+0000 7f810b7fe640 1 -- 172.21.15.33:0/1832103774 learned_addr learned my addr 172.21.15.33:0/1832103774 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:54:59.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.826+0000 7f810a7fc640 1 --2- 172.21.15.33:0/1832103774 >> v2:172.21.15.174:3300/0 conn(0x7f810c06e960 0x7f810c06f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:59.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.826+0000 7f810b7fe640 1 -- 172.21.15.33:0/1832103774 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f810c15dc00 msgr2=0x7f810c0d0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:54:59.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.826+0000 7f810affd640 1 --2- 172.21.15.33:0/1832103774 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f810c15dc00 0x7f810c0d0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:59.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.826+0000 7f810b7fe640 1 --2- 172.21.15.33:0/1832103774 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f810c15dc00 0x7f810c0d0690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:59.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.826+0000 7f810b7fe640 1 -- 172.21.15.33:0/1832103774 >> v2:172.21.15.174:3300/0 conn(0x7f810c06e960 msgr2=0x7f810c06f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:54:59.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.826+0000 7f810b7fe640 1 --2- 172.21.15.33:0/1832103774 >> v2:172.21.15.174:3300/0 conn(0x7f810c06e960 0x7f810c06f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:59.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.826+0000 7f810b7fe640 1 -- 172.21.15.33:0/1832103774 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f810c06c2f0 con 0x7f810c15dfe0 2024-05-08T10:54:59.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.826+0000 7f810b7fe640 1 --2- 172.21.15.33:0/1832103774 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f810c15dfe0 0x7f810c06f630 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f810c0b4530 tx=0x7f80fc02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d66e614877b4ed3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:54:59.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.826+0000 7f8109ffb640 1 -- 172.21.15.33:0/1832103774 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80fc037070 con 0x7f810c15dfe0 2024-05-08T10:54:59.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.827+0000 7f8109ffb640 1 -- 172.21.15.33:0/1832103774 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80fc032440 con 0x7f810c15dfe0 2024-05-08T10:54:59.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.827+0000 7f8109ffb640 1 -- 172.21.15.33:0/1832103774 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80fc032810 con 0x7f810c15dfe0 2024-05-08T10:54:59.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.827+0000 7f8111509640 1 -- 172.21.15.33:0/1832103774 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f810c15dfe0 msgr2=0x7f810c06f630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:59.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.827+0000 7f8111509640 1 --2- 172.21.15.33:0/1832103774 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f810c15dfe0 0x7f810c06f630 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f810c0b4530 tx=0x7f80fc02a140 comp rx=0 tx=0).stop 2024-05-08T10:54:59.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.827+0000 7f8111509640 1 -- 172.21.15.33:0/1832103774 shutdown_connections 2024-05-08T10:54:59.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.827+0000 7f8111509640 1 --2- 172.21.15.33:0/1832103774 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f810c15dfe0 0x7f810c06f630 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:59.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.827+0000 7f8111509640 1 --2- 172.21.15.33:0/1832103774 >> v2:172.21.15.174:3300/0 conn(0x7f810c06e960 0x7f810c06f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:59.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.827+0000 7f8111509640 1 --2- 172.21.15.33:0/1832103774 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f810c15dc00 0x7f810c0d0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:59.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.827+0000 7f8111509640 1 -- 172.21.15.33:0/1832103774 >> 172.21.15.33:0/1832103774 conn(0x7f810c0d1940 msgr2=0x7f810c0d1d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:54:59.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.827+0000 7f8111509640 1 -- 172.21.15.33:0/1832103774 shutdown_connections 2024-05-08T10:54:59.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.827+0000 7f8111509640 1 -- 172.21.15.33:0/1832103774 wait complete. 2024-05-08T10:54:59.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.828+0000 7f8111509640 1 Processor -- start 2024-05-08T10:54:59.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.828+0000 7f8111509640 1 -- start start 2024-05-08T10:54:59.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.829+0000 7f8111509640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f810c06e960 0x7f810c151de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:59.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.829+0000 7f8111509640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f810c15dc00 0x7f810c0b51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:59.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.829+0000 7f8111509640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f810c15dfe0 0x7f810c15f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:59.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.829+0000 7f8111509640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f810c0d0d50 con 0x7f810c15dfe0 2024-05-08T10:54:59.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.829+0000 7f8111509640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f810c0d0bd0 con 0x7f810c15dc00 2024-05-08T10:54:59.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.829+0000 7f8111509640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f810c161a00 con 0x7f810c06e960 2024-05-08T10:54:59.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.829+0000 7f810b7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f810c15dfe0 0x7f810c15f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:59.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.829+0000 7f810b7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f810c15dfe0 0x7f810c15f1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37452/0 (socket says 172.21.15.33:37452) 2024-05-08T10:54:59.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.829+0000 7f810b7fe640 1 -- 172.21.15.33:0/1563556024 learned_addr learned my addr 172.21.15.33:0/1563556024 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:54:59.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.829+0000 7f810affd640 1 --2- 172.21.15.33:0/1563556024 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f810c06e960 0x7f810c151de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:59.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.829+0000 7f810a7fc640 1 --2- 172.21.15.33:0/1563556024 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f810c15dc00 0x7f810c0b51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:59.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.830+0000 7f810b7fe640 1 -- 172.21.15.33:0/1563556024 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f810c06e960 msgr2=0x7f810c151de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:59.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.830+0000 7f810b7fe640 1 --2- 172.21.15.33:0/1563556024 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f810c06e960 0x7f810c151de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:59.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.830+0000 7f810b7fe640 1 -- 172.21.15.33:0/1563556024 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f810c15dc00 msgr2=0x7f810c0b51a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:54:59.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.830+0000 7f810b7fe640 1 --2- 172.21.15.33:0/1563556024 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f810c15dc00 0x7f810c0b51a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:54:59.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.830+0000 7f810b7fe640 1 -- 172.21.15.33:0/1563556024 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f810c0c5510 con 0x7f810c15dfe0 2024-05-08T10:54:59.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.830+0000 7f810b7fe640 1 --2- 172.21.15.33:0/1563556024 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f810c15dfe0 0x7f810c15f1d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f80fc0090b0 tx=0x7f80fc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:54:59.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.830+0000 7f81037fe640 1 -- 172.21.15.33:0/1563556024 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80fc041070 con 0x7f810c15dfe0 2024-05-08T10:54:59.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.830+0000 7f81037fe640 1 -- 172.21.15.33:0/1563556024 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80fc03c950 con 0x7f810c15dfe0 2024-05-08T10:54:59.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.830+0000 7f8111509640 1 -- 172.21.15.33:0/1563556024 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f810c0c57f0 con 0x7f810c15dfe0 2024-05-08T10:54:59.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.830+0000 7f81037fe640 1 -- 172.21.15.33:0/1563556024 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80fc037040 con 0x7f810c15dfe0 2024-05-08T10:54:59.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.830+0000 7f8111509640 1 -- 172.21.15.33:0/1563556024 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f810c0c5db0 con 0x7f810c15dfe0 2024-05-08T10:54:59.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.831+0000 7f8111509640 1 -- 172.21.15.33:0/1563556024 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f810c069d20 con 0x7f810c15dfe0 2024-05-08T10:54:59.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.832+0000 7f81037fe640 1 -- 172.21.15.33:0/1563556024 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f80fc044070 con 0x7f810c15dfe0 2024-05-08T10:54:59.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.832+0000 7f81037fe640 1 --2- 172.21.15.33:0/1563556024 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f80ec06b4d0 0x7f80ec06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:54:59.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.832+0000 7f81037fe640 1 -- 172.21.15.33:0/1563556024 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f80fc0aad20 con 0x7f810c15dfe0 2024-05-08T10:54:59.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.832+0000 7f810affd640 1 --2- 172.21.15.33:0/1563556024 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f80ec06b4d0 0x7f80ec06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:54:59.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.833+0000 7f810affd640 1 --2- 172.21.15.33:0/1563556024 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f80ec06b4d0 0x7f80ec06d990 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f810400f400 tx=0x7f81040077b0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:54:59.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:54:59.836+0000 7f81037fe640 1 -- 172.21.15.33:0/1563556024 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f80fc079670 con 0x7f810c15dfe0 2024-05-08T10:55:00.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.016+0000 7f8111509640 1 -- 172.21.15.33:0/1563556024 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f810c0d11c0 con 0x7f810c15dfe0 2024-05-08T10:55:00.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.017+0000 7f81037fe640 1 -- 172.21.15.33:0/1563556024 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16617 (secure 0 0 0) 0x7f80fc07d710 con 0x7f810c15dfe0 2024-05-08T10:55:00.015 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:55:00.015 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":20,"fsid":"963217b2-c375-4f5a-95cf-88e199dd38ff","created":"2024-05-08T10:54:26.711528+0000","modified":"2024-05-08T10:54:51.528856+0000","last_up_change":"2024-05-08T10:54:37.987478+0000","last_in_change":"2024-05-08T10:54:28.834106+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T10:54:38.989228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T10:54:47.774236+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T10:54:48.869679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c5da4fb5-d4f2-4982-a804-2aa92fe77731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3990629207},{"type":"v1","addr":"172.21.15.33:6817","nonce":3990629207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3990629207},{"type":"v1","addr":"172.21.15.33:6819","nonce":3990629207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3990629207},{"type":"v1","addr":"172.21.15.33:6823","nonce":3990629207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3990629207},{"type":"v1","addr":"172.21.15.33:6821","nonce":3990629207}]},"public_addr":"172.21.15.33:6817/3990629207","cluster_addr":"172.21.15.33:6819/3990629207","heartbeat_back_addr":"172.21.15.33:6823/3990629207","heartbeat_front_addr":"172.21.15.33:6821/3990629207","state":["exists","up"]},{"osd":1,"uuid":"f8fdd8db-c2a3-4d28-81f3-b30f44bea7c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":1758076090},{"type":"v1","addr":"172.21.15.33:6825","nonce":1758076090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":1758076090},{"type":"v1","addr":"172.21.15.33:6827","nonce":1758076090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":1758076090},{"type":"v1","addr":"172.21.15.33:6831","nonce":1758076090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":1758076090},{"type":"v1","addr":"172.21.15.33:6829","nonce":1758076090}]},"public_addr":"172.21.15.33:6825/1758076090","cluster_addr":"172.21.15.33:6827/1758076090","heartbeat_back_addr":"172.21.15.33:6831/1758076090","heartbeat_front_addr":"172.21.15.33:6829/1758076090","state":["exists","up"]},{"osd":2,"uuid":"87d465f3-b40f-48dd-bae2-4c67904d4828","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":2940853479},{"type":"v1","addr":"172.21.15.33:6801","nonce":2940853479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6803","nonce":2940853479},{"type":"v1","addr":"172.21.15.33:6805","nonce":2940853479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6811","nonce":2940853479},{"type":"v1","addr":"172.21.15.33:6813","nonce":2940853479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6807","nonce":2940853479},{"type":"v1","addr":"172.21.15.33:6809","nonce":2940853479}]},"public_addr":"172.21.15.33:6801/2940853479","cluster_addr":"172.21.15.33:6805/2940853479","heartbeat_back_addr":"172.21.15.33:6813/2940853479","heartbeat_front_addr":"172.21.15.33:6809/2940853479","state":["exists","up"]},{"osd":3,"uuid":"79450edf-9637-4181-9372-e1cd5e91e73e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":4029047077},{"type":"v1","addr":"172.21.15.33:6804","nonce":4029047077}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":4029047077},{"type":"v1","addr":"172.21.15.33:6808","nonce":4029047077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":4029047077},{"type":"v1","addr":"172.21.15.33:6815","nonce":4029047077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":4029047077},{"type":"v1","addr":"172.21.15.33:6812","nonce":4029047077}]},"public_addr":"172.21.15.33:6804/4029047077","cluster_addr":"172.21.15.33:6808/4029047077","heartbeat_back_addr":"172.21.15.33:6815/4029047077","heartbeat_front_addr":"172.21.15.33:6812/4029047077","state":["exists","up"]},{"osd":4,"uuid":"bd0debfa-e559-4b1e-920d-6b2639c7085e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":1697399220},{"type":"v1","addr":"172.21.15.174:6801","nonce":1697399220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":1697399220},{"type":"v1","addr":"172.21.15.174:6803","nonce":1697399220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":1697399220},{"type":"v1","addr":"172.21.15.174:6807","nonce":1697399220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":1697399220},{"type":"v1","addr":"172.21.15.174:6805","nonce":1697399220}]},"public_addr":"172.21.15.174:6801/1697399220","cluster_addr":"172.21.15.174:6803/1697399220","heartbeat_back_addr":"172.21.15.174:6807/1697399220","heartbeat_front_addr":"172.21.15.174:6805/1697399220","state":["exists","up"]},{"osd":5,"uuid":"ff0f51c0-672b-448f-9de1-b9305ce8c00d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":1511860729},{"type":"v1","addr":"172.21.15.174:6825","nonce":1511860729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":1511860729},{"type":"v1","addr":"172.21.15.174:6827","nonce":1511860729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":1511860729},{"type":"v1","addr":"172.21.15.174:6831","nonce":1511860729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":1511860729},{"type":"v1","addr":"172.21.15.174:6829","nonce":1511860729}]},"public_addr":"172.21.15.174:6825/1511860729","cluster_addr":"172.21.15.174:6827/1511860729","heartbeat_back_addr":"172.21.15.174:6831/1511860729","heartbeat_front_addr":"172.21.15.174:6829/1511860729","state":["exists","up"]},{"osd":6,"uuid":"93061f6c-c0ce-47e9-88a0-1151c5ccb4e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":2326407945},{"type":"v1","addr":"172.21.15.174:6817","nonce":2326407945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":2326407945},{"type":"v1","addr":"172.21.15.174:6819","nonce":2326407945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":2326407945},{"type":"v1","addr":"172.21.15.174:6823","nonce":2326407945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":2326407945},{"type":"v1","addr":"172.21.15.174:6821","nonce":2326407945}]},"public_addr":"172.21.15.174:6817/2326407945","cluster_addr":"172.21.15.174:6819/2326407945","heartbeat_back_addr":"172.21.15.174:6823/2326407945","heartbeat_front_addr":"172.21.15.174:6821/2326407945","state":["exists","up"]},{"osd":7,"uuid":"7be1dcf3-1957-4ec3-bacf-f5f9fff580a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":1637570253},{"type":"v1","addr":"172.21.15.174:6809","nonce":1637570253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":1637570253},{"type":"v1","addr":"172.21.15.174:6811","nonce":1637570253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":1637570253},{"type":"v1","addr":"172.21.15.174:6815","nonce":1637570253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":1637570253},{"type":"v1","addr":"172.21.15.174:6813","nonce":1637570253}]},"public_addr":"172.21.15.174:6809/1637570253","cluster_addr":"172.21.15.174:6811/1637570253","heartbeat_back_addr":"172.21.15.174:6815/1637570253","heartbeat_front_addr":"172.21.15.174:6813/1637570253","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:33.997709+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:34.016568+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:33.990484+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:33.980666+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:33.920609+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:34.005069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:34.018345+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:34.061646+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T10:55:00.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.019+0000 7f8111509640 1 -- 172.21.15.33:0/1563556024 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f80ec06b4d0 msgr2=0x7f80ec06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:00.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.019+0000 7f8111509640 1 --2- 172.21.15.33:0/1563556024 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f80ec06b4d0 0x7f80ec06d990 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f810400f400 tx=0x7f81040077b0 comp rx=0 tx=0).stop 2024-05-08T10:55:00.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.019+0000 7f8111509640 1 -- 172.21.15.33:0/1563556024 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f810c15dfe0 msgr2=0x7f810c15f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:00.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.019+0000 7f8111509640 1 --2- 172.21.15.33:0/1563556024 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f810c15dfe0 0x7f810c15f1d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f80fc0090b0 tx=0x7f80fc0046c0 comp rx=0 tx=0).stop 2024-05-08T10:55:00.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.019+0000 7f8111509640 1 -- 172.21.15.33:0/1563556024 shutdown_connections 2024-05-08T10:55:00.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.019+0000 7f8111509640 1 --2- 172.21.15.33:0/1563556024 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f80ec06b4d0 0x7f80ec06d990 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:00.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.019+0000 7f8111509640 1 --2- 172.21.15.33:0/1563556024 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f810c15dfe0 0x7f810c15f1d0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:00.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.019+0000 7f8111509640 1 --2- 172.21.15.33:0/1563556024 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f810c15dc00 0x7f810c0b51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:00.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.019+0000 7f8111509640 1 --2- 172.21.15.33:0/1563556024 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f810c06e960 0x7f810c151de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:00.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.019+0000 7f8111509640 1 -- 172.21.15.33:0/1563556024 >> 172.21.15.33:0/1563556024 conn(0x7f810c0d1940 msgr2=0x7f810c15cbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:00.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.019+0000 7f8111509640 1 -- 172.21.15.33:0/1563556024 shutdown_connections 2024-05-08T10:55:00.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.019+0000 7f8111509640 1 -- 172.21.15.33:0/1563556024 wait complete. 2024-05-08T10:55:00.027 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-05-08T10:55:00.028 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T10:55:00.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.134+0000 7fe92f97e640 1 Processor -- start 2024-05-08T10:55:00.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.134+0000 7fe92f97e640 1 -- start start 2024-05-08T10:55:00.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.135+0000 7fe92f97e640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe9280d2520 0x7fe9280d17e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.135+0000 7fe92f97e640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9280ce720 con 0x7fe9281613a0 2024-05-08T10:55:00.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.135+0000 7fe92f97e640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9280d12d0 con 0x7fe9280d4960 2024-05-08T10:55:00.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.135+0000 7fe92f97e640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9280cf010 con 0x7fe9280d2520 2024-05-08T10:55:00.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.135+0000 7fe92d71a640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fe9281613a0 0x7fe9280cf4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:43502/0 (socket says 172.21.15.33:43502) 2024-05-08T10:55:00.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.135+0000 7fe92d71a640 1 -- 172.21.15.33:0/1454056163 learned_addr learned my addr 172.21.15.33:0/1454056163 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-05-08T10:55:00.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.136+0000 7fe927fff640 1 -- 172.21.15.33:0/1454056163 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2528834356 0 0) 0x7fe9280ce720 con 0x7fe9281613a0 2024-05-08T10:55:00.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.136+0000 7fe927fff640 1 -- 172.21.15.33:0/1454056163 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe910003520 con 0x7fe9281613a0 2024-05-08T10:55:00.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.136+0000 7fe92df1b640 1 --2- 172.21.15.33:0/1454056163 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe9280d2520 0x7fe9280d17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.136+0000 7fe927fff640 1 -- 172.21.15.33:0/1454056163 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4067133376 0 0) 0x7fe910003520 con 0x7fe9281613a0 2024-05-08T10:55:00.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.136+0000 7fe927fff640 1 -- 172.21.15.33:0/1454056163 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe9280d2520 msgr2=0x7fe9280d17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:00.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.136+0000 7fe927fff640 1 --2- 172.21.15.33:0/1454056163 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe9280d2520 0x7fe9280d17e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:00.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.136+0000 7fe927fff640 1 -- 172.21.15.33:0/1454056163 >> v1:172.21.15.174:6789/0 conn(0x7fe9280d4960 legacy=0x7fe9280d1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:00.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.136+0000 7fe927fff640 1 -- 172.21.15.33:0/1454056163 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9280ce9c0 con 0x7fe9281613a0 2024-05-08T10:55:00.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.136+0000 7fe927fff640 1 -- 172.21.15.33:0/1454056163 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2948294915 0 0) 0x7fe920001690 con 0x7fe9281613a0 2024-05-08T10:55:00.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.136+0000 7fe927fff640 1 -- 172.21.15.33:0/1454056163 >> v1:172.21.15.33:6789/0 conn(0x7fe9281613a0 legacy=0x7fe9280cf4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:00.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.136+0000 7fe927fff640 1 --2- 172.21.15.33:0/1454056163 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe9280d2520 0x7fe9100039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.136+0000 7fe927fff640 1 --2- 172.21.15.33:0/1454056163 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe910003f60 0x7fe910004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.136+0000 7fe927fff640 1 --2- 172.21.15.33:0/1454056163 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe910004d40 0x7fe9100051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.136+0000 7fe927fff640 1 -- 172.21.15.33:0/1454056163 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9280cf010 con 0x7fe910004d40 2024-05-08T10:55:00.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.136+0000 7fe927fff640 1 -- 172.21.15.33:0/1454056163 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe91000baa0 con 0x7fe910003f60 2024-05-08T10:55:00.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.136+0000 7fe927fff640 1 -- 172.21.15.33:0/1454056163 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe91000bca0 con 0x7fe9280d2520 2024-05-08T10:55:00.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.136+0000 7fe92df1b640 1 --2- 172.21.15.33:0/1454056163 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe910004d40 0x7fe9100051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.136+0000 7fe92d71a640 1 --2- 172.21.15.33:0/1454056163 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe9280d2520 0x7fe9100039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.136+0000 7fe92cf19640 1 --2- 172.21.15.33:0/1454056163 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe910003f60 0x7fe910004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.136+0000 7fe92df1b640 1 -- 172.21.15.33:0/1454056163 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe9280d2520 msgr2=0x7fe9100039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:00.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.136+0000 7fe92df1b640 1 --2- 172.21.15.33:0/1454056163 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe9280d2520 0x7fe9100039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:00.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.136+0000 7fe92df1b640 1 -- 172.21.15.33:0/1454056163 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe910003f60 msgr2=0x7fe910004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:00.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.136+0000 7fe92df1b640 1 --2- 172.21.15.33:0/1454056163 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe910003f60 0x7fe910004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:00.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.136+0000 7fe92df1b640 1 -- 172.21.15.33:0/1454056163 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe910003520 con 0x7fe910004d40 2024-05-08T10:55:00.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.137+0000 7fe92df1b640 1 --2- 172.21.15.33:0/1454056163 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe910004d40 0x7fe9100051c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe918009f90 tx=0x7fe910005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dd32f0a102013e9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:00.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.137+0000 7fe927fff640 1 -- 172.21.15.33:0/1454056163 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe918009c10 con 0x7fe910004d40 2024-05-08T10:55:00.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.137+0000 7fe927fff640 1 -- 172.21.15.33:0/1454056163 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe918036070 con 0x7fe910004d40 2024-05-08T10:55:00.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.137+0000 7fe927fff640 1 -- 172.21.15.33:0/1454056163 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe918031850 con 0x7fe910004d40 2024-05-08T10:55:00.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.138+0000 7fe92f97e640 1 -- 172.21.15.33:0/1454056163 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe910004d40 msgr2=0x7fe9100051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:00.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.138+0000 7fe92f97e640 1 --2- 172.21.15.33:0/1454056163 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe910004d40 0x7fe9100051c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe918009f90 tx=0x7fe910005830 comp rx=0 tx=0).stop 2024-05-08T10:55:00.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.138+0000 7fe92df1b640 1 -- 172.21.15.33:0/1454056163 reap_dead start 2024-05-08T10:55:00.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.138+0000 7fe92f97e640 1 -- 172.21.15.33:0/1454056163 shutdown_connections 2024-05-08T10:55:00.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.138+0000 7fe92f97e640 1 -- 172.21.15.33:0/1454056163 >> 172.21.15.33:0/1454056163 conn(0x7fe9280d3c10 msgr2=0x7fe9280d4020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:00.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.138+0000 7fe92f97e640 1 -- 172.21.15.33:0/1454056163 shutdown_connections 2024-05-08T10:55:00.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.138+0000 7fe92f97e640 1 -- 172.21.15.33:0/1454056163 wait complete. 2024-05-08T10:55:00.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.139+0000 7fe92f97e640 1 Processor -- start 2024-05-08T10:55:00.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.139+0000 7fe92f97e640 1 -- start start 2024-05-08T10:55:00.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.140+0000 7fe92f97e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe910004d40 0x7fe92815c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.140+0000 7fe92f97e640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe9280a0e40 0x7fe92809f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.140+0000 7fe92f97e640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe92809f790 0x7fe9281e6d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.140+0000 7fe92f97e640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9280d0f80 con 0x7fe910004d40 2024-05-08T10:55:00.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.140+0000 7fe92f97e640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9280cfbb0 con 0x7fe92809f790 2024-05-08T10:55:00.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.140+0000 7fe92f97e640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe928161780 con 0x7fe9280a0e40 2024-05-08T10:55:00.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.140+0000 7fe92d71a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe910004d40 0x7fe92815c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.140+0000 7fe92d71a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe910004d40 0x7fe92815c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37474/0 (socket says 172.21.15.33:37474) 2024-05-08T10:55:00.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.140+0000 7fe92d71a640 1 -- 172.21.15.33:0/4294230334 learned_addr learned my addr 172.21.15.33:0/4294230334 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:00.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.140+0000 7fe92cf19640 1 --2- 172.21.15.33:0/4294230334 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe9280a0e40 0x7fe92809f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.140+0000 7fe92d71a640 1 -- 172.21.15.33:0/4294230334 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe9280a0e40 msgr2=0x7fe92809f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:00.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.140+0000 7fe92df1b640 1 --2- 172.21.15.33:0/4294230334 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe92809f790 0x7fe9281e6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.140+0000 7fe92d71a640 1 --2- 172.21.15.33:0/4294230334 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe9280a0e40 0x7fe92809f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:00.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.140+0000 7fe92d71a640 1 -- 172.21.15.33:0/4294230334 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe92809f790 msgr2=0x7fe9281e6d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:00.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.140+0000 7fe92d71a640 1 --2- 172.21.15.33:0/4294230334 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe92809f790 0x7fe9281e6d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:00.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.140+0000 7fe92d71a640 1 -- 172.21.15.33:0/4294230334 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe92809fdc0 con 0x7fe910004d40 2024-05-08T10:55:00.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.140+0000 7fe92df1b640 1 --2- 172.21.15.33:0/4294230334 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe92809f790 0x7fe9281e6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:55:00.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.140+0000 7fe92d71a640 1 --2- 172.21.15.33:0/4294230334 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe910004d40 0x7fe92815c770 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe920007290 tx=0x7fe920007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:00.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.140+0000 7fe925ffb640 1 -- 172.21.15.33:0/4294230334 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe92000f8e0 con 0x7fe910004d40 2024-05-08T10:55:00.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.140+0000 7fe92f97e640 1 -- 172.21.15.33:0/4294230334 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9280a00a0 con 0x7fe910004d40 2024-05-08T10:55:00.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.140+0000 7fe925ffb640 1 -- 172.21.15.33:0/4294230334 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe920018070 con 0x7fe910004d40 2024-05-08T10:55:00.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.140+0000 7fe925ffb640 1 -- 172.21.15.33:0/4294230334 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe92000fce0 con 0x7fe910004d40 2024-05-08T10:55:00.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.141+0000 7fe92f97e640 1 -- 172.21.15.33:0/4294230334 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9280a0660 con 0x7fe910004d40 2024-05-08T10:55:00.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.142+0000 7fe92f97e640 1 -- 172.21.15.33:0/4294230334 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe928069d20 con 0x7fe910004d40 2024-05-08T10:55:00.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.142+0000 7fe925ffb640 1 -- 172.21.15.33:0/4294230334 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe92001d460 con 0x7fe910004d40 2024-05-08T10:55:00.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.142+0000 7fe925ffb640 1 --2- 172.21.15.33:0/4294230334 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fe91406b4d0 0x7fe91406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.142+0000 7fe925ffb640 1 -- 172.21.15.33:0/4294230334 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe92008a2e0 con 0x7fe910004d40 2024-05-08T10:55:00.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.142+0000 7fe92cf19640 1 --2- 172.21.15.33:0/4294230334 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fe91406b4d0 0x7fe91406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.143+0000 7fe92cf19640 1 --2- 172.21.15.33:0/4294230334 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fe91406b4d0 0x7fe91406d990 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe91c007fd0 tx=0x7fe91c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:00.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.146+0000 7fe925ffb640 1 -- 172.21.15.33:0/4294230334 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe920059170 con 0x7fe910004d40 2024-05-08T10:55:00.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.326+0000 7fe92f97e640 1 -- 172.21.15.33:0/4294230334 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe92808d980 con 0x7fe910004d40 2024-05-08T10:55:00.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.328+0000 7fe925ffb640 1 -- 172.21.15.33:0/4294230334 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16617 (secure 0 0 0) 0x7fe920058a70 con 0x7fe910004d40 2024-05-08T10:55:00.325 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:55:00.325 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":20,"fsid":"963217b2-c375-4f5a-95cf-88e199dd38ff","created":"2024-05-08T10:54:26.711528+0000","modified":"2024-05-08T10:54:51.528856+0000","last_up_change":"2024-05-08T10:54:37.987478+0000","last_in_change":"2024-05-08T10:54:28.834106+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T10:54:38.989228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T10:54:47.774236+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T10:54:48.869679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c5da4fb5-d4f2-4982-a804-2aa92fe77731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3990629207},{"type":"v1","addr":"172.21.15.33:6817","nonce":3990629207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3990629207},{"type":"v1","addr":"172.21.15.33:6819","nonce":3990629207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3990629207},{"type":"v1","addr":"172.21.15.33:6823","nonce":3990629207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3990629207},{"type":"v1","addr":"172.21.15.33:6821","nonce":3990629207}]},"public_addr":"172.21.15.33:6817/3990629207","cluster_addr":"172.21.15.33:6819/3990629207","heartbeat_back_addr":"172.21.15.33:6823/3990629207","heartbeat_front_addr":"172.21.15.33:6821/3990629207","state":["exists","up"]},{"osd":1,"uuid":"f8fdd8db-c2a3-4d28-81f3-b30f44bea7c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":1758076090},{"type":"v1","addr":"172.21.15.33:6825","nonce":1758076090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":1758076090},{"type":"v1","addr":"172.21.15.33:6827","nonce":1758076090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":1758076090},{"type":"v1","addr":"172.21.15.33:6831","nonce":1758076090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":1758076090},{"type":"v1","addr":"172.21.15.33:6829","nonce":1758076090}]},"public_addr":"172.21.15.33:6825/1758076090","cluster_addr":"172.21.15.33:6827/1758076090","heartbeat_back_addr":"172.21.15.33:6831/1758076090","heartbeat_front_addr":"172.21.15.33:6829/1758076090","state":["exists","up"]},{"osd":2,"uuid":"87d465f3-b40f-48dd-bae2-4c67904d4828","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":2940853479},{"type":"v1","addr":"172.21.15.33:6801","nonce":2940853479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6803","nonce":2940853479},{"type":"v1","addr":"172.21.15.33:6805","nonce":2940853479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6811","nonce":2940853479},{"type":"v1","addr":"172.21.15.33:6813","nonce":2940853479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6807","nonce":2940853479},{"type":"v1","addr":"172.21.15.33:6809","nonce":2940853479}]},"public_addr":"172.21.15.33:6801/2940853479","cluster_addr":"172.21.15.33:6805/2940853479","heartbeat_back_addr":"172.21.15.33:6813/2940853479","heartbeat_front_addr":"172.21.15.33:6809/2940853479","state":["exists","up"]},{"osd":3,"uuid":"79450edf-9637-4181-9372-e1cd5e91e73e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":4029047077},{"type":"v1","addr":"172.21.15.33:6804","nonce":4029047077}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":4029047077},{"type":"v1","addr":"172.21.15.33:6808","nonce":4029047077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":4029047077},{"type":"v1","addr":"172.21.15.33:6815","nonce":4029047077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":4029047077},{"type":"v1","addr":"172.21.15.33:6812","nonce":4029047077}]},"public_addr":"172.21.15.33:6804/4029047077","cluster_addr":"172.21.15.33:6808/4029047077","heartbeat_back_addr":"172.21.15.33:6815/4029047077","heartbeat_front_addr":"172.21.15.33:6812/4029047077","state":["exists","up"]},{"osd":4,"uuid":"bd0debfa-e559-4b1e-920d-6b2639c7085e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":1697399220},{"type":"v1","addr":"172.21.15.174:6801","nonce":1697399220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":1697399220},{"type":"v1","addr":"172.21.15.174:6803","nonce":1697399220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":1697399220},{"type":"v1","addr":"172.21.15.174:6807","nonce":1697399220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":1697399220},{"type":"v1","addr":"172.21.15.174:6805","nonce":1697399220}]},"public_addr":"172.21.15.174:6801/1697399220","cluster_addr":"172.21.15.174:6803/1697399220","heartbeat_back_addr":"172.21.15.174:6807/1697399220","heartbeat_front_addr":"172.21.15.174:6805/1697399220","state":["exists","up"]},{"osd":5,"uuid":"ff0f51c0-672b-448f-9de1-b9305ce8c00d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":1511860729},{"type":"v1","addr":"172.21.15.174:6825","nonce":1511860729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":1511860729},{"type":"v1","addr":"172.21.15.174:6827","nonce":1511860729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":1511860729},{"type":"v1","addr":"172.21.15.174:6831","nonce":1511860729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":1511860729},{"type":"v1","addr":"172.21.15.174:6829","nonce":1511860729}]},"public_addr":"172.21.15.174:6825/1511860729","cluster_addr":"172.21.15.174:6827/1511860729","heartbeat_back_addr":"172.21.15.174:6831/1511860729","heartbeat_front_addr":"172.21.15.174:6829/1511860729","state":["exists","up"]},{"osd":6,"uuid":"93061f6c-c0ce-47e9-88a0-1151c5ccb4e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":2326407945},{"type":"v1","addr":"172.21.15.174:6817","nonce":2326407945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":2326407945},{"type":"v1","addr":"172.21.15.174:6819","nonce":2326407945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":2326407945},{"type":"v1","addr":"172.21.15.174:6823","nonce":2326407945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":2326407945},{"type":"v1","addr":"172.21.15.174:6821","nonce":2326407945}]},"public_addr":"172.21.15.174:6817/2326407945","cluster_addr":"172.21.15.174:6819/2326407945","heartbeat_back_addr":"172.21.15.174:6823/2326407945","heartbeat_front_addr":"172.21.15.174:6821/2326407945","state":["exists","up"]},{"osd":7,"uuid":"7be1dcf3-1957-4ec3-bacf-f5f9fff580a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":1637570253},{"type":"v1","addr":"172.21.15.174:6809","nonce":1637570253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":1637570253},{"type":"v1","addr":"172.21.15.174:6811","nonce":1637570253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":1637570253},{"type":"v1","addr":"172.21.15.174:6815","nonce":1637570253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":1637570253},{"type":"v1","addr":"172.21.15.174:6813","nonce":1637570253}]},"public_addr":"172.21.15.174:6809/1637570253","cluster_addr":"172.21.15.174:6811/1637570253","heartbeat_back_addr":"172.21.15.174:6815/1637570253","heartbeat_front_addr":"172.21.15.174:6813/1637570253","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:33.997709+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:34.016568+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:33.990484+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:33.980666+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:33.920609+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:34.005069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:34.018345+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:34.061646+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T10:55:00.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.330+0000 7fe92f97e640 1 -- 172.21.15.33:0/4294230334 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fe91406b4d0 msgr2=0x7fe91406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:00.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.330+0000 7fe92f97e640 1 --2- 172.21.15.33:0/4294230334 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fe91406b4d0 0x7fe91406d990 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe91c007fd0 tx=0x7fe91c009040 comp rx=0 tx=0).stop 2024-05-08T10:55:00.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.330+0000 7fe92f97e640 1 -- 172.21.15.33:0/4294230334 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe910004d40 msgr2=0x7fe92815c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:00.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.330+0000 7fe92f97e640 1 --2- 172.21.15.33:0/4294230334 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe910004d40 0x7fe92815c770 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe920007290 tx=0x7fe920007750 comp rx=0 tx=0).stop 2024-05-08T10:55:00.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.330+0000 7fe92f97e640 1 -- 172.21.15.33:0/4294230334 shutdown_connections 2024-05-08T10:55:00.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.330+0000 7fe92f97e640 1 --2- 172.21.15.33:0/4294230334 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fe91406b4d0 0x7fe91406d990 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:00.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.330+0000 7fe92f97e640 1 --2- 172.21.15.33:0/4294230334 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe92809f790 0x7fe9281e6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:00.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.330+0000 7fe92f97e640 1 --2- 172.21.15.33:0/4294230334 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe9280a0e40 0x7fe92809f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:00.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.330+0000 7fe92f97e640 1 --2- 172.21.15.33:0/4294230334 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe910004d40 0x7fe92815c770 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:00.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.330+0000 7fe92f97e640 1 -- 172.21.15.33:0/4294230334 >> 172.21.15.33:0/4294230334 conn(0x7fe9280d3c10 msgr2=0x7fe9280b1590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:00.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.330+0000 7fe92f97e640 1 -- 172.21.15.33:0/4294230334 shutdown_connections 2024-05-08T10:55:00.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.330+0000 7fe92f97e640 1 -- 172.21.15.33:0/4294230334 wait complete. 2024-05-08T10:55:00.338 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-05-08T10:55:00.339 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-05-08T10:55:00.339 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-05-08T10:55:00.339 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-05-08T10:55:00.340 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-05-08T10:55:00.340 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-05-08T10:55:00.340 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-05-08T10:55:00.341 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-05-08T10:55:00.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.522+0000 7fcf7c407640 1 Processor -- start 2024-05-08T10:55:00.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.522+0000 7fcf7c407640 1 -- start start 2024-05-08T10:55:00.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.524+0000 7fcf7c407640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcf7406b6c0 0x7fcf7415b640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.524+0000 7fcf7c407640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fcf7415ae30 0x7fcf740d0310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.524+0000 7fcf7c407640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf7415b450 con 0x7fcf740cfe90 2024-05-08T10:55:00.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.524+0000 7fcf7c407640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf740713c0 con 0x7fcf7415ae30 2024-05-08T10:55:00.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.524+0000 7fcf7c407640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf74070a90 con 0x7fcf7406b6c0 2024-05-08T10:55:00.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.524+0000 7fcf7a9a4640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fcf7415ae30 0x7fcf740d0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.524+0000 7f670a4d2640 1 Processor -- start 2024-05-08T10:55:00.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.524+0000 7fcf7a9a4640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fcf7415ae30 0x7fcf740d0310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37488/0 (socket says 172.21.15.33:37488) 2024-05-08T10:55:00.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.524+0000 7fcf7a9a4640 1 -- 172.21.15.33:0/1209992983 learned_addr learned my addr 172.21.15.33:0/1209992983 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:00.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.524+0000 7fcf7a1a3640 1 --2- 172.21.15.33:0/1209992983 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcf7406b6c0 0x7fcf7415b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.524+0000 7f4784c99640 1 Processor -- start 2024-05-08T10:55:00.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.524+0000 7f4784c99640 1 -- start start 2024-05-08T10:55:00.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.524+0000 7f670a4d2640 1 -- start start 2024-05-08T10:55:00.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.525+0000 7fd71d597640 1 Processor -- start 2024-05-08T10:55:00.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.525+0000 7fd71d597640 1 -- start start 2024-05-08T10:55:00.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.525+0000 7f4784c99640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f478015a960 0x7f478015e320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.526+0000 7fcf7a9a4640 1 -- 172.21.15.33:0/1209992983 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcf7406b6c0 msgr2=0x7fcf7415b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:00.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.526+0000 7fcf7a9a4640 1 --2- 172.21.15.33:0/1209992983 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcf7406b6c0 0x7fcf7415b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:00.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.526+0000 7fcf791a1640 1 -- 172.21.15.33:0/1209992983 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3267285595 0 0) 0x7fcf7415b450 con 0x7fcf740cfe90 2024-05-08T10:55:00.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.526+0000 7f4784c99640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f478006d3c0 con 0x7f47800cfe40 2024-05-08T10:55:00.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.526+0000 7fcf7a9a4640 1 -- 172.21.15.33:0/1209992983 >> v1:172.21.15.174:6789/0 conn(0x7fcf740cfe90 legacy=0x7fcf7415a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:00.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.526+0000 7fcf7a9a4640 1 -- 172.21.15.33:0/1209992983 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf74070d70 con 0x7fcf7415ae30 2024-05-08T10:55:00.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.526+0000 7fdfa60c4640 1 Processor -- start 2024-05-08T10:55:00.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.526+0000 7f4784c99640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f478015e900 con 0x7f4780071a80 2024-05-08T10:55:00.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.526+0000 7f477f7fe640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f478015a960 0x7f478015e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.526+0000 7f4784c99640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47800d02a0 con 0x7f478015a960 2024-05-08T10:55:00.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.526+0000 7f477ffff640 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f4780071a80 0x7f478006d870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.33:47874/0 (socket says 172.21.15.33:47874) 2024-05-08T10:55:00.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.526+0000 7f477ffff640 1 -- 172.21.15.33:0/2063358990 learned_addr learned my addr 172.21.15.33:0/2063358990 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-05-08T10:55:00.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.526+0000 7f477f7fe640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f478015a960 0x7f478015e320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37500/0 (socket says 172.21.15.33:37500) 2024-05-08T10:55:00.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.526+0000 7f670a4d2640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f66fc0df800 0x7f66fc055d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.526+0000 7f8f51c1f640 1 Processor -- start 2024-05-08T10:55:00.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.526+0000 7fdfa60c4640 1 -- start start 2024-05-08T10:55:00.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.526+0000 7f477e7fc640 1 -- 172.21.15.33:0/2063358990 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3180660275 0 0) 0x7f478015e900 con 0x7f4780071a80 2024-05-08T10:55:00.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.526+0000 7f477e7fc640 1 -- 172.21.15.33:0/2063358990 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4768003520 con 0x7f4780071a80 2024-05-08T10:55:00.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.526+0000 7f670a4d2640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f66fc0366a0 0x7f66fc04fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.526+0000 7f6703fff640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f66fc0df800 0x7f66fc055d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.526+0000 7fd71d597640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fd718142fb0 0x7fd7180702c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.526+0000 7fd71d597640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd71815b0a0 con 0x7fd718143500 2024-05-08T10:55:00.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.526+0000 7fd71d597640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd71815b380 con 0x7fd7180d0120 2024-05-08T10:55:00.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.526+0000 7fd71d597640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd718160c20 con 0x7fd718142fb0 2024-05-08T10:55:00.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.526+0000 7f6703fff640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f66fc0df800 0x7f66fc055d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.33:49878/0 (socket says 172.21.15.33:49878) 2024-05-08T10:55:00.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.526+0000 7f6703fff640 1 -- 172.21.15.33:0/3009630289 learned_addr learned my addr 172.21.15.33:0/3009630289 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:00.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.527+0000 7fd7177fe640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fd718142fb0 0x7fd7180702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.527+0000 7f670a4d2640 1 -- 172.21.15.33:0/3009630289 --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66fc006c30 con 0x7f66fc03a0a0 2024-05-08T10:55:00.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.527+0000 7f670a4d2640 1 -- 172.21.15.33:0/3009630289 --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66fc006f10 con 0x7f66fc0366a0 2024-05-08T10:55:00.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.527+0000 7fa6db684640 1 Processor -- start 2024-05-08T10:55:00.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.527+0000 7f477e7fc640 1 -- 172.21.15.33:0/2063358990 <== mon.1 v1:172.21.15.174:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3729344195 0 0) 0x7f4768003520 con 0x7f4780071a80 2024-05-08T10:55:00.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.527+0000 7f477e7fc640 1 -- 172.21.15.33:0/2063358990 >> v2:172.21.15.33:3300/0 conn(0x7f478015a960 msgr2=0x7f478015e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:00.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.527+0000 7f477e7fc640 1 --2- 172.21.15.33:0/2063358990 >> v2:172.21.15.33:3300/0 conn(0x7f478015a960 0x7f478015e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:00.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.527+0000 7f477e7fc640 1 -- 172.21.15.33:0/2063358990 >> v1:172.21.15.33:6789/0 conn(0x7f47800cfe40 legacy=0x7f4780071370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:00.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.527+0000 7f477e7fc640 1 -- 172.21.15.33:0/2063358990 --> v1:172.21.15.174:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f478015ebe0 con 0x7f4780071a80 2024-05-08T10:55:00.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.527+0000 7f477e7fc640 1 -- 172.21.15.33:0/2063358990 <== mon.1 v1:172.21.15.174:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2948294915 0 0) 0x7f47780019f0 con 0x7f4780071a80 2024-05-08T10:55:00.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.527+0000 7f477e7fc640 1 -- 172.21.15.33:0/2063358990 >> v1:172.21.15.174:6789/0 conn(0x7f4780071a80 legacy=0x7f478006d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:00.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.527+0000 7f477e7fc640 1 --2- 172.21.15.33:0/2063358990 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f47680039b0 0x7f4768003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.527+0000 7f477e7fc640 1 --2- 172.21.15.33:0/2063358990 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4768004800 0x7f4768004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.527+0000 7f477e7fc640 1 --2- 172.21.15.33:0/2063358990 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47680051c0 0x7f47680141d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.527+0000 7f477e7fc640 1 -- 172.21.15.33:0/2063358990 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47800d02a0 con 0x7f47680051c0 2024-05-08T10:55:00.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.527+0000 7f477e7fc640 1 -- 172.21.15.33:0/2063358990 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4768014870 con 0x7f47680039b0 2024-05-08T10:55:00.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.527+0000 7f477e7fc640 1 -- 172.21.15.33:0/2063358990 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4768014a70 con 0x7f4768004800 2024-05-08T10:55:00.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.527+0000 7f67037fe640 1 --2- 172.21.15.33:0/3009630289 >> v2:172.21.15.33:3300/0 conn(0x7f66fc0366a0 0x7f66fc04fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.526+0000 7f8f51c1f640 1 -- start start 2024-05-08T10:55:00.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.527+0000 7f670a4d2640 1 -- 172.21.15.33:0/3009630289 --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66fc0071f0 con 0x7f66fc0df800 2024-05-08T10:55:00.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.527+0000 7fd71cd96640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fd718143500 0x7fd7180cdca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:43520/0 (socket says 172.21.15.33:43520) 2024-05-08T10:55:00.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.527+0000 7fd71cd96640 1 -- 172.21.15.33:0/2676897978 learned_addr learned my addr 172.21.15.33:0/2676897978 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-05-08T10:55:00.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.527+0000 7f6702ffd640 1 -- 172.21.15.33:0/3009630289 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2691908361 0 0) 0x7f66fc006c30 con 0x7f66fc03a0a0 2024-05-08T10:55:00.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.527+0000 7f477effd640 1 --2- 172.21.15.33:0/2063358990 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4768004800 0x7f4768004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.527+0000 7f477ffff640 1 --2- 172.21.15.33:0/2063358990 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47680051c0 0x7f47680141d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.527+0000 7f6702ffd640 1 -- 172.21.15.33:0/3009630289 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66f4003520 con 0x7f66fc03a0a0 2024-05-08T10:55:00.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.527+0000 7f477f7fe640 1 --2- 172.21.15.33:0/2063358990 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f47680039b0 0x7f4768003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.527+0000 7fa6db684640 1 -- start start 2024-05-08T10:55:00.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.528+0000 7f6703fff640 1 -- 172.21.15.33:0/3009630289 >> v2:172.21.15.33:3300/0 conn(0x7f66fc0366a0 msgr2=0x7f66fc04fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:00.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.528+0000 7f6703fff640 1 --2- 172.21.15.33:0/3009630289 >> v2:172.21.15.33:3300/0 conn(0x7f66fc0366a0 0x7f66fc04fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:00.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.528+0000 7f6703fff640 1 -- 172.21.15.33:0/3009630289 >> v1:172.21.15.174:6789/0 conn(0x7f66fc03a0a0 legacy=0x7f66fc03a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:00.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.528+0000 7f6703fff640 1 -- 172.21.15.33:0/3009630289 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66fc0074d0 con 0x7f66fc0df800 2024-05-08T10:55:00.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.528+0000 7fd716ffd640 1 -- 172.21.15.33:0/2676897978 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1106379221 0 0) 0x7fd71815b0a0 con 0x7fd718143500 2024-05-08T10:55:00.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.528+0000 7fd716ffd640 1 -- 172.21.15.33:0/2676897978 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd704003520 con 0x7fd718143500 2024-05-08T10:55:00.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.528+0000 7fd716ffd640 1 -- 172.21.15.33:0/2676897978 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1455791801 0 0) 0x7fd71815b380 con 0x7fd7180d0120 2024-05-08T10:55:00.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.528+0000 7fd7177fe640 1 -- 172.21.15.33:0/2676897978 >> v1:172.21.15.174:6789/0 conn(0x7fd7180d0120 legacy=0x7fd7180cb460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:00.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.528+0000 7fd7177fe640 1 -- 172.21.15.33:0/2676897978 >> v1:172.21.15.33:6789/0 conn(0x7fd718143500 legacy=0x7fd7180cdca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:00.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.528+0000 7f8f51c1f640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f8f440ead00 0x7f8f4404fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.528+0000 7f8f51c1f640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8f4404ffd0 0x7f8f44037bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.528+0000 7f8f51c1f640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f8f44038110 0x7f8f440385a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.528+0000 7f8f51c1f640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f44054330 con 0x7f8f440ead00 2024-05-08T10:55:00.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.528+0000 7f8f51c1f640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f44053720 con 0x7f8f44038110 2024-05-08T10:55:00.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.528+0000 7f8f51c1f640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f44053a00 con 0x7f8f4404ffd0 2024-05-08T10:55:00.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.528+0000 7fdfa60c4640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fdf98050140 0x7fdf98038170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.528+0000 7fd7177fe640 1 -- 172.21.15.33:0/2676897978 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7180cd4a0 con 0x7fd718142fb0 2024-05-08T10:55:00.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.528+0000 7fdfa60c4640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdf980df410 0x7fdf98006a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.528+0000 7f477effd640 1 -- 172.21.15.33:0/2063358990 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f47680039b0 msgr2=0x7f4768003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:00.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.528+0000 7f477effd640 1 --2- 172.21.15.33:0/2063358990 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f47680039b0 0x7f4768003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:00.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.528+0000 7f477effd640 1 -- 172.21.15.33:0/2063358990 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47680051c0 msgr2=0x7f47680141d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:00.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.528+0000 7f477effd640 1 --2- 172.21.15.33:0/2063358990 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47680051c0 0x7f47680141d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:00.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.528+0000 7f477effd640 1 -- 172.21.15.33:0/2063358990 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f478015ebe0 con 0x7f4768004800 2024-05-08T10:55:00.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.529+0000 7f477f7fe640 1 --2- 172.21.15.33:0/2063358990 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f47680039b0 0x7f4768003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:55:00.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.528+0000 7fa6db684640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fa6d415f1a0 0x7fa6d40b4880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.528+0000 7fa6db684640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa6d415f580 0x7fa6d40ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.529+0000 7fa6db684640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa6d40b29c0 0x7fa6d40cfdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.529+0000 7fa6db684640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6d406dcc0 con 0x7fa6d415f1a0 2024-05-08T10:55:00.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.529+0000 7fa6db684640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6d40b4340 con 0x7fa6d40b29c0 2024-05-08T10:55:00.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.529+0000 7fa6db684640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d40cd570 con 0x7fa6d415f580 2024-05-08T10:55:00.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.529+0000 7f477ffff640 1 -- 172.21.15.33:0/2063358990 reap_dead start 2024-05-08T10:55:00.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.529+0000 7fcf7a9a4640 1 --2- 172.21.15.33:0/1209992983 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf7415ae30 0x7fcf740d0310 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fcf64009870 tx=0x7fcf6402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e2c9debedb7c799 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:00.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.529+0000 7fa6d9c21640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa6d40b29c0 0x7fa6d40cfdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.529+0000 7f8f4bfff640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f8f44038110 0x7f8f440385a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.529+0000 7fa6d9c21640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa6d40b29c0 0x7fa6d40cfdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.33:49904/0 (socket says 172.21.15.33:49904) 2024-05-08T10:55:00.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.529+0000 7fa6d9c21640 1 -- 172.21.15.33:0/3888620596 learned_addr learned my addr 172.21.15.33:0/3888620596 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:00.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.529+0000 7f8f4bfff640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f8f44038110 0x7f8f440385a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.33:49896/0 (socket says 172.21.15.33:49896) 2024-05-08T10:55:00.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.529+0000 7f8f4bfff640 1 -- 172.21.15.33:0/3428098083 learned_addr learned my addr 172.21.15.33:0/3428098083 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:00.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.528+0000 7fdf9f7fe640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fdf980df030 0x7fdf9804fa30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:43526/0 (socket says 172.21.15.33:43526) 2024-05-08T10:55:00.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.529+0000 7fdfa60c4640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf98005f60 con 0x7fdf980df030 2024-05-08T10:55:00.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.529+0000 7fdfa60c4640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf980e38e0 con 0x7fdf98050140 2024-05-08T10:55:00.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.529+0000 7fdfa60c4640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf98006200 con 0x7fdf980df410 2024-05-08T10:55:00.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.528+0000 7fdf9effd640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fdf98050140 0x7fdf98038170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.529+0000 7fa6d9420640 1 --2- 172.21.15.33:0/3888620596 >> v2:172.21.15.33:3300/0 conn(0x7fa6d415f1a0 0x7fa6d40b4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.529+0000 7f8f4affd640 1 --2- 172.21.15.33:0/3428098083 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8f4404ffd0 0x7f8f44037bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.529+0000 7f8f4bfff640 1 -- 172.21.15.33:0/3428098083 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8f4404ffd0 msgr2=0x7f8f44037bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:00.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.529+0000 7f8f4bfff640 1 --2- 172.21.15.33:0/3428098083 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8f4404ffd0 0x7f8f44037bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:00.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.529+0000 7f8f4bfff640 1 -- 172.21.15.33:0/3428098083 >> v2:172.21.15.33:3300/0 conn(0x7f8f440ead00 msgr2=0x7f8f4404fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:00.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.529+0000 7f8f4bfff640 1 --2- 172.21.15.33:0/3428098083 >> v2:172.21.15.33:3300/0 conn(0x7f8f440ead00 0x7f8f4404fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:00.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.529+0000 7f14a9dd6640 1 Processor -- start 2024-05-08T10:55:00.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.529+0000 7f14a9dd6640 1 -- start start 2024-05-08T10:55:00.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.529+0000 7fdf9effd640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fdf98050140 0x7fdf98038170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37538/0 (socket says 172.21.15.33:37538) 2024-05-08T10:55:00.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.529+0000 7fdf9effd640 1 -- 172.21.15.33:0/1455545046 learned_addr learned my addr 172.21.15.33:0/1455545046 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:00.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.529+0000 7fdf9ffff640 1 --2- 172.21.15.33:0/1455545046 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdf980df410 0x7fdf98006a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.529+0000 7f477effd640 1 --2- 172.21.15.33:0/2063358990 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4768004800 0x7f4768004c80 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f4770001750 tx=0x7f4768005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7b3bfb1c50d7f264 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:00.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.529+0000 7fa6d9c21640 1 -- 172.21.15.33:0/3888620596 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa6d415f580 msgr2=0x7fa6d40ccf00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T10:55:00.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.529+0000 7fa6d8c1f640 1 --2- 172.21.15.33:0/3888620596 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa6d415f580 0x7fa6d40ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.529+0000 7f8f4bfff640 1 -- 172.21.15.33:0/3428098083 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f44053ce0 con 0x7f8f44038110 2024-05-08T10:55:00.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.529+0000 7fa6d9c21640 1 --2- 172.21.15.33:0/3888620596 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa6d415f580 0x7fa6d40ccf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:00.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.529+0000 7fa6d9c21640 1 -- 172.21.15.33:0/3888620596 >> v2:172.21.15.33:3300/0 conn(0x7fa6d415f1a0 msgr2=0x7fa6d40b4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:00.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.529+0000 7fa6d9c21640 1 --2- 172.21.15.33:0/3888620596 >> v2:172.21.15.33:3300/0 conn(0x7fa6d415f1a0 0x7fa6d40b4880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:00.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.529+0000 7fa6d9c21640 1 -- 172.21.15.33:0/3888620596 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6d40cd850 con 0x7fa6d40b29c0 2024-05-08T10:55:00.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.529+0000 7fa6d9420640 1 --2- 172.21.15.33:0/3888620596 >> v2:172.21.15.33:3300/0 conn(0x7fa6d415f1a0 0x7fa6d40b4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T10:55:00.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.530+0000 7fd7177fe640 1 --2- 172.21.15.33:0/2676897978 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd718142fb0 0x7fd7180702c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd7080097a0 tx=0x7fd70802a2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fed9e2a329f90550 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:00.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.530+0000 7fcf791a1640 1 -- 172.21.15.33:0/1209992983 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf64037070 con 0x7fcf7415ae30 2024-05-08T10:55:00.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.529+0000 7f6703fff640 1 --2- 172.21.15.33:0/3009630289 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f66fc0df800 0x7f66fc055d10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6704062820 tx=0x7f67040a5180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c6fc2b3e8f2d00a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:00.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.530+0000 7f6702ffd640 1 -- 172.21.15.33:0/3009630289 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67040b2070 con 0x7f66fc0df800 2024-05-08T10:55:00.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.530+0000 7f6702ffd640 1 -- 172.21.15.33:0/3009630289 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67040ad440 con 0x7f66fc0df800 2024-05-08T10:55:00.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.530+0000 7f6702ffd640 1 -- 172.21.15.33:0/3009630289 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67040ad870 con 0x7f66fc0df800 2024-05-08T10:55:00.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.530+0000 7fcf791a1640 1 -- 172.21.15.33:0/1209992983 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf64032440 con 0x7fcf7415ae30 2024-05-08T10:55:00.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.530+0000 7fd716ffd640 1 -- 172.21.15.33:0/2676897978 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd708037070 con 0x7fd718142fb0 2024-05-08T10:55:00.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.530+0000 7f477e7fc640 1 -- 172.21.15.33:0/2063358990 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4770001370 con 0x7f4768004800 2024-05-08T10:55:00.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.530+0000 7f477e7fc640 1 -- 172.21.15.33:0/2063358990 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47700052f0 con 0x7f4768004800 2024-05-08T10:55:00.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.530+0000 7f477e7fc640 1 -- 172.21.15.33:0/2063358990 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f477002ab40 con 0x7f4768004800 2024-05-08T10:55:00.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.530+0000 7fd716ffd640 1 -- 172.21.15.33:0/2676897978 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd708032640 con 0x7fd718142fb0 2024-05-08T10:55:00.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.530+0000 7fd716ffd640 1 -- 172.21.15.33:0/2676897978 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd708037070 con 0x7fd718142fb0 2024-05-08T10:55:00.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.530+0000 7fdf9effd640 1 -- 172.21.15.33:0/1455545046 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdf980df410 msgr2=0x7fdf98006a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:00.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.530+0000 7fdf9effd640 1 --2- 172.21.15.33:0/1455545046 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdf980df410 0x7fdf98006a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:00.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.530+0000 7fdf9effd640 1 -- 172.21.15.33:0/1455545046 >> v1:172.21.15.33:6789/0 conn(0x7fdf980df030 legacy=0x7fdf9804fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:00.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.530+0000 7fdf9effd640 1 -- 172.21.15.33:0/1455545046 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf980064e0 con 0x7fdf98050140 2024-05-08T10:55:00.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.530+0000 7f8f4bfff640 1 --2- 172.21.15.33:0/3428098083 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8f44038110 0x7f8f440385a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8f4400bd00 tx=0x7f8f3802a1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=30590fac8cc48241 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:00.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.530+0000 7fcf791a1640 1 -- 172.21.15.33:0/1209992983 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf64032810 con 0x7fcf7415ae30 2024-05-08T10:55:00.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.531+0000 7f670a4d2640 1 -- 172.21.15.33:0/3009630289 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f66fc0df800 msgr2=0x7f66fc055d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:00.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.531+0000 7f670a4d2640 1 --2- 172.21.15.33:0/3009630289 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f66fc0df800 0x7f66fc055d10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6704062820 tx=0x7f67040a5180 comp rx=0 tx=0).stop 2024-05-08T10:55:00.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.531+0000 7f670a4d2640 1 -- 172.21.15.33:0/3009630289 shutdown_connections 2024-05-08T10:55:00.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.531+0000 7f8f4a7fc640 1 -- 172.21.15.33:0/3428098083 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f38037070 con 0x7f8f44038110 2024-05-08T10:55:00.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.531+0000 7f14a9dd6640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f14a40709d0 0x7f14a40cdca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.531+0000 7fcf7c407640 1 -- 172.21.15.33:0/1209992983 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf7415ae30 msgr2=0x7fcf740d0310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:00.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.531+0000 7f670a4d2640 1 --2- 172.21.15.33:0/3009630289 >> v2:172.21.15.33:3300/0 conn(0x7f66fc0366a0 0x7f66fc04fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:00.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.531+0000 7fcf7c407640 1 --2- 172.21.15.33:0/1209992983 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf7415ae30 0x7fcf740d0310 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fcf64009870 tx=0x7fcf6402a270 comp rx=0 tx=0).stop 2024-05-08T10:55:00.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.531+0000 7f14a9dd6640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14a40cbab0 con 0x7f14a40cb6d0 2024-05-08T10:55:00.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.531+0000 7f14a9dd6640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14a40cd200 con 0x7f14a4142fb0 2024-05-08T10:55:00.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.531+0000 7f670a4d2640 1 --2- 172.21.15.33:0/3009630289 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f66fc0df800 0x7f66fc055d10 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:00.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.531+0000 7f670a4d2640 1 -- 172.21.15.33:0/3009630289 >> 172.21.15.33:0/3009630289 conn(0x7f66fc01e6c0 msgr2=0x7f66fc0553f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:00.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.531+0000 7f14a9dd6640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14a415b0a0 con 0x7f14a40709d0 2024-05-08T10:55:00.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.531+0000 7f4784c99640 1 -- 172.21.15.33:0/2063358990 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4768004800 msgr2=0x7f4768004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:00.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.531+0000 7f4784c99640 1 --2- 172.21.15.33:0/2063358990 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4768004800 0x7f4768004c80 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f4770001750 tx=0x7f4768005830 comp rx=0 tx=0).stop 2024-05-08T10:55:00.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.531+0000 7f4784c99640 1 -- 172.21.15.33:0/2063358990 shutdown_connections 2024-05-08T10:55:00.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.531+0000 7f4784c99640 1 --2- 172.21.15.33:0/2063358990 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4768004800 0x7f4768004c80 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:00.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.531+0000 7f4784c99640 1 -- 172.21.15.33:0/2063358990 >> 172.21.15.33:0/2063358990 conn(0x7f47800b22e0 msgr2=0x7f47800b26c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:00.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.531+0000 7f4784c99640 1 -- 172.21.15.33:0/2063358990 shutdown_connections 2024-05-08T10:55:00.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.531+0000 7f4784c99640 1 -- 172.21.15.33:0/2063358990 wait complete. 2024-05-08T10:55:00.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.531+0000 7f14a3fff640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f14a40709d0 0x7f14a40cdca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.531+0000 7f14a95d5640 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f14a4142fb0 0x7f14a40ce1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.33:47902/0 (socket says 172.21.15.33:47902) 2024-05-08T10:55:00.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.531+0000 7f14a3fff640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f14a40709d0 0x7f14a40cdca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.33:49910/0 (socket says 172.21.15.33:49910) 2024-05-08T10:55:00.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.531+0000 7f14a3fff640 1 -- 172.21.15.33:0/475051328 learned_addr learned my addr 172.21.15.33:0/475051328 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:00.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.531+0000 7fa6d9c21640 1 --2- 172.21.15.33:0/3888620596 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa6d40b29c0 0x7fa6d40cfdd0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa6d40b33f0 tx=0x7fa6c402a0b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2164e597c8a789d8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:00.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.531+0000 7f670a4d2640 1 -- 172.21.15.33:0/3009630289 shutdown_connections 2024-05-08T10:55:00.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.531+0000 7f670a4d2640 1 -- 172.21.15.33:0/3009630289 wait complete. 2024-05-08T10:55:00.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.531+0000 7f14a3fff640 1 -- 172.21.15.33:0/475051328 >> v1:172.21.15.174:6789/0 conn(0x7f14a4142fb0 legacy=0x7f14a40ce1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:00.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.532+0000 7f14a3fff640 1 -- 172.21.15.33:0/475051328 >> v1:172.21.15.33:6789/0 conn(0x7f14a40cb6d0 legacy=0x7f14a40702c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:00.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.532+0000 7fd71d597640 1 -- 172.21.15.33:0/2676897978 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd718142fb0 msgr2=0x7fd7180702c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:00.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.532+0000 7fd71d597640 1 --2- 172.21.15.33:0/2676897978 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd718142fb0 0x7fd7180702c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd7080097a0 tx=0x7fd70802a2e0 comp rx=0 tx=0).stop 2024-05-08T10:55:00.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.532+0000 7fcf7c407640 1 -- 172.21.15.33:0/1209992983 shutdown_connections 2024-05-08T10:55:00.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.532+0000 7fcf7c407640 1 --2- 172.21.15.33:0/1209992983 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf7415ae30 0x7fcf740d0310 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:00.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.532+0000 7fcf7c407640 1 --2- 172.21.15.33:0/1209992983 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcf7406b6c0 0x7fcf7415b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:00.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.532+0000 7fcf7c407640 1 -- 172.21.15.33:0/1209992983 >> 172.21.15.33:0/1209992983 conn(0x7fcf7406aba0 msgr2=0x7fcf7406afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:00.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.532+0000 7fa6cbfff640 1 -- 172.21.15.33:0/3888620596 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c4037070 con 0x7fa6d40b29c0 2024-05-08T10:55:00.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.532+0000 7fa6cbfff640 1 -- 172.21.15.33:0/3888620596 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6c402ae00 con 0x7fa6d40b29c0 2024-05-08T10:55:00.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.532+0000 7fa6cbfff640 1 -- 172.21.15.33:0/3888620596 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c4032660 con 0x7fa6d40b29c0 2024-05-08T10:55:00.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.532+0000 7f14a3fff640 1 -- 172.21.15.33:0/475051328 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14a415b380 con 0x7f14a40709d0 2024-05-08T10:55:00.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.532+0000 7fd71d597640 1 -- 172.21.15.33:0/2676897978 shutdown_connections 2024-05-08T10:55:00.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.532+0000 7fcf7c407640 1 -- 172.21.15.33:0/1209992983 shutdown_connections 2024-05-08T10:55:00.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.532+0000 7fd71d597640 1 --2- 172.21.15.33:0/2676897978 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd718142fb0 0x7fd7180702c0 secure :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd7080097a0 tx=0x7fd70802a2e0 comp rx=0 tx=0).stop 2024-05-08T10:55:00.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.532+0000 7fd71d597640 1 -- 172.21.15.33:0/2676897978 >> 172.21.15.33:0/2676897978 conn(0x7fd7180cf630 msgr2=0x7fd7180cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:00.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.532+0000 7fcf7c407640 1 -- 172.21.15.33:0/1209992983 wait complete. 2024-05-08T10:55:00.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.532+0000 7fd71d597640 1 -- 172.21.15.33:0/2676897978 shutdown_connections 2024-05-08T10:55:00.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.531+0000 7f8f4a7fc640 1 -- 172.21.15.33:0/3428098083 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f38032440 con 0x7f8f44038110 2024-05-08T10:55:00.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.532+0000 7fdf9effd640 1 --2- 172.21.15.33:0/1455545046 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdf98050140 0x7fdf98038170 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c009870 tx=0x7fdf8c02a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63ceb1fd1ed598c1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:00.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.532+0000 7f8f4a7fc640 1 -- 172.21.15.33:0/3428098083 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f38032810 con 0x7f8f44038110 2024-05-08T10:55:00.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.532+0000 7fd71d597640 1 -- 172.21.15.33:0/2676897978 wait complete. 2024-05-08T10:55:00.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.533+0000 7f14a3fff640 1 --2- 172.21.15.33:0/475051328 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f14a40709d0 0x7f14a40cdca0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1494009870 tx=0x7f149402b510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=be72fe74e5763d5d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:00.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.533+0000 7fdf9e7fc640 1 -- 172.21.15.33:0/1455545046 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf8c037070 con 0x7fdf98050140 2024-05-08T10:55:00.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.533+0000 7fdf9e7fc640 1 -- 172.21.15.33:0/1455545046 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf8c032440 con 0x7fdf98050140 2024-05-08T10:55:00.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.533+0000 7fdf9e7fc640 1 -- 172.21.15.33:0/1455545046 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf8c032810 con 0x7fdf98050140 2024-05-08T10:55:00.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.533+0000 7f4784c99640 1 Processor -- start 2024-05-08T10:55:00.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.533+0000 7f8f51c1f640 1 -- 172.21.15.33:0/3428098083 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8f44038110 msgr2=0x7f8f440385a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:00.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.533+0000 7f8f51c1f640 1 --2- 172.21.15.33:0/3428098083 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8f44038110 0x7f8f440385a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8f4400bd00 tx=0x7f8f3802a1e0 comp rx=0 tx=0).stop 2024-05-08T10:55:00.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.533+0000 7fa6db684640 1 -- 172.21.15.33:0/3888620596 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa6d40b29c0 msgr2=0x7fa6d40cfdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:00.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.533+0000 7fa6db684640 1 --2- 172.21.15.33:0/3888620596 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa6d40b29c0 0x7fa6d40cfdd0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa6d40b33f0 tx=0x7fa6c402a0b0 comp rx=0 tx=0).stop 2024-05-08T10:55:00.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.533+0000 7fa6db684640 1 -- 172.21.15.33:0/3888620596 shutdown_connections 2024-05-08T10:55:00.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.533+0000 7fa6db684640 1 --2- 172.21.15.33:0/3888620596 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa6d40b29c0 0x7fa6d40cfdd0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:00.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.533+0000 7fa6db684640 1 --2- 172.21.15.33:0/3888620596 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa6d415f580 0x7fa6d40ccf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:00.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.533+0000 7fa6db684640 1 --2- 172.21.15.33:0/3888620596 >> v2:172.21.15.33:3300/0 conn(0x7fa6d415f1a0 0x7fa6d40b4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:00.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.533+0000 7fa6db684640 1 -- 172.21.15.33:0/3888620596 >> 172.21.15.33:0/3888620596 conn(0x7fa6d40b3580 msgr2=0x7fa6d40b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:00.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.533+0000 7fa6db684640 1 -- 172.21.15.33:0/3888620596 shutdown_connections 2024-05-08T10:55:00.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.533+0000 7fa6db684640 1 -- 172.21.15.33:0/3888620596 wait complete. 2024-05-08T10:55:00.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.533+0000 7fcf7c407640 1 Processor -- start 2024-05-08T10:55:00.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.533+0000 7f14a37fe640 1 -- 172.21.15.33:0/475051328 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1494037070 con 0x7f14a40709d0 2024-05-08T10:55:00.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.533+0000 7f14a37fe640 1 -- 172.21.15.33:0/475051328 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1494030710 con 0x7f14a40709d0 2024-05-08T10:55:00.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.533+0000 7f14a37fe640 1 -- 172.21.15.33:0/475051328 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1494030ae0 con 0x7f14a40709d0 2024-05-08T10:55:00.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.533+0000 7f8f51c1f640 1 -- 172.21.15.33:0/3428098083 shutdown_connections 2024-05-08T10:55:00.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.533+0000 7f8f51c1f640 1 --2- 172.21.15.33:0/3428098083 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8f44038110 0x7f8f440385a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:00.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.533+0000 7f8f51c1f640 1 --2- 172.21.15.33:0/3428098083 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8f4404ffd0 0x7f8f44037bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:00.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.533+0000 7f8f51c1f640 1 --2- 172.21.15.33:0/3428098083 >> v2:172.21.15.33:3300/0 conn(0x7f8f440ead00 0x7f8f4404fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:00.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.533+0000 7f8f51c1f640 1 -- 172.21.15.33:0/3428098083 >> 172.21.15.33:0/3428098083 conn(0x7f8f44009fb0 msgr2=0x7f8f4400a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:00.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.534+0000 7fcf7c407640 1 -- start start 2024-05-08T10:55:00.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.534+0000 7f4784c99640 1 -- start start 2024-05-08T10:55:00.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.534+0000 7f670a4d2640 1 Processor -- start 2024-05-08T10:55:00.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.534+0000 7fd71d597640 1 Processor -- start 2024-05-08T10:55:00.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.534+0000 7f8f51c1f640 1 -- 172.21.15.33:0/3428098083 shutdown_connections 2024-05-08T10:55:00.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.534+0000 7fdfa60c4640 1 -- 172.21.15.33:0/1455545046 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdf98050140 msgr2=0x7fdf98038170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:00.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.534+0000 7fdfa60c4640 1 --2- 172.21.15.33:0/1455545046 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdf98050140 0x7fdf98038170 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c009870 tx=0x7fdf8c02a250 comp rx=0 tx=0).stop 2024-05-08T10:55:00.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.534+0000 7fd71d597640 1 -- start start 2024-05-08T10:55:00.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.534+0000 7f8f51c1f640 1 -- 172.21.15.33:0/3428098083 wait complete. 2024-05-08T10:55:00.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.534+0000 7f14a9dd6640 1 -- 172.21.15.33:0/475051328 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f14a40709d0 msgr2=0x7f14a40cdca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:00.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.534+0000 7f14a9dd6640 1 --2- 172.21.15.33:0/475051328 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f14a40709d0 0x7f14a40cdca0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1494009870 tx=0x7f149402b510 comp rx=0 tx=0).stop 2024-05-08T10:55:00.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.535+0000 7fdfa60c4640 1 -- 172.21.15.33:0/1455545046 shutdown_connections 2024-05-08T10:55:00.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.535+0000 7f14a9dd6640 1 -- 172.21.15.33:0/475051328 shutdown_connections 2024-05-08T10:55:00.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.535+0000 7f14a9dd6640 1 --2- 172.21.15.33:0/475051328 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f14a40709d0 0x7f14a40cdca0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:00.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.535+0000 7f14a9dd6640 1 -- 172.21.15.33:0/475051328 >> 172.21.15.33:0/475051328 conn(0x7f14a40cf630 msgr2=0x7f14a40cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:00.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.535+0000 7fdfa60c4640 1 --2- 172.21.15.33:0/1455545046 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdf980df410 0x7fdf98006a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:00.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.535+0000 7fdfa60c4640 1 --2- 172.21.15.33:0/1455545046 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdf98050140 0x7fdf98038170 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:00.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.535+0000 7fdfa60c4640 1 -- 172.21.15.33:0/1455545046 >> 172.21.15.33:0/1455545046 conn(0x7fdf98009fe0 msgr2=0x7fdf9800a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:00.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.535+0000 7fdfa60c4640 1 -- 172.21.15.33:0/1455545046 shutdown_connections 2024-05-08T10:55:00.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.535+0000 7fdfa60c4640 1 -- 172.21.15.33:0/1455545046 wait complete. 2024-05-08T10:55:00.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.535+0000 7f14a9dd6640 1 -- 172.21.15.33:0/475051328 shutdown_connections 2024-05-08T10:55:00.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.535+0000 7f670a4d2640 1 -- start start 2024-05-08T10:55:00.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.535+0000 7fcf7c407640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcf7406b6c0 0x7fcf74135a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.535+0000 7fcf7c407640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcf740cfe90 0x7fcf741577d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.535+0000 7fcf7c407640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf7415ae30 0x7fcf74151dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.535+0000 7f4784c99640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4768004800 0x7f4780149b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.535+0000 7fcf7c407640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf74143820 con 0x7fcf7415ae30 2024-05-08T10:55:00.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.535+0000 7fcf7c407640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf7415bb80 con 0x7fcf7406b6c0 2024-05-08T10:55:00.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.535+0000 7fcf7c407640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf741439a0 con 0x7fcf740cfe90 2024-05-08T10:55:00.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.535+0000 7fa6db684640 1 Processor -- start 2024-05-08T10:55:00.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.535+0000 7f4784c99640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f478014b680 0x7f478014d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.535+0000 7fa6db684640 1 -- start start 2024-05-08T10:55:00.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.535+0000 7f14a9dd6640 1 -- 172.21.15.33:0/475051328 wait complete. 2024-05-08T10:55:00.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.535+0000 7fcf799a2640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcf740cfe90 0x7fcf741577d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.535+0000 7fcf799a2640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcf740cfe90 0x7fcf741577d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.33:58532/0 (socket says 172.21.15.33:58532) 2024-05-08T10:55:00.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.535+0000 7fcf799a2640 1 -- 172.21.15.33:0/418694581 learned_addr learned my addr 172.21.15.33:0/418694581 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:00.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.535+0000 7fcf7a9a4640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf7415ae30 0x7fcf74151dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.536+0000 7fd71d597640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd7180d0120 0x7fd718153510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.536+0000 7fcf7a1a3640 1 --2- 172.21.15.33:0/418694581 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcf7406b6c0 0x7fcf74135a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.536+0000 7fd71d597640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd718143500 0x7fd718138970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.536+0000 7fcf7a9a4640 1 -- 172.21.15.33:0/418694581 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcf740cfe90 msgr2=0x7fcf741577d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:00.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.536+0000 7fcf7a9a4640 1 --2- 172.21.15.33:0/418694581 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcf740cfe90 0x7fcf741577d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:00.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.536+0000 7fcf7a9a4640 1 -- 172.21.15.33:0/418694581 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcf7406b6c0 msgr2=0x7fcf74135a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:00.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.536+0000 7fcf7a9a4640 1 --2- 172.21.15.33:0/418694581 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcf7406b6c0 0x7fcf74135a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:00.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.536+0000 7fcf7a9a4640 1 -- 172.21.15.33:0/418694581 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf74152d10 con 0x7fcf7415ae30 2024-05-08T10:55:00.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.536+0000 7fcf799a2640 1 --2- 172.21.15.33:0/418694581 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcf740cfe90 0x7fcf741577d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T10:55:00.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.536+0000 7f477f7fe640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4768004800 0x7f4780149b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.536+0000 7f477f7fe640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4768004800 0x7f4780149b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.33:49920/0 (socket says 172.21.15.33:49920) 2024-05-08T10:55:00.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.536+0000 7f477effd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f478014b680 0x7f478014d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.536+0000 7f477effd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f478014b680 0x7f478014d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37560/0 (socket says 172.21.15.33:37560) 2024-05-08T10:55:00.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.536+0000 7f4784c99640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f478014d6c0 0x7f47801517f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.536+0000 7f4784c99640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f478015f1a0 con 0x7f478014b680 2024-05-08T10:55:00.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.536+0000 7f4784c99640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4780072680 con 0x7f4768004800 2024-05-08T10:55:00.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.536+0000 7f670a4d2640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f66fc0366a0 0x7f66fc034040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.536+0000 7f670a4d2640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f66fc03a0a0 0x7f66fc0dc870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.536+0000 7f477ffff640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f478014d6c0 0x7f47801517f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.536+0000 7f477ffff640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f478014d6c0 0x7f47801517f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.33:58550/0 (socket says 172.21.15.33:58550) 2024-05-08T10:55:00.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.536+0000 7f477ffff640 1 -- 172.21.15.33:0/1856486369 learned_addr learned my addr 172.21.15.33:0/1856486369 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:00.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.536+0000 7f670a4d2640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f66fc0df800 0x7f66fc033000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.536+0000 7f670a4d2640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66fc04ff80 con 0x7f66fc03a0a0 2024-05-08T10:55:00.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.536+0000 7f8f51c1f640 1 Processor -- start 2024-05-08T10:55:00.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.536+0000 7f4784c99640 1 -- 172.21.15.33:0/1856486369 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f478015e320 con 0x7f478014d6c0 2024-05-08T10:55:00.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.536+0000 7f670a4d2640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66fc0dfbe0 con 0x7f66fc0df800 2024-05-08T10:55:00.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.536+0000 7f670a4d2640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66fc050100 con 0x7f66fc0366a0 2024-05-08T10:55:00.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.536+0000 7fd717fff640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd7180d0120 0x7fd718153510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.536+0000 7fd717fff640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd7180d0120 0x7fd718153510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.33:58534/0 (socket says 172.21.15.33:58534) 2024-05-08T10:55:00.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.537+0000 7fd71d597640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd7180b2460 0x7fd71813aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.537+0000 7fd71d597640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7180c9c80 con 0x7fd7180b2460 2024-05-08T10:55:00.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.537+0000 7fd71d597640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd71815ad30 con 0x7fd718143500 2024-05-08T10:55:00.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.537+0000 7fd71d597640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd71813a380 con 0x7fd7180d0120 2024-05-08T10:55:00.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.537+0000 7fd717fff640 1 -- 172.21.15.33:0/1249348392 learned_addr learned my addr 172.21.15.33:0/1249348392 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:00.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.537+0000 7f8f51c1f640 1 -- start start 2024-05-08T10:55:00.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.537+0000 7fa6db684640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa6d40b29c0 0x7fa6d40cb540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.537+0000 7fa6db684640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6d415f1a0 0x7fa6d406eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.537+0000 7fa6db684640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa6d415f580 0x7fa6d41fbef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.537+0000 7f67037fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f66fc03a0a0 0x7f66fc0dc870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.537+0000 7f67037fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f66fc03a0a0 0x7f66fc0dc870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37574/0 (socket says 172.21.15.33:37574) 2024-05-08T10:55:00.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.537+0000 7f67037fe640 1 -- 172.21.15.33:0/3547047589 learned_addr learned my addr 172.21.15.33:0/3547047589 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:00.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.537+0000 7fd7177fe640 1 --2- 172.21.15.33:0/1249348392 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd718143500 0x7fd718138970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.537+0000 7fa6d9420640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa6d40b29c0 0x7fa6d40cb540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.537+0000 7fa6d9420640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa6d40b29c0 0x7fa6d40cb540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.33:49946/0 (socket says 172.21.15.33:49946) 2024-05-08T10:55:00.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.537+0000 7fa6d9420640 1 -- 172.21.15.33:0/2197227088 learned_addr learned my addr 172.21.15.33:0/2197227088 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:00.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.537+0000 7f477ffff640 1 -- 172.21.15.33:0/1856486369 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4768004800 msgr2=0x7f4780149b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:00.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.537+0000 7f477ffff640 1 --2- 172.21.15.33:0/1856486369 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4768004800 0x7f4780149b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:00.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.537+0000 7f477ffff640 1 -- 172.21.15.33:0/1856486369 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f478014b680 msgr2=0x7f478014d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:00.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.537+0000 7fa6db684640 1 -- 172.21.15.33:0/2197227088 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d40ce0f0 con 0x7fa6d415f1a0 2024-05-08T10:55:00.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.537+0000 7fa6d9c21640 1 --2- 172.21.15.33:0/2197227088 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa6d415f580 0x7fa6d41fbef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.537+0000 7fa6db684640 1 -- 172.21.15.33:0/2197227088 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d40cde10 con 0x7fa6d40b29c0 2024-05-08T10:55:00.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.537+0000 7fa6db684640 1 -- 172.21.15.33:0/2197227088 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d40d0310 con 0x7fa6d415f580 2024-05-08T10:55:00.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.537+0000 7fd717fff640 1 -- 172.21.15.33:0/1249348392 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd718143500 msgr2=0x7fd718138970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:00.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.537+0000 7fd717fff640 1 --2- 172.21.15.33:0/1249348392 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd718143500 0x7fd718138970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:00.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.537+0000 7fd717fff640 1 -- 172.21.15.33:0/1249348392 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd7180b2460 msgr2=0x7fd71813aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:00.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.537+0000 7fd717fff640 1 --2- 172.21.15.33:0/1249348392 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd7180b2460 0x7fd71813aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:00.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.537+0000 7fd717fff640 1 -- 172.21.15.33:0/1249348392 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7181392e0 con 0x7fd7180d0120 2024-05-08T10:55:00.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.538+0000 7fd717fff640 1 --2- 172.21.15.33:0/1249348392 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd7180d0120 0x7fd718153510 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd700001b70 tx=0x7fd700014420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:00.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.537+0000 7fcf7a9a4640 1 --2- 172.21.15.33:0/418694581 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf7415ae30 0x7fcf74151dc0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fcf64031000 tx=0x7fcf640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:00.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.538+0000 7f14a9dd6640 1 Processor -- start 2024-05-08T10:55:00.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.537+0000 7fdfa60c4640 1 Processor -- start 2024-05-08T10:55:00.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.538+0000 7fdfa60c4640 1 -- start start 2024-05-08T10:55:00.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.537+0000 7f477ffff640 1 --2- 172.21.15.33:0/1856486369 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f478014b680 0x7f478014d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:00.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.537+0000 7f477ffff640 1 -- 172.21.15.33:0/1856486369 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f478015b940 con 0x7f478014d6c0 2024-05-08T10:55:00.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.537+0000 7f477f7fe640 1 --2- 172.21.15.33:0/1856486369 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4768004800 0x7f4780149b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-05-08T10:55:00.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.537+0000 7f477effd640 1 --2- 172.21.15.33:0/1856486369 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f478014b680 0x7f478014d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T10:55:00.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.538+0000 7f6703fff640 1 --2- 172.21.15.33:0/3547047589 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f66fc0366a0 0x7f66fc034040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.538+0000 7f6708a6f640 1 --2- 172.21.15.33:0/3547047589 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f66fc0df800 0x7f66fc033000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.538+0000 7f14a9dd6640 1 -- start start 2024-05-08T10:55:00.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.538+0000 7fa6d8c1f640 1 --2- 172.21.15.33:0/2197227088 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6d415f1a0 0x7fa6d406eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.538+0000 7fd714ff9640 1 -- 172.21.15.33:0/1249348392 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd700001d20 con 0x7fd7180d0120 2024-05-08T10:55:00.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.538+0000 7fa6d8c1f640 1 -- 172.21.15.33:0/2197227088 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa6d415f580 msgr2=0x7fa6d41fbef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:00.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.538+0000 7fd714ff9640 1 -- 172.21.15.33:0/1249348392 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd700014d40 con 0x7fd7180d0120 2024-05-08T10:55:00.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.538+0000 7fd71d597640 1 -- 172.21.15.33:0/1249348392 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7181395c0 con 0x7fd7180d0120 2024-05-08T10:55:00.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.538+0000 7fa6d8c1f640 1 --2- 172.21.15.33:0/2197227088 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa6d415f580 0x7fa6d41fbef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:00.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.538+0000 7fa6d8c1f640 1 -- 172.21.15.33:0/2197227088 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa6d40b29c0 msgr2=0x7fa6d40cb540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:00.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.538+0000 7f8f51c1f640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f44038110 0x7f8f440df0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.538+0000 7f477ffff640 1 --2- 172.21.15.33:0/1856486369 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f478014d6c0 0x7f47801517f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f47800b5ab0 tx=0x7f4778006a80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:00.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.538+0000 7fa6d8c1f640 1 --2- 172.21.15.33:0/2197227088 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa6d40b29c0 0x7fa6d40cb540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:00.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.538+0000 7f8f51c1f640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8f4404ffd0 0x7f8f44034f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.538+0000 7f6703fff640 1 -- 172.21.15.33:0/3547047589 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f66fc0df800 msgr2=0x7f66fc033000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:00.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.538+0000 7f6703fff640 1 --2- 172.21.15.33:0/3547047589 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f66fc0df800 0x7f66fc033000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:00.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.539+0000 7f6703fff640 1 -- 172.21.15.33:0/3547047589 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f66fc03a0a0 msgr2=0x7f66fc0dc870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:00.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.539+0000 7f6703fff640 1 --2- 172.21.15.33:0/3547047589 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f66fc03a0a0 0x7f66fc0dc870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:00.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.538+0000 7f8f51c1f640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8f440ead00 0x7f8f44035470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.539+0000 7f6703fff640 1 -- 172.21.15.33:0/3547047589 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66fc048f20 con 0x7f66fc0366a0 2024-05-08T10:55:00.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.538+0000 7f8f51c1f640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f44054940 con 0x7f8f44038110 2024-05-08T10:55:00.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.539+0000 7f67037fe640 1 --2- 172.21.15.33:0/3547047589 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f66fc03a0a0 0x7f66fc0dc870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T10:55:00.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.538+0000 7f8f51c1f640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f440547c0 con 0x7f8f4404ffd0 2024-05-08T10:55:00.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.538+0000 7f8f51c1f640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f4404f550 con 0x7f8f440ead00 2024-05-08T10:55:00.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.538+0000 7fa6d8c1f640 1 -- 172.21.15.33:0/2197227088 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6d40c58b0 con 0x7fa6d415f1a0 2024-05-08T10:55:00.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.538+0000 7fa6d8c1f640 1 --2- 172.21.15.33:0/2197227088 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6d415f1a0 0x7fa6d406eae0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa6d000c5c0 tx=0x7fa6d000ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:00.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.539+0000 7fa6c9ffb640 1 -- 172.21.15.33:0/2197227088 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6d0015070 con 0x7fa6d415f1a0 2024-05-08T10:55:00.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.539+0000 7f8f4b7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f44038110 0x7f8f440df0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.539+0000 7f8f4bfff640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8f440ead00 0x7f8f44035470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.539+0000 7f8f4bfff640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8f440ead00 0x7f8f44035470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.33:58584/0 (socket says 172.21.15.33:58584) 2024-05-08T10:55:00.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.538+0000 7fd71d597640 1 -- 172.21.15.33:0/1249348392 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd718139b80 con 0x7fd7180d0120 2024-05-08T10:55:00.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.538+0000 7fd714ff9640 1 -- 172.21.15.33:0/1249348392 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd700001d20 con 0x7fd7180d0120 2024-05-08T10:55:00.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.539+0000 7fd71d597640 1 -- 172.21.15.33:0/1249348392 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd6fc001030 con 0x7fd7180d0120 2024-05-08T10:55:00.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.539+0000 7f8f4bfff640 1 -- 172.21.15.33:0/1416397490 learned_addr learned my addr 172.21.15.33:0/1416397490 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:00.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.539+0000 7f8f4affd640 1 --2- 172.21.15.33:0/1416397490 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8f4404ffd0 0x7f8f44034f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.539+0000 7f8f4bfff640 1 -- 172.21.15.33:0/1416397490 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8f4404ffd0 msgr2=0x7f8f44034f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:00.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.539+0000 7f8f4bfff640 1 --2- 172.21.15.33:0/1416397490 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8f4404ffd0 0x7f8f44034f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:00.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.539+0000 7f8f4bfff640 1 -- 172.21.15.33:0/1416397490 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f44038110 msgr2=0x7f8f440df0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:00.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.539+0000 7f8f4bfff640 1 --2- 172.21.15.33:0/1416397490 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f44038110 0x7f8f440df0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:00.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.539+0000 7fdfa60c4640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdf98050140 0x7fdf980cfa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.539+0000 7f8f4bfff640 1 -- 172.21.15.33:0/1416397490 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f440368e0 con 0x7f8f440ead00 2024-05-08T10:55:00.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.540+0000 7fdfa60c4640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdf980df030 0x7fdf980df7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.540+0000 7fdf9f7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdf98050140 0x7fdf980cfa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.540+0000 7fdfa60c4640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdf980df410 0x7fdf9804a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.539+0000 7fcf6affd640 1 -- 172.21.15.33:0/418694581 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf64041070 con 0x7fcf7415ae30 2024-05-08T10:55:00.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.539+0000 7fcf6affd640 1 -- 172.21.15.33:0/418694581 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf6403c870 con 0x7fcf7415ae30 2024-05-08T10:55:00.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.539+0000 7fcf6affd640 1 -- 172.21.15.33:0/418694581 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf64037040 con 0x7fcf7415ae30 2024-05-08T10:55:00.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.540+0000 7f14a9dd6640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f14a40709d0 0x7f14a40c8f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.540+0000 7fdfa60c4640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf980507c0 con 0x7fdf98050140 2024-05-08T10:55:00.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.540+0000 7fcf7c407640 1 -- 172.21.15.33:0/418694581 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf74152ff0 con 0x7fcf7415ae30 2024-05-08T10:55:00.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.540+0000 7fdf9effd640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdf980df030 0x7fdf980df7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.540+0000 7f14a9dd6640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14a40cb6d0 0x7f14a40b3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.540+0000 7fcf7c407640 1 -- 172.21.15.33:0/418694581 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf741535b0 con 0x7fcf7415ae30 2024-05-08T10:55:00.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.540+0000 7f14a9dd6640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f14a4142fb0 0x7f14a4159520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.540+0000 7f14a9dd6640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14a415ad30 con 0x7f14a40cb6d0 2024-05-08T10:55:00.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.540+0000 7f14a3fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14a40cb6d0 0x7f14a40b3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.540+0000 7f14a3fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14a40cb6d0 0x7f14a40b3f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37626/0 (socket says 172.21.15.33:37626) 2024-05-08T10:55:00.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.540+0000 7f14a3fff640 1 -- 172.21.15.33:0/4144104906 learned_addr learned my addr 172.21.15.33:0/4144104906 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:00.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.540+0000 7f14a9dd6640 1 -- 172.21.15.33:0/4144104906 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14a40cd780 con 0x7f14a40709d0 2024-05-08T10:55:00.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.540+0000 7f14a95d5640 1 --2- 172.21.15.33:0/4144104906 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f14a4142fb0 0x7f14a4159520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.540+0000 7f14a9dd6640 1 -- 172.21.15.33:0/4144104906 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14a40c9c80 con 0x7f14a4142fb0 2024-05-08T10:55:00.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.541+0000 7f14a8dd4640 1 --2- 172.21.15.33:0/4144104906 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f14a40709d0 0x7f14a40c8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.540+0000 7fdf9effd640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdf980df030 0x7fdf980df7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.33:58594/0 (socket says 172.21.15.33:58594) 2024-05-08T10:55:00.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.540+0000 7fdf9effd640 1 -- 172.21.15.33:0/398140234 learned_addr learned my addr 172.21.15.33:0/398140234 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:00.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.540+0000 7fdfa60c4640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf98050640 con 0x7fdf980df410 2024-05-08T10:55:00.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.540+0000 7fdfa60c4640 1 -- 172.21.15.33:0/398140234 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf980546c0 con 0x7fdf980df030 2024-05-08T10:55:00.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.540+0000 7fdf9ffff640 1 --2- 172.21.15.33:0/398140234 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdf980df410 0x7fdf9804a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.540+0000 7fdf9ffff640 1 -- 172.21.15.33:0/398140234 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdf980df030 msgr2=0x7fdf980df7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:00.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.540+0000 7fdf9ffff640 1 --2- 172.21.15.33:0/398140234 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdf980df030 0x7fdf980df7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:00.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.540+0000 7fdf9ffff640 1 -- 172.21.15.33:0/398140234 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdf98050140 msgr2=0x7fdf980cfa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:00.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.540+0000 7fdf9effd640 1 --2- 172.21.15.33:0/398140234 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdf980df030 0x7fdf980df7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:55:00.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.541+0000 7fdf9ffff640 1 --2- 172.21.15.33:0/398140234 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdf98050140 0x7fdf980cfa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:00.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.541+0000 7fdf9ffff640 1 -- 172.21.15.33:0/398140234 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf9817af10 con 0x7fdf980df410 2024-05-08T10:55:00.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.539+0000 7f4767fff640 1 -- 172.21.15.33:0/1856486369 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4778007e60 con 0x7f478014d6c0 2024-05-08T10:55:00.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.539+0000 7f4767fff640 1 -- 172.21.15.33:0/1856486369 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4778019070 con 0x7f478014d6c0 2024-05-08T10:55:00.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.539+0000 7f4767fff640 1 -- 172.21.15.33:0/1856486369 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f477800abd0 con 0x7f478014d6c0 2024-05-08T10:55:00.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.540+0000 7f4784c99640 1 -- 172.21.15.33:0/1856486369 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f478014b0b0 con 0x7f478014d6c0 2024-05-08T10:55:00.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.541+0000 7f4784c99640 1 -- 172.21.15.33:0/1856486369 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f478015bec0 con 0x7f478014d6c0 2024-05-08T10:55:00.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.539+0000 7fa6db684640 1 -- 172.21.15.33:0/2197227088 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6d40c5b90 con 0x7fa6d415f1a0 2024-05-08T10:55:00.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.539+0000 7fa6db684640 1 -- 172.21.15.33:0/2197227088 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6d40c5540 con 0x7fa6d415f1a0 2024-05-08T10:55:00.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.540+0000 7fa6c9ffb640 1 -- 172.21.15.33:0/2197227088 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6d0004220 con 0x7fa6d415f1a0 2024-05-08T10:55:00.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.541+0000 7fa6db684640 1 -- 172.21.15.33:0/2197227088 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa6b4001030 con 0x7fa6d415f1a0 2024-05-08T10:55:00.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.541+0000 7fa6c9ffb640 1 -- 172.21.15.33:0/2197227088 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6d0003610 con 0x7fa6d415f1a0 2024-05-08T10:55:00.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.540+0000 7f6703fff640 1 --2- 172.21.15.33:0/3547047589 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f66fc0366a0 0x7f66fc034040 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f6704064750 tx=0x7f6704069770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:00.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.541+0000 7fdf9f7fe640 1 --2- 172.21.15.33:0/398140234 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdf98050140 0x7fdf980cfa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:55:00.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.541+0000 7f6700ff9640 1 -- 172.21.15.33:0/3547047589 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67040b2050 con 0x7f66fc0366a0 2024-05-08T10:55:00.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.541+0000 7f6700ff9640 1 -- 172.21.15.33:0/3547047589 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67040be070 con 0x7f66fc0366a0 2024-05-08T10:55:00.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.541+0000 7f14a95d5640 1 -- 172.21.15.33:0/4144104906 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f14a40709d0 msgr2=0x7f14a40c8f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:00.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.541+0000 7f14a95d5640 1 --2- 172.21.15.33:0/4144104906 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f14a40709d0 0x7f14a40c8f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:00.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.541+0000 7f14a95d5640 1 -- 172.21.15.33:0/4144104906 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14a40cb6d0 msgr2=0x7f14a40b3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:00.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.541+0000 7f14a95d5640 1 --2- 172.21.15.33:0/4144104906 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14a40cb6d0 0x7f14a40b3f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:00.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.541+0000 7f14a95d5640 1 -- 172.21.15.33:0/4144104906 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14a40b46d0 con 0x7f14a4142fb0 2024-05-08T10:55:00.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.541+0000 7f670a4d2640 1 -- 172.21.15.33:0/3547047589 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66fc049200 con 0x7f66fc0366a0 2024-05-08T10:55:00.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.541+0000 7fcf7c407640 1 -- 172.21.15.33:0/418694581 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcf74069d20 con 0x7fcf7415ae30 2024-05-08T10:55:00.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.541+0000 7f670a4d2640 1 -- 172.21.15.33:0/3547047589 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66fc0497c0 con 0x7f66fc0366a0 2024-05-08T10:55:00.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.541+0000 7fd714ff9640 1 -- 172.21.15.33:0/1249348392 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd700005070 con 0x7fd7180d0120 2024-05-08T10:55:00.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.541+0000 7fd714ff9640 1 --2- 172.21.15.33:0/1249348392 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fd6f806b700 0x7fd6f806dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.542+0000 7fd7177fe640 1 --2- 172.21.15.33:0/1249348392 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fd6f806b700 0x7fd6f806dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.542+0000 7fd714ff9640 1 -- 172.21.15.33:0/1249348392 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd70005e6b0 con 0x7fd7180d0120 2024-05-08T10:55:00.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.542+0000 7f14a95d5640 1 --2- 172.21.15.33:0/4144104906 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f14a4142fb0 0x7f14a4159520 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f149c00c6f0 tx=0x7f149c00cbb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:00.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.543+0000 7f6700ff9640 1 -- 172.21.15.33:0/3547047589 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67040b9450 con 0x7f66fc0366a0 2024-05-08T10:55:00.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.543+0000 7f14a17fa640 1 -- 172.21.15.33:0/4144104906 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f149c017070 con 0x7f14a4142fb0 2024-05-08T10:55:00.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.543+0000 7f14a17fa640 1 -- 172.21.15.33:0/4144104906 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f149c005da0 con 0x7f14a4142fb0 2024-05-08T10:55:00.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.543+0000 7f14a17fa640 1 -- 172.21.15.33:0/4144104906 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f149c00a840 con 0x7f14a4142fb0 2024-05-08T10:55:00.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.544+0000 7f14a9dd6640 1 -- 172.21.15.33:0/4144104906 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14a40b49b0 con 0x7f14a4142fb0 2024-05-08T10:55:00.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.544+0000 7f14a9dd6640 1 -- 172.21.15.33:0/4144104906 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14a40c6b10 con 0x7f14a4142fb0 2024-05-08T10:55:00.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.542+0000 7fd714ff9640 1 --2- 172.21.15.33:0/1249348392 >> [v2:172.21.15.33:6816/3990629207,v1:172.21.15.33:6817/3990629207] conn(0x7fd6f8074430 0x7fd6f80768d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.542+0000 7fd714ff9640 1 -- 172.21.15.33:0/1249348392 --> [v2:172.21.15.33:6816/3990629207,v1:172.21.15.33:6817/3990629207] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd6f8076fa0 con 0x7fd6f8074430 2024-05-08T10:55:00.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.542+0000 7fd714ff9640 1 -- 172.21.15.33:0/1249348392 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd70005d040 con 0x7fd7180d0120 2024-05-08T10:55:00.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.542+0000 7fd71cd96640 1 --2- 172.21.15.33:0/1249348392 >> [v2:172.21.15.33:6816/3990629207,v1:172.21.15.33:6817/3990629207] conn(0x7fd6f8074430 0x7fd6f80768d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.542+0000 7fd7177fe640 1 --2- 172.21.15.33:0/1249348392 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fd6f806b700 0x7fd6f806dbc0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd708034000 tx=0x7fd70802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:00.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.543+0000 7fd71cd96640 1 --2- 172.21.15.33:0/1249348392 >> [v2:172.21.15.33:6816/3990629207,v1:172.21.15.33:6817/3990629207] conn(0x7fd6f8074430 0x7fd6f80768d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:00.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.543+0000 7fcf6affd640 1 -- 172.21.15.33:0/418694581 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fcf64044070 con 0x7fcf7415ae30 2024-05-08T10:55:00.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.544+0000 7fcf6affd640 1 --2- 172.21.15.33:0/418694581 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fcf5806b5a0 0x7fcf5806da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.544+0000 7fcf6affd640 1 -- 172.21.15.33:0/418694581 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcf640aac30 con 0x7fcf7415ae30 2024-05-08T10:55:00.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.544+0000 7fcf6affd640 1 --2- 172.21.15.33:0/418694581 >> [v2:172.21.15.33:6800/2940853479,v1:172.21.15.33:6801/2940853479] conn(0x7fcf580737a0 0x7fcf58075bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.544+0000 7fcf6affd640 1 -- 172.21.15.33:0/418694581 --> [v2:172.21.15.33:6800/2940853479,v1:172.21.15.33:6801/2940853479] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcf6400af30 con 0x7fcf580737a0 2024-05-08T10:55:00.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.544+0000 7fcf6affd640 1 -- 172.21.15.33:0/418694581 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcf64075800 con 0x7fcf7415ae30 2024-05-08T10:55:00.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.544+0000 7fd714ff9640 1 -- 172.21.15.33:0/1249348392 <== osd.0 v2:172.21.15.33:6816/3990629207 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fd6f8076fa0 con 0x7fd6f8074430 2024-05-08T10:55:00.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.544+0000 7f6700ff9640 1 -- 172.21.15.33:0/3547047589 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f67040b9670 con 0x7f66fc0366a0 2024-05-08T10:55:00.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.540+0000 7f8f4bfff640 1 --2- 172.21.15.33:0/1416397490 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8f440ead00 0x7f8f44035470 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8f38009960 tx=0x7f8f380046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:00.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.541+0000 7f8f37fff640 1 -- 172.21.15.33:0/1416397490 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f38041070 con 0x7f8f440ead00 2024-05-08T10:55:00.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.541+0000 7f8f37fff640 1 -- 172.21.15.33:0/1416397490 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f3803c930 con 0x7f8f440ead00 2024-05-08T10:55:00.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.542+0000 7f8f37fff640 1 -- 172.21.15.33:0/1416397490 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f38037040 con 0x7f8f440ead00 2024-05-08T10:55:00.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.542+0000 7f8f51c1f640 1 -- 172.21.15.33:0/1416397490 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f44036ba0 con 0x7f8f440ead00 2024-05-08T10:55:00.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.542+0000 7f8f51c1f640 1 -- 172.21.15.33:0/1416397490 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f44045690 con 0x7f8f440ead00 2024-05-08T10:55:00.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.542+0000 7fdf9ffff640 1 --2- 172.21.15.33:0/398140234 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdf980df410 0x7fdf9804a550 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fdfa004fd70 tx=0x7fdfa0073460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:00.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.542+0000 7fdf8bfff640 1 -- 172.21.15.33:0/398140234 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa0098070 con 0x7fdf980df410 2024-05-08T10:55:00.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.542+0000 7fdf8bfff640 1 -- 172.21.15.33:0/398140234 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfa00685e0 con 0x7fdf980df410 2024-05-08T10:55:00.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.545+0000 7f8f37fff640 1 -- 172.21.15.33:0/1416397490 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8f38044070 con 0x7f8f440ead00 2024-05-08T10:55:00.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.545+0000 7f66ee7fc640 1 -- 172.21.15.33:0/3547047589 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f66dc001030 con 0x7f66fc0366a0 2024-05-08T10:55:00.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.546+0000 7f8f37fff640 1 --2- 172.21.15.33:0/1416397490 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f8f3006b520 0x7f8f3006d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.545+0000 7f14a9dd6640 1 -- 172.21.15.33:0/4144104906 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f14a40b4ed0 con 0x7f14a4142fb0 2024-05-08T10:55:00.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.542+0000 7f4784c99640 1 -- 172.21.15.33:0/1856486369 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f478014a0c0 con 0x7f478014d6c0 2024-05-08T10:55:00.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.545+0000 7f4767fff640 1 -- 172.21.15.33:0/1856486369 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f477801e460 con 0x7f478014d6c0 2024-05-08T10:55:00.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.545+0000 7f4767fff640 1 --2- 172.21.15.33:0/1856486369 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f476c06b5d0 0x7f476c06da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.546+0000 7f4767fff640 1 -- 172.21.15.33:0/1856486369 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f477808a270 con 0x7f478014d6c0 2024-05-08T10:55:00.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.545+0000 7fa6c9ffb640 1 -- 172.21.15.33:0/2197227088 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa6d00037b0 con 0x7fa6d415f1a0 2024-05-08T10:55:00.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.545+0000 7f6700ff9640 1 --2- 172.21.15.33:0/3547047589 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f66e806b4d0 0x7f66e806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.545+0000 7f6700ff9640 1 -- 172.21.15.33:0/3547047589 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6704125f40 con 0x7f66fc0366a0 2024-05-08T10:55:00.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.545+0000 7f67037fe640 1 --2- 172.21.15.33:0/3547047589 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f66e806b4d0 0x7f66e806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.546+0000 7f6700ff9640 1 --2- 172.21.15.33:0/3547047589 >> [v2:172.21.15.174:6808/1637570253,v1:172.21.15.174:6809/1637570253] conn(0x7f66e80736d0 0x7f66e8075af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.546+0000 7f6700ff9640 1 -- 172.21.15.33:0/3547047589 --> [v2:172.21.15.174:6808/1637570253,v1:172.21.15.174:6809/1637570253] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f67040677f0 con 0x7f66e80736d0 2024-05-08T10:55:00.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.544+0000 7fcf7a1a3640 1 --2- 172.21.15.33:0/418694581 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fcf5806b5a0 0x7fcf5806da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.544+0000 7fcf799a2640 1 --2- 172.21.15.33:0/418694581 >> [v2:172.21.15.33:6800/2940853479,v1:172.21.15.33:6801/2940853479] conn(0x7fcf580737a0 0x7fcf58075bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.545+0000 7fcf799a2640 1 --2- 172.21.15.33:0/418694581 >> [v2:172.21.15.33:6800/2940853479,v1:172.21.15.33:6801/2940853479] conn(0x7fcf580737a0 0x7fcf58075bc0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:00.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.546+0000 7fcf7a1a3640 1 --2- 172.21.15.33:0/418694581 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fcf5806b5a0 0x7fcf5806da60 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fcf74138ff0 tx=0x7fcf70008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:00.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.546+0000 7f8f37fff640 1 -- 172.21.15.33:0/1416397490 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8f380aabd0 con 0x7f8f440ead00 2024-05-08T10:55:00.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.546+0000 7f4767fff640 1 --2- 172.21.15.33:0/1856486369 >> [v2:172.21.15.174:6824/1511860729,v1:172.21.15.174:6825/1511860729] conn(0x7f476c0737f0 0x7f476c075c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.546+0000 7f4767fff640 1 -- 172.21.15.33:0/1856486369 --> [v2:172.21.15.174:6824/1511860729,v1:172.21.15.174:6825/1511860729] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4778015ec0 con 0x7f476c0737f0 2024-05-08T10:55:00.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.546+0000 7f4767fff640 1 -- 172.21.15.33:0/1856486369 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4778091050 con 0x7f478014d6c0 2024-05-08T10:55:00.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.546+0000 7f6700ff9640 1 -- 172.21.15.33:0/3547047589 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f67040f07e0 con 0x7f66fc0366a0 2024-05-08T10:55:00.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.543+0000 7fdf8bfff640 1 -- 172.21.15.33:0/398140234 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa0093430 con 0x7fdf980df410 2024-05-08T10:55:00.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.543+0000 7fdfa60c4640 1 -- 172.21.15.33:0/398140234 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf9817b1f0 con 0x7fdf980df410 2024-05-08T10:55:00.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.543+0000 7fdfa60c4640 1 -- 172.21.15.33:0/398140234 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf9817b7b0 con 0x7fdf980df410 2024-05-08T10:55:00.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.544+0000 7fdfa60c4640 1 -- 172.21.15.33:0/398140234 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdf9817acc0 con 0x7fdf980df410 2024-05-08T10:55:00.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.546+0000 7f6708a6f640 1 --2- 172.21.15.33:0/3547047589 >> [v2:172.21.15.174:6808/1637570253,v1:172.21.15.174:6809/1637570253] conn(0x7f66e80736d0 0x7f66e8075af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.546+0000 7f8f51c1f640 1 --2- 172.21.15.33:0/1416397490 >> [v2:172.21.15.33:6824/1758076090,v1:172.21.15.33:6825/1758076090] conn(0x7f8f44046dc0 0x7f8f44049990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.546+0000 7f8f51c1f640 1 -- 172.21.15.33:0/1416397490 --> [v2:172.21.15.33:6824/1758076090,v1:172.21.15.33:6825/1758076090] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8f44035ec0 con 0x7f8f44046dc0 2024-05-08T10:55:00.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.546+0000 7fa6c9ffb640 1 --2- 172.21.15.33:0/2197227088 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fa6b806b5d0 0x7fa6b806da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.546+0000 7f14a17fa640 1 -- 172.21.15.33:0/4144104906 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f149c01a070 con 0x7f14a4142fb0 2024-05-08T10:55:00.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.546+0000 7f8f4b7fe640 1 --2- 172.21.15.33:0/1416397490 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f8f3006b520 0x7f8f3006d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.546+0000 7fa6c9ffb640 1 -- 172.21.15.33:0/2197227088 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa6d008a440 con 0x7fa6d415f1a0 2024-05-08T10:55:00.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.547+0000 7f67037fe640 1 --2- 172.21.15.33:0/3547047589 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f66e806b4d0 0x7f66e806d990 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f66fc0371e0 tx=0x7f66f8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:00.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.547+0000 7f6708a6f640 1 --2- 172.21.15.33:0/3547047589 >> [v2:172.21.15.174:6808/1637570253,v1:172.21.15.174:6809/1637570253] conn(0x7f66e80736d0 0x7f66e8075af0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:00.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.547+0000 7fdf8bfff640 1 -- 172.21.15.33:0/398140234 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fdfa009b070 con 0x7fdf980df410 2024-05-08T10:55:00.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.547+0000 7fcf6affd640 1 -- 172.21.15.33:0/418694581 <== osd.2 v2:172.21.15.33:6800/2940853479 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fcf6400af30 con 0x7fcf580737a0 2024-05-08T10:55:00.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.547+0000 7fa6d9420640 1 --2- 172.21.15.33:0/2197227088 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fa6b806b5d0 0x7fa6b806da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.546+0000 7f477f7fe640 1 --2- 172.21.15.33:0/1856486369 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f476c06b5d0 0x7f476c06da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.547+0000 7f477f7fe640 1 --2- 172.21.15.33:0/1856486369 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f476c06b5d0 0x7f476c06da90 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f477400d440 tx=0x7f4774008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:00.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.547+0000 7f8f4b7fe640 1 --2- 172.21.15.33:0/1416397490 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f8f3006b520 0x7f8f3006d9e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8f4000a7f0 tx=0x7f8f40008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:00.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.547+0000 7f8f4affd640 1 --2- 172.21.15.33:0/1416397490 >> [v2:172.21.15.33:6824/1758076090,v1:172.21.15.33:6825/1758076090] conn(0x7f8f44046dc0 0x7f8f44049990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.547+0000 7f477effd640 1 --2- 172.21.15.33:0/1856486369 >> [v2:172.21.15.174:6824/1511860729,v1:172.21.15.174:6825/1511860729] conn(0x7f476c0737f0 0x7f476c075c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.547+0000 7f14a17fa640 1 --2- 172.21.15.33:0/4144104906 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f148406b4d0 0x7f148406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.547+0000 7fa6c9ffb640 1 --2- 172.21.15.33:0/2197227088 >> [v2:172.21.15.174:6816/2326407945,v1:172.21.15.174:6817/2326407945] conn(0x7fa6b80737f0 0x7fa6b8075c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.547+0000 7f14a17fa640 1 -- 172.21.15.33:0/4144104906 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f149c089720 con 0x7f14a4142fb0 2024-05-08T10:55:00.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.547+0000 7fa6c9ffb640 1 -- 172.21.15.33:0/2197227088 --> [v2:172.21.15.174:6816/2326407945,v1:172.21.15.174:6817/2326407945] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa6d001de50 con 0x7fa6b80737f0 2024-05-08T10:55:00.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.547+0000 7fa6c9ffb640 1 -- 172.21.15.33:0/2197227088 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa6d008a830 con 0x7fa6d415f1a0 2024-05-08T10:55:00.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.547+0000 7fdf8bfff640 1 --2- 172.21.15.33:0/398140234 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fdf8406b500 0x7fdf8406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.547+0000 7f14a17fa640 1 --2- 172.21.15.33:0/4144104906 >> [v2:172.21.15.33:6802/4029047077,v1:172.21.15.33:6804/4029047077] conn(0x7f1484073670 0x7f1484075a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.547+0000 7fdf8bfff640 1 -- 172.21.15.33:0/398140234 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdfa0104840 con 0x7fdf980df410 2024-05-08T10:55:00.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.547+0000 7fa6d9c21640 1 --2- 172.21.15.33:0/2197227088 >> [v2:172.21.15.174:6816/2326407945,v1:172.21.15.174:6817/2326407945] conn(0x7fa6b80737f0 0x7fa6b8075c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.547+0000 7f14a17fa640 1 -- 172.21.15.33:0/4144104906 --> [v2:172.21.15.33:6802/4029047077,v1:172.21.15.33:6804/4029047077] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f149c011e50 con 0x7f1484073670 2024-05-08T10:55:00.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.548+0000 7f14a17fa640 1 -- 172.21.15.33:0/4144104906 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f149c090050 con 0x7f14a4142fb0 2024-05-08T10:55:00.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.548+0000 7f6700ff9640 1 -- 172.21.15.33:0/3547047589 <== osd.7 v2:172.21.15.174:6808/1637570253 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f67040677f0 con 0x7f66e80736d0 2024-05-08T10:55:00.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.548+0000 7f8f4affd640 1 --2- 172.21.15.33:0/1416397490 >> [v2:172.21.15.33:6824/1758076090,v1:172.21.15.33:6825/1758076090] conn(0x7f8f44046dc0 0x7f8f44049990 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:00.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.548+0000 7f14a3fff640 1 --2- 172.21.15.33:0/4144104906 >> [v2:172.21.15.33:6802/4029047077,v1:172.21.15.33:6804/4029047077] conn(0x7f1484073670 0x7f1484075a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.548+0000 7fa6d9420640 1 --2- 172.21.15.33:0/2197227088 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fa6b806b5d0 0x7fa6b806da90 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc007540 tx=0x7fa6cc00d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:00.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.548+0000 7f477effd640 1 --2- 172.21.15.33:0/1856486369 >> [v2:172.21.15.174:6824/1511860729,v1:172.21.15.174:6825/1511860729] conn(0x7f476c0737f0 0x7f476c075c10 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:00.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.548+0000 7fdf8bfff640 1 --2- 172.21.15.33:0/398140234 >> [v2:172.21.15.174:6800/1697399220,v1:172.21.15.174:6801/1697399220] conn(0x7fdf84073720 0x7fdf84075b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.548+0000 7fdf8bfff640 1 -- 172.21.15.33:0/398140234 --> [v2:172.21.15.174:6800/1697399220,v1:172.21.15.174:6801/1697399220] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdfa0095ec0 con 0x7fdf84073720 2024-05-08T10:55:00.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.548+0000 7fdf8bfff640 1 -- 172.21.15.33:0/398140234 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdfa010a250 con 0x7fdf980df410 2024-05-08T10:55:00.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.548+0000 7fdf9f7fe640 1 --2- 172.21.15.33:0/398140234 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fdf8406b500 0x7fdf8406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.548+0000 7fdf9effd640 1 --2- 172.21.15.33:0/398140234 >> [v2:172.21.15.174:6800/1697399220,v1:172.21.15.174:6801/1697399220] conn(0x7fdf84073720 0x7fdf84075b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.548+0000 7fa6d9c21640 1 --2- 172.21.15.33:0/2197227088 >> [v2:172.21.15.174:6816/2326407945,v1:172.21.15.174:6817/2326407945] conn(0x7fa6b80737f0 0x7fa6b8075c10 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:00.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.548+0000 7f14a8dd4640 1 --2- 172.21.15.33:0/4144104906 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f148406b4d0 0x7f148406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.548+0000 7fdf9effd640 1 --2- 172.21.15.33:0/398140234 >> [v2:172.21.15.174:6800/1697399220,v1:172.21.15.174:6801/1697399220] conn(0x7fdf84073720 0x7fdf84075b40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:00.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.548+0000 7f14a3fff640 1 --2- 172.21.15.33:0/4144104906 >> [v2:172.21.15.33:6802/4029047077,v1:172.21.15.33:6804/4029047077] conn(0x7f1484073670 0x7f1484075a90 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:00.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.549+0000 7f8f37fff640 1 -- 172.21.15.33:0/1416397490 <== osd.1 v2:172.21.15.33:6824/1758076090 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f8f4c04f0a0 con 0x7f8f44046dc0 2024-05-08T10:55:00.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.549+0000 7f14a8dd4640 1 --2- 172.21.15.33:0/4144104906 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f148406b4d0 0x7f148406d990 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f14a4131ad0 tx=0x7f148c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:00.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.549+0000 7f4767fff640 1 -- 172.21.15.33:0/1856486369 <== osd.5 v2:172.21.15.174:6824/1511860729 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f4778015ec0 con 0x7f476c0737f0 2024-05-08T10:55:00.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.549+0000 7fdf9f7fe640 1 --2- 172.21.15.33:0/398140234 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fdf8406b500 0x7fdf8406d9c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fdf94000f60 tx=0x7fdf94009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:00.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.549+0000 7fa6c9ffb640 1 -- 172.21.15.33:0/2197227088 <== osd.6 v2:172.21.15.174:6816/2326407945 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fa6d001de50 con 0x7fa6b80737f0 2024-05-08T10:55:00.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.550+0000 7fdf8bfff640 1 -- 172.21.15.33:0/398140234 <== osd.4 v2:172.21.15.174:6800/1697399220 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fdfa0095ec0 con 0x7fdf84073720 2024-05-08T10:55:00.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.550+0000 7f14a17fa640 1 -- 172.21.15.33:0/4144104906 <== osd.3 v2:172.21.15.33:6802/4029047077 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f149c011e50 con 0x7f1484073670 2024-05-08T10:55:00.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.580+0000 7fcf7c407640 1 -- 172.21.15.33:0/418694581 --> [v2:172.21.15.33:6800/2940853479,v1:172.21.15.33:6801/2940853479] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fcf7406b190 con 0x7fcf580737a0 2024-05-08T10:55:00.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.581+0000 7fcf6affd640 1 -- 172.21.15.33:0/418694581 <== osd.2 v2:172.21.15.33:6800/2940853479 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fcf7406b190 con 0x7fcf580737a0 2024-05-08T10:55:00.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.582+0000 7fd71d597640 1 -- 172.21.15.33:0/1249348392 --> [v2:172.21.15.33:6816/3990629207,v1:172.21.15.33:6817/3990629207] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd6fc002dd0 con 0x7fd6f8074430 2024-05-08T10:55:00.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.582+0000 7fcf68ff9640 1 -- 172.21.15.33:0/418694581 >> [v2:172.21.15.33:6800/2940853479,v1:172.21.15.33:6801/2940853479] conn(0x7fcf580737a0 msgr2=0x7fcf58075bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:00.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.582+0000 7fcf68ff9640 1 --2- 172.21.15.33:0/418694581 >> [v2:172.21.15.33:6800/2940853479,v1:172.21.15.33:6801/2940853479] conn(0x7fcf580737a0 0x7fcf58075bc0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:00.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.581+0000 7f66ee7fc640 1 -- 172.21.15.33:0/3547047589 --> [v2:172.21.15.174:6808/1637570253,v1:172.21.15.174:6809/1637570253] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f66dc002dd0 con 0x7f66e80736d0 2024-05-08T10:55:00.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.582+0000 7fcf68ff9640 1 -- 172.21.15.33:0/418694581 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fcf5806b5a0 msgr2=0x7fcf5806da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:00.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.582+0000 7fcf68ff9640 1 --2- 172.21.15.33:0/418694581 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fcf5806b5a0 0x7fcf5806da60 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fcf74138ff0 tx=0x7fcf70008040 comp rx=0 tx=0).stop 2024-05-08T10:55:00.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.582+0000 7fcf68ff9640 1 -- 172.21.15.33:0/418694581 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf7415ae30 msgr2=0x7fcf74151dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:00.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.582+0000 7fcf68ff9640 1 --2- 172.21.15.33:0/418694581 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf7415ae30 0x7fcf74151dc0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fcf64031000 tx=0x7fcf640046c0 comp rx=0 tx=0).stop 2024-05-08T10:55:00.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.582+0000 7fcf7a9a4640 1 -- 172.21.15.33:0/418694581 reap_dead start 2024-05-08T10:55:00.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.582+0000 7fcf68ff9640 1 -- 172.21.15.33:0/418694581 shutdown_connections 2024-05-08T10:55:00.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.582+0000 7fcf68ff9640 1 -- 172.21.15.33:0/418694581 >> 172.21.15.33:0/418694581 conn(0x7fcf7406aba0 msgr2=0x7fcf7415ca80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:00.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.582+0000 7f6700ff9640 1 -- 172.21.15.33:0/3547047589 <== osd.7 v2:172.21.15.174:6808/1637570253 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f66dc002dd0 con 0x7f66e80736d0 2024-05-08T10:55:00.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.582+0000 7fd714ff9640 1 -- 172.21.15.33:0/1249348392 <== osd.0 v2:172.21.15.33:6816/3990629207 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd6fc002dd0 con 0x7fd6f8074430 2024-05-08T10:55:00.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.582+0000 7fcf68ff9640 1 -- 172.21.15.33:0/418694581 shutdown_connections 2024-05-08T10:55:00.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.582+0000 7f8f51c1f640 1 -- 172.21.15.33:0/1416397490 --> [v2:172.21.15.33:6824/1758076090,v1:172.21.15.33:6825/1758076090] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8f4404b030 con 0x7f8f44046dc0 2024-05-08T10:55:00.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.582+0000 7f4784c99640 1 -- 172.21.15.33:0/1856486369 --> [v2:172.21.15.174:6824/1511860729,v1:172.21.15.174:6825/1511860729] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f478004efc0 con 0x7f476c0737f0 2024-05-08T10:55:00.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.583+0000 7f66ee7fc640 1 -- 172.21.15.33:0/3547047589 >> [v2:172.21.15.174:6808/1637570253,v1:172.21.15.174:6809/1637570253] conn(0x7f66e80736d0 msgr2=0x7f66e8075af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:00.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.583+0000 7f66ee7fc640 1 --2- 172.21.15.33:0/3547047589 >> [v2:172.21.15.174:6808/1637570253,v1:172.21.15.174:6809/1637570253] conn(0x7f66e80736d0 0x7f66e8075af0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:00.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.583+0000 7fa6db684640 1 -- 172.21.15.33:0/2197227088 --> [v2:172.21.15.174:6816/2326407945,v1:172.21.15.174:6817/2326407945] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa6b4002d50 con 0x7fa6b80737f0 2024-05-08T10:55:00.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.583+0000 7f66ee7fc640 1 -- 172.21.15.33:0/3547047589 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f66e806b4d0 msgr2=0x7f66e806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:00.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.583+0000 7f66ee7fc640 1 --2- 172.21.15.33:0/3547047589 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f66e806b4d0 0x7f66e806d990 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f66fc0371e0 tx=0x7f66f8008040 comp rx=0 tx=0).stop 2024-05-08T10:55:00.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.583+0000 7f66ee7fc640 1 -- 172.21.15.33:0/3547047589 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f66fc0366a0 msgr2=0x7f66fc034040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:00.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.583+0000 7f66ee7fc640 1 --2- 172.21.15.33:0/3547047589 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f66fc0366a0 0x7f66fc034040 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f6704064750 tx=0x7f6704069770 comp rx=0 tx=0).stop 2024-05-08T10:55:00.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.582+0000 7fcf68ff9640 1 -- 172.21.15.33:0/418694581 wait complete. 2024-05-08T10:55:00.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.583+0000 7f6708a6f640 1 -- 172.21.15.33:0/3547047589 reap_dead start 2024-05-08T10:55:00.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.583+0000 7f66ee7fc640 1 -- 172.21.15.33:0/3547047589 shutdown_connections 2024-05-08T10:55:00.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.583+0000 7f66ee7fc640 1 -- 172.21.15.33:0/3547047589 >> 172.21.15.33:0/3547047589 conn(0x7f66fc01e6c0 msgr2=0x7f66fc0078f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:00.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.583+0000 7f8f37fff640 1 -- 172.21.15.33:0/1416397490 <== osd.1 v2:172.21.15.33:6824/1758076090 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8f4404b030 con 0x7f8f44046dc0 2024-05-08T10:55:00.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.583+0000 7f4767fff640 1 -- 172.21.15.33:0/1856486369 <== osd.5 v2:172.21.15.174:6824/1511860729 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f478004efc0 con 0x7f476c0737f0 2024-05-08T10:55:00.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.583+0000 7fd71d597640 1 -- 172.21.15.33:0/1249348392 >> [v2:172.21.15.33:6816/3990629207,v1:172.21.15.33:6817/3990629207] conn(0x7fd6f8074430 msgr2=0x7fd6f80768d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:00.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.583+0000 7fd71d597640 1 --2- 172.21.15.33:0/1249348392 >> [v2:172.21.15.33:6816/3990629207,v1:172.21.15.33:6817/3990629207] conn(0x7fd6f8074430 0x7fd6f80768d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:00.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.583+0000 7fd71d597640 1 -- 172.21.15.33:0/1249348392 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fd6f806b700 msgr2=0x7fd6f806dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:00.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.583+0000 7fd71d597640 1 --2- 172.21.15.33:0/1249348392 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fd6f806b700 0x7fd6f806dbc0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd708034000 tx=0x7fd70802e000 comp rx=0 tx=0).stop 2024-05-08T10:55:00.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.583+0000 7fd71d597640 1 -- 172.21.15.33:0/1249348392 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd7180d0120 msgr2=0x7fd718153510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:00.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.583+0000 7fd71d597640 1 --2- 172.21.15.33:0/1249348392 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd7180d0120 0x7fd718153510 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd700001b70 tx=0x7fd700014420 comp rx=0 tx=0).stop 2024-05-08T10:55:00.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.583+0000 7fd71cd96640 1 -- 172.21.15.33:0/1249348392 reap_dead start 2024-05-08T10:55:00.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.583+0000 7fd71d597640 1 -- 172.21.15.33:0/1249348392 shutdown_connections 2024-05-08T10:55:00.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.583+0000 7fd71d597640 1 -- 172.21.15.33:0/1249348392 >> 172.21.15.33:0/1249348392 conn(0x7fd7180cf630 msgr2=0x7fd718070280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:00.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.583+0000 7fa6c9ffb640 1 -- 172.21.15.33:0/2197227088 <== osd.6 v2:172.21.15.174:6816/2326407945 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa6b4002d50 con 0x7fa6b80737f0 2024-05-08T10:55:00.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.583+0000 7f66ee7fc640 1 -- 172.21.15.33:0/3547047589 shutdown_connections 2024-05-08T10:55:00.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.583+0000 7f66ee7fc640 1 -- 172.21.15.33:0/3547047589 wait complete. 2024-05-08T10:55:00.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.583+0000 7fdfa60c4640 1 -- 172.21.15.33:0/398140234 --> [v2:172.21.15.174:6800/1697399220,v1:172.21.15.174:6801/1697399220] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fdf980053c0 con 0x7fdf84073720 2024-05-08T10:55:00.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.584+0000 7fd71d597640 1 -- 172.21.15.33:0/1249348392 shutdown_connections 2024-05-08T10:55:00.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.584+0000 7fd71d597640 1 -- 172.21.15.33:0/1249348392 wait complete. 2024-05-08T10:55:00.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.584+0000 7f4765ffb640 1 -- 172.21.15.33:0/1856486369 >> [v2:172.21.15.174:6824/1511860729,v1:172.21.15.174:6825/1511860729] conn(0x7f476c0737f0 msgr2=0x7f476c075c10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:00.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.584+0000 7fa6db684640 1 -- 172.21.15.33:0/2197227088 >> [v2:172.21.15.174:6816/2326407945,v1:172.21.15.174:6817/2326407945] conn(0x7fa6b80737f0 msgr2=0x7fa6b8075c10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:00.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.584+0000 7f4765ffb640 1 --2- 172.21.15.33:0/1856486369 >> [v2:172.21.15.174:6824/1511860729,v1:172.21.15.174:6825/1511860729] conn(0x7f476c0737f0 0x7f476c075c10 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:00.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.584+0000 7fa6db684640 1 --2- 172.21.15.33:0/2197227088 >> [v2:172.21.15.174:6816/2326407945,v1:172.21.15.174:6817/2326407945] conn(0x7fa6b80737f0 0x7fa6b8075c10 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:00.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.584+0000 7f8f51c1f640 1 -- 172.21.15.33:0/1416397490 >> [v2:172.21.15.33:6824/1758076090,v1:172.21.15.33:6825/1758076090] conn(0x7f8f44046dc0 msgr2=0x7f8f44049990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:00.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.584+0000 7f8f51c1f640 1 --2- 172.21.15.33:0/1416397490 >> [v2:172.21.15.33:6824/1758076090,v1:172.21.15.33:6825/1758076090] conn(0x7f8f44046dc0 0x7f8f44049990 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:00.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.584+0000 7f8f51c1f640 1 -- 172.21.15.33:0/1416397490 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f8f3006b520 msgr2=0x7f8f3006d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:00.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.584+0000 7f4765ffb640 1 -- 172.21.15.33:0/1856486369 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f476c06b5d0 msgr2=0x7f476c06da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:00.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.584+0000 7f4765ffb640 1 --2- 172.21.15.33:0/1856486369 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f476c06b5d0 0x7f476c06da90 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f477400d440 tx=0x7f4774008040 comp rx=0 tx=0).stop 2024-05-08T10:55:00.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.584+0000 7f4765ffb640 1 -- 172.21.15.33:0/1856486369 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f478014d6c0 msgr2=0x7f47801517f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:00.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.584+0000 7f4765ffb640 1 --2- 172.21.15.33:0/1856486369 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f478014d6c0 0x7f47801517f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f47800b5ab0 tx=0x7f4778006a80 comp rx=0 tx=0).stop 2024-05-08T10:55:00.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.584+0000 7f8f51c1f640 1 --2- 172.21.15.33:0/1416397490 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f8f3006b520 0x7f8f3006d9e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8f4000a7f0 tx=0x7f8f40008040 comp rx=0 tx=0).stop 2024-05-08T10:55:00.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.584+0000 7fa6db684640 1 -- 172.21.15.33:0/2197227088 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fa6b806b5d0 msgr2=0x7fa6b806da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:00.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.584+0000 7fa6db684640 1 --2- 172.21.15.33:0/2197227088 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fa6b806b5d0 0x7fa6b806da90 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc007540 tx=0x7fa6cc00d040 comp rx=0 tx=0).stop 2024-05-08T10:55:00.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.584+0000 7f8f51c1f640 1 -- 172.21.15.33:0/1416397490 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8f440ead00 msgr2=0x7f8f44035470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:00.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.584+0000 7f8f51c1f640 1 --2- 172.21.15.33:0/1416397490 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8f440ead00 0x7f8f44035470 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8f38009960 tx=0x7f8f380046c0 comp rx=0 tx=0).stop 2024-05-08T10:55:00.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.584+0000 7fdf8bfff640 1 -- 172.21.15.33:0/398140234 <== osd.4 v2:172.21.15.174:6800/1697399220 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fdf980053c0 con 0x7fdf84073720 2024-05-08T10:55:00.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.584+0000 7f477ffff640 1 -- 172.21.15.33:0/1856486369 reap_dead start 2024-05-08T10:55:00.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.584+0000 7f8f4bfff640 1 -- 172.21.15.33:0/1416397490 reap_dead start 2024-05-08T10:55:00.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.584+0000 7fa6db684640 1 -- 172.21.15.33:0/2197227088 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6d415f1a0 msgr2=0x7fa6d406eae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:00.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.584+0000 7fa6db684640 1 --2- 172.21.15.33:0/2197227088 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6d415f1a0 0x7fa6d406eae0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa6d000c5c0 tx=0x7fa6d000ca80 comp rx=0 tx=0).stop 2024-05-08T10:55:00.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.584+0000 7fa6d9c21640 1 -- 172.21.15.33:0/2197227088 reap_dead start 2024-05-08T10:55:00.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.584+0000 7f14a9dd6640 1 -- 172.21.15.33:0/4144104906 --> [v2:172.21.15.33:6802/4029047077,v1:172.21.15.33:6804/4029047077] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f14a404efc0 con 0x7f1484073670 2024-05-08T10:55:00.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.584+0000 7f8f51c1f640 1 -- 172.21.15.33:0/1416397490 shutdown_connections 2024-05-08T10:55:00.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.584+0000 7f8f51c1f640 1 -- 172.21.15.33:0/1416397490 >> 172.21.15.33:0/1416397490 conn(0x7f8f44009fb0 msgr2=0x7f8f44039380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:00.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.584+0000 7fa6db684640 1 -- 172.21.15.33:0/2197227088 shutdown_connections 2024-05-08T10:55:00.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.584+0000 7fa6db684640 1 -- 172.21.15.33:0/2197227088 >> 172.21.15.33:0/2197227088 conn(0x7fa6d40b3580 msgr2=0x7fa6d40ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:00.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.584+0000 7f4765ffb640 1 -- 172.21.15.33:0/1856486369 shutdown_connections 2024-05-08T10:55:00.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.584+0000 7f4765ffb640 1 -- 172.21.15.33:0/1856486369 >> 172.21.15.33:0/1856486369 conn(0x7f47800b22e0 msgr2=0x7f4780071370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:00.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.584+0000 7fa6db684640 1 -- 172.21.15.33:0/2197227088 shutdown_connections 2024-05-08T10:55:00.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.585+0000 7fa6db684640 1 -- 172.21.15.33:0/2197227088 wait complete. 2024-05-08T10:55:00.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.585+0000 7f14a17fa640 1 -- 172.21.15.33:0/4144104906 <== osd.3 v2:172.21.15.33:6802/4029047077 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f14a404efc0 con 0x7f1484073670 2024-05-08T10:55:00.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.585+0000 7f8f51c1f640 1 -- 172.21.15.33:0/1416397490 shutdown_connections 2024-05-08T10:55:00.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.585+0000 7fdfa60c4640 1 -- 172.21.15.33:0/398140234 >> [v2:172.21.15.174:6800/1697399220,v1:172.21.15.174:6801/1697399220] conn(0x7fdf84073720 msgr2=0x7fdf84075b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:00.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.585+0000 7f4765ffb640 1 -- 172.21.15.33:0/1856486369 shutdown_connections 2024-05-08T10:55:00.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.585+0000 7fdfa60c4640 1 --2- 172.21.15.33:0/398140234 >> [v2:172.21.15.174:6800/1697399220,v1:172.21.15.174:6801/1697399220] conn(0x7fdf84073720 0x7fdf84075b40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:00.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.585+0000 7f8f51c1f640 1 -- 172.21.15.33:0/1416397490 wait complete. 2024-05-08T10:55:00.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.585+0000 7fdfa60c4640 1 -- 172.21.15.33:0/398140234 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fdf8406b500 msgr2=0x7fdf8406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:00.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.585+0000 7fdfa60c4640 1 --2- 172.21.15.33:0/398140234 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fdf8406b500 0x7fdf8406d9c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fdf94000f60 tx=0x7fdf94009040 comp rx=0 tx=0).stop 2024-05-08T10:55:00.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.585+0000 7fdfa60c4640 1 -- 172.21.15.33:0/398140234 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdf980df410 msgr2=0x7fdf9804a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:00.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.585+0000 7fdfa60c4640 1 --2- 172.21.15.33:0/398140234 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdf980df410 0x7fdf9804a550 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fdfa004fd70 tx=0x7fdfa0073460 comp rx=0 tx=0).stop 2024-05-08T10:55:00.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.585+0000 7f4765ffb640 1 -- 172.21.15.33:0/1856486369 wait complete. 2024-05-08T10:55:00.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.585+0000 7fdf9ffff640 1 -- 172.21.15.33:0/398140234 reap_dead start 2024-05-08T10:55:00.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.586+0000 7fdfa60c4640 1 -- 172.21.15.33:0/398140234 shutdown_connections 2024-05-08T10:55:00.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.586+0000 7fdfa60c4640 1 -- 172.21.15.33:0/398140234 >> 172.21.15.33:0/398140234 conn(0x7fdf98009fe0 msgr2=0x7fdf98053fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:00.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.585+0000 7f14a9dd6640 1 -- 172.21.15.33:0/4144104906 >> [v2:172.21.15.33:6802/4029047077,v1:172.21.15.33:6804/4029047077] conn(0x7f1484073670 msgr2=0x7f1484075a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:00.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.585+0000 7f14a9dd6640 1 --2- 172.21.15.33:0/4144104906 >> [v2:172.21.15.33:6802/4029047077,v1:172.21.15.33:6804/4029047077] conn(0x7f1484073670 0x7f1484075a90 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:00.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.586+0000 7f14a9dd6640 1 -- 172.21.15.33:0/4144104906 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f148406b4d0 msgr2=0x7f148406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:00.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.586+0000 7f14a9dd6640 1 --2- 172.21.15.33:0/4144104906 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f148406b4d0 0x7f148406d990 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f14a4131ad0 tx=0x7f148c009040 comp rx=0 tx=0).stop 2024-05-08T10:55:00.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.586+0000 7f14a9dd6640 1 -- 172.21.15.33:0/4144104906 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f14a4142fb0 msgr2=0x7f14a4159520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:00.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.586+0000 7f14a9dd6640 1 --2- 172.21.15.33:0/4144104906 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f14a4142fb0 0x7f14a4159520 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f149c00c6f0 tx=0x7f149c00cbb0 comp rx=0 tx=0).stop 2024-05-08T10:55:00.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.586+0000 7f14a95d5640 1 -- 172.21.15.33:0/4144104906 reap_dead start 2024-05-08T10:55:00.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.586+0000 7f14a9dd6640 1 -- 172.21.15.33:0/4144104906 shutdown_connections 2024-05-08T10:55:00.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.586+0000 7f14a9dd6640 1 -- 172.21.15.33:0/4144104906 >> 172.21.15.33:0/4144104906 conn(0x7f14a40cf630 msgr2=0x7f14a40b0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:00.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.586+0000 7fdfa60c4640 1 -- 172.21.15.33:0/398140234 shutdown_connections 2024-05-08T10:55:00.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.586+0000 7fdfa60c4640 1 -- 172.21.15.33:0/398140234 wait complete. 2024-05-08T10:55:00.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.587+0000 7f14a9dd6640 1 -- 172.21.15.33:0/4144104906 shutdown_connections 2024-05-08T10:55:00.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.587+0000 7f14a9dd6640 1 -- 172.21.15.33:0/4144104906 wait complete. 2024-05-08T10:55:00.645 INFO:teuthology.orchestra.run.smithi033.stdout:55834574856 2024-05-08T10:55:00.645 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-08T10:55:00.646 INFO:teuthology.orchestra.run.smithi033.stdout:55834574857 2024-05-08T10:55:00.646 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-08T10:55:00.647 INFO:teuthology.orchestra.run.smithi033.stdout:55834574856 2024-05-08T10:55:00.648 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-08T10:55:00.648 INFO:teuthology.orchestra.run.smithi033.stdout:55834574856 2024-05-08T10:55:00.648 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-08T10:55:00.649 INFO:teuthology.orchestra.run.smithi033.stdout:55834574857 2024-05-08T10:55:00.649 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-08T10:55:00.650 INFO:teuthology.orchestra.run.smithi033.stdout:55834574856 2024-05-08T10:55:00.651 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-08T10:55:00.651 INFO:teuthology.orchestra.run.smithi033.stdout:55834574856 2024-05-08T10:55:00.651 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-08T10:55:00.652 INFO:teuthology.orchestra.run.smithi033.stdout:55834574856 2024-05-08T10:55:00.653 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-08T10:55:00.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.866+0000 7f9fdcfae640 1 Processor -- start 2024-05-08T10:55:00.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.867+0000 7f9fdcfae640 1 -- start start 2024-05-08T10:55:00.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.868+0000 7f9fdcfae640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f9fd0051030 0x7f9fd0007b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.868+0000 7f9fdcfae640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fd00081c0 con 0x7f9fd0050540 2024-05-08T10:55:00.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.868+0000 7f9fdcfae640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fd00084a0 con 0x7f9fd0054fd0 2024-05-08T10:55:00.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.868+0000 7f9fdcfae640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fd003a0e0 con 0x7f9fd0051030 2024-05-08T10:55:00.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.869+0000 7f9fd6ffd640 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f9fd0054fd0 0x7f9fd00e7bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.33:47912/0 (socket says 172.21.15.33:47912) 2024-05-08T10:55:00.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.869+0000 7f9fd6ffd640 1 -- 172.21.15.33:0/2806313302 learned_addr learned my addr 172.21.15.33:0/2806313302 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-05-08T10:55:00.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.869+0000 7f9fd7fff640 1 --2- 172.21.15.33:0/2806313302 >> v2:172.21.15.33:3300/0 conn(0x7f9fd0051030 0x7f9fd0007b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.869+0000 7f9fd7fff640 1 -- 172.21.15.33:0/2806313302 >> v1:172.21.15.174:6789/0 conn(0x7f9fd0054fd0 legacy=0x7f9fd00e7bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:00.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.869+0000 7f1703547640 1 Processor -- start 2024-05-08T10:55:00.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.870+0000 7f348f258640 1 Processor -- start 2024-05-08T10:55:00.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.870+0000 7f348f258640 1 -- start start 2024-05-08T10:55:00.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.870+0000 7f9fd67fc640 1 -- 172.21.15.33:0/2806313302 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2013829980 0 0) 0x7f9fd00084a0 con 0x7f9fd0054fd0 2024-05-08T10:55:00.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.870+0000 7f9fd7fff640 1 -- 172.21.15.33:0/2806313302 >> v1:172.21.15.33:6789/0 conn(0x7f9fd0050540 legacy=0x7f9fd0050920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:00.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.870+0000 7f9fd7fff640 1 -- 172.21.15.33:0/2806313302 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fd0008780 con 0x7f9fd0051030 2024-05-08T10:55:00.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.870+0000 7f1703547640 1 -- start start 2024-05-08T10:55:00.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.871+0000 7f131346a640 1 Processor -- start 2024-05-08T10:55:00.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.871+0000 7f131346a640 1 -- start start 2024-05-08T10:55:00.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.871+0000 7f348f258640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f34881617c0 0x7f34880d4690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.871+0000 7f1703547640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f16f40eacc0 0x7f16f404fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.871+0000 7f9fd7fff640 1 --2- 172.21.15.33:0/2806313302 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9fd0051030 0x7f9fd0007b50 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9fc40097a0 tx=0x7f9fc402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27b0b9f3683e06e6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:00.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.871+0000 7f348f258640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f34880d0750 0x7f34880b3680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.871+0000 7f72e943f640 1 Processor -- start 2024-05-08T10:55:00.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.872+0000 7f348f258640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34880d0dc0 con 0x7f34880b2ad0 2024-05-08T10:55:00.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.872+0000 7f348f258640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34880b32d0 con 0x7f34880d0750 2024-05-08T10:55:00.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.872+0000 7f348f258640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34880cf250 con 0x7f34881617c0 2024-05-08T10:55:00.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.872+0000 7f131346a640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f130c159f60 0x7f130c15a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.872+0000 7f9fd67fc640 1 -- 172.21.15.33:0/2806313302 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fc4037070 con 0x7f9fd0051030 2024-05-08T10:55:00.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.872+0000 7f9fd67fc640 1 -- 172.21.15.33:0/2806313302 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fc402ada0 con 0x7f9fd0051030 2024-05-08T10:55:00.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.872+0000 7f1703547640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f16f404ff90 0x7f16f4037b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.872+0000 7f1702545640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f16f40eacc0 0x7f16f404fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.872+0000 7f1702545640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f16f40eacc0 0x7f16f404fa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.33:58624/0 (socket says 172.21.15.33:58624) 2024-05-08T10:55:00.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.872+0000 7f1703547640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16f40536e0 con 0x7f16f40380d0 2024-05-08T10:55:00.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.872+0000 7f1703547640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16f40542f0 con 0x7f16f404ff90 2024-05-08T10:55:00.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.872+0000 7f1703547640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16f40539c0 con 0x7f16f40eacc0 2024-05-08T10:55:00.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.872+0000 7f1702545640 1 -- 172.21.15.33:0/3267418810 learned_addr learned my addr 172.21.15.33:0/3267418810 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:00.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.872+0000 7f1701d44640 1 --2- 172.21.15.33:0/3267418810 >> v2:172.21.15.33:3300/0 conn(0x7f16f404ff90 0x7f16f4037b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.872+0000 7f348d7f5640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f34880d0750 0x7f34880b3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.872+0000 7f348d7f5640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f34880d0750 0x7f34880b3680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37652/0 (socket says 172.21.15.33:37652) 2024-05-08T10:55:00.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.872+0000 7f348d7f5640 1 -- 172.21.15.33:0/1690559675 learned_addr learned my addr 172.21.15.33:0/1690559675 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:00.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.872+0000 7f3487fff640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f34880b2ad0 0x7f34880d0040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:43544/0 (socket says 172.21.15.33:43544) 2024-05-08T10:55:00.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.872+0000 7f34877fe640 1 -- 172.21.15.33:0/1690559675 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2628449180 0 0) 0x7f34880d0dc0 con 0x7f34880b2ad0 2024-05-08T10:55:00.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.872+0000 7f34877fe640 1 -- 172.21.15.33:0/1690559675 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3470003520 con 0x7f34880b2ad0 2024-05-08T10:55:00.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.873+0000 7f1311a07640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f130c0709d0 0x7f130c164d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:43560/0 (socket says 172.21.15.33:43560) 2024-05-08T10:55:00.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.873+0000 7f1311a07640 1 -- 172.21.15.33:0/1232814918 learned_addr learned my addr 172.21.15.33:0/1232814918 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-05-08T10:55:00.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.873+0000 7f131346a640 1 -- 172.21.15.33:0/1232814918 --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f130c06c4c0 con 0x7f130c0709d0 2024-05-08T10:55:00.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.871+0000 7f72e943f640 1 -- start start 2024-05-08T10:55:00.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.873+0000 7f1311206640 1 --2- 172.21.15.33:0/1232814918 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f130c159f60 0x7f130c15a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.873+0000 7f72e943f640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f72dc0e30b0 0x7f72dc057d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.873+0000 7f1701d44640 1 -- 172.21.15.33:0/3267418810 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f16f40eacc0 msgr2=0x7f16f404fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:00.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.873+0000 7f1701d44640 1 --2- 172.21.15.33:0/3267418810 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f16f40eacc0 0x7f16f404fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:00.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.873+0000 7f1701d44640 1 -- 172.21.15.33:0/3267418810 >> v1:172.21.15.33:6789/0 conn(0x7f16f40380d0 legacy=0x7f16f4038560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:00.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.873+0000 7f9fdcfae640 1 -- 172.21.15.33:0/2806313302 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9fd0051030 msgr2=0x7f9fd0007b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:00.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.873+0000 7f9fdcfae640 1 --2- 172.21.15.33:0/2806313302 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9fd0051030 0x7f9fd0007b50 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9fc40097a0 tx=0x7f9fc402a110 comp rx=0 tx=0).stop 2024-05-08T10:55:00.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.873+0000 7f1701d44640 1 -- 172.21.15.33:0/3267418810 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16f4053ca0 con 0x7f16f404ff90 2024-05-08T10:55:00.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.873+0000 7f1303fff640 1 -- 172.21.15.33:0/1232814918 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 573232264 0 0) 0x7f130c06c4c0 con 0x7f130c0709d0 2024-05-08T10:55:00.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.873+0000 7f72e943f640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f72dc03e830 0x7f72dc053be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.873+0000 7f72e943f640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f72dc054120 0x7f72dc0e6c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.873+0000 7f72e943f640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72dc0582c0 con 0x7f72dc03e830 2024-05-08T10:55:00.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.873+0000 7f72e943f640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72dc058560 con 0x7f72dc054120 2024-05-08T10:55:00.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.873+0000 7f72e943f640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72dc058840 con 0x7f72dc0e30b0 2024-05-08T10:55:00.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.873+0000 7f72e27fc640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f72dc03e830 0x7f72dc053be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.873+0000 7f72e27fc640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f72dc03e830 0x7f72dc053be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37662/0 (socket says 172.21.15.33:37662) 2024-05-08T10:55:00.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.873+0000 7f72e27fc640 1 -- 172.21.15.33:0/3595648911 learned_addr learned my addr 172.21.15.33:0/3595648911 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:00.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.873+0000 7f131346a640 1 -- 172.21.15.33:0/1232814918 --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f130c06c7a0 con 0x7f130c0723c0 2024-05-08T10:55:00.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.873+0000 7f131346a640 1 -- 172.21.15.33:0/1232814918 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f130c06ca80 con 0x7f130c159f60 2024-05-08T10:55:00.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.873+0000 7f9fdcfae640 1 -- 172.21.15.33:0/2806313302 shutdown_connections 2024-05-08T10:55:00.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.873+0000 7f9fdcfae640 1 --2- 172.21.15.33:0/2806313302 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9fd0051030 0x7f9fd0007b50 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:00.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.873+0000 7f9fdcfae640 1 -- 172.21.15.33:0/2806313302 >> 172.21.15.33:0/2806313302 conn(0x7f9fd0055bc0 msgr2=0x7f9fd0055fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:00.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.873+0000 7f72e2ffd640 1 --2- 172.21.15.33:0/3595648911 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f72dc0e30b0 0x7f72dc057d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.873+0000 7f9fdcfae640 1 -- 172.21.15.33:0/2806313302 shutdown_connections 2024-05-08T10:55:00.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.873+0000 7f72e37fe640 1 --2- 172.21.15.33:0/3595648911 >> v2:172.21.15.174:3300/0 conn(0x7f72dc054120 0x7f72dc0e6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.872+0000 7f348d7f5640 1 -- 172.21.15.33:0/1690559675 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f34881617c0 msgr2=0x7f34880d4690 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T10:55:00.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.872+0000 7f348d7f5640 1 --2- 172.21.15.33:0/1690559675 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f34881617c0 0x7f34880d4690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:00.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.872+0000 7f348d7f5640 1 -- 172.21.15.33:0/1690559675 >> v1:172.21.15.33:6789/0 conn(0x7f34880b2ad0 legacy=0x7f34880d0040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:00.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.872+0000 7f348d7f5640 1 -- 172.21.15.33:0/1690559675 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34880cf4a0 con 0x7f34880d0750 2024-05-08T10:55:00.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.874+0000 7f72e27fc640 1 -- 172.21.15.33:0/3595648911 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f72dc0e30b0 msgr2=0x7f72dc057d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:00.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.874+0000 7f72e27fc640 1 --2- 172.21.15.33:0/3595648911 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f72dc0e30b0 0x7f72dc057d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:00.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.874+0000 7f72e27fc640 1 -- 172.21.15.33:0/3595648911 >> v2:172.21.15.174:3300/0 conn(0x7f72dc054120 msgr2=0x7f72dc0e6c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:00.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.874+0000 7f72e27fc640 1 --2- 172.21.15.33:0/3595648911 >> v2:172.21.15.174:3300/0 conn(0x7f72dc054120 0x7f72dc0e6c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:00.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.874+0000 7f72e27fc640 1 -- 172.21.15.33:0/3595648911 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72dc058b20 con 0x7f72dc03e830 2024-05-08T10:55:00.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.874+0000 7f72e2ffd640 1 --2- 172.21.15.33:0/3595648911 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f72dc0e30b0 0x7f72dc057d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:55:00.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.874+0000 7f1303fff640 1 -- 172.21.15.33:0/1232814918 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12f8003520 con 0x7f130c0709d0 2024-05-08T10:55:00.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.874+0000 7f1303fff640 1 -- 172.21.15.33:0/1232814918 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 68880646 0 0) 0x7f130c06c7a0 con 0x7f130c0723c0 2024-05-08T10:55:00.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.874+0000 7f1303fff640 1 -- 172.21.15.33:0/1232814918 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f130c06c4c0 con 0x7f130c0723c0 2024-05-08T10:55:00.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.874+0000 7f348d7f5640 1 --2- 172.21.15.33:0/1690559675 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34880d0750 0x7f34880b3680 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3478009870 tx=0x7f347802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2069aed073019cab server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:00.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.875+0000 7f1701d44640 1 --2- 172.21.15.33:0/3267418810 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f16f404ff90 0x7f16f4037b90 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f16fc069af0 tx=0x7f16fc0a5030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd5ed4d3e455646e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:00.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.875+0000 7fd0cb481640 1 Processor -- start 2024-05-08T10:55:00.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.875+0000 7f1303fff640 1 -- 172.21.15.33:0/1232814918 <== mon.1 v1:172.21.15.174:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1884996604 0 0) 0x7f130c06c4c0 con 0x7f130c0723c0 2024-05-08T10:55:00.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.875+0000 7f1303fff640 1 -- 172.21.15.33:0/1232814918 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f130c159f60 msgr2=0x7f130c15a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:00.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.875+0000 7f1303fff640 1 --2- 172.21.15.33:0/1232814918 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f130c159f60 0x7f130c15a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:00.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.875+0000 7f1303fff640 1 -- 172.21.15.33:0/1232814918 >> v1:172.21.15.33:6789/0 conn(0x7f130c0709d0 legacy=0x7f130c164d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:00.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.875+0000 7fd0cb481640 1 -- start start 2024-05-08T10:55:00.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.875+0000 7f1303fff640 1 -- 172.21.15.33:0/1232814918 --> v1:172.21.15.174:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f130c06cd60 con 0x7f130c0723c0 2024-05-08T10:55:00.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.875+0000 7f1303fff640 1 -- 172.21.15.33:0/1232814918 <== mon.1 v1:172.21.15.174:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2948294915 0 0) 0x7f12fc001670 con 0x7f130c0723c0 2024-05-08T10:55:00.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.875+0000 7f1303fff640 1 -- 172.21.15.33:0/1232814918 >> v1:172.21.15.174:6789/0 conn(0x7f130c0723c0 legacy=0x7f130c0702c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:00.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.875+0000 7f1303fff640 1 --2- 172.21.15.33:0/1232814918 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f12f8004ba0 0x7f12f8004fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.875+0000 7f1303fff640 1 --2- 172.21.15.33:0/1232814918 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12f80037a0 0x7f12f8003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.875+0000 7f1303fff640 1 --2- 172.21.15.33:0/1232814918 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f12f8004160 0x7f12f800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.875+0000 7f1303fff640 1 -- 172.21.15.33:0/1232814918 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f130c06ca80 con 0x7f12f80037a0 2024-05-08T10:55:00.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.875+0000 7f1303fff640 1 -- 172.21.15.33:0/1232814918 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12f800c010 con 0x7f12f8004160 2024-05-08T10:55:00.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.875+0000 7f1303fff640 1 -- 172.21.15.33:0/1232814918 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12f800c210 con 0x7f12f8004ba0 2024-05-08T10:55:00.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.875+0000 7f05d2657640 1 Processor -- start 2024-05-08T10:55:00.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.875+0000 7f05d2657640 1 -- start start 2024-05-08T10:55:00.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.875+0000 7f1310a05640 1 --2- 172.21.15.33:0/1232814918 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12f80037a0 0x7f12f8003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.875+0000 7f1311a07640 1 --2- 172.21.15.33:0/1232814918 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f12f8004160 0x7f12f800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.875+0000 7f34877fe640 1 -- 172.21.15.33:0/1690559675 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3478037070 con 0x7f34880d0750 2024-05-08T10:55:00.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.875+0000 7f72e27fc640 1 --2- 172.21.15.33:0/3595648911 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72dc03e830 0x7f72dc053be0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f72e4062820 tx=0x7f72e40a5100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e22a5cb50dc6612 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:00.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.875+0000 7f34877fe640 1 -- 172.21.15.33:0/1690559675 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3478032440 con 0x7f34880d0750 2024-05-08T10:55:00.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.875+0000 7f34877fe640 1 -- 172.21.15.33:0/1690559675 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3478032810 con 0x7f34880d0750 2024-05-08T10:55:00.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.875+0000 7f1701543640 1 -- 172.21.15.33:0/3267418810 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16fc0b2070 con 0x7f16f404ff90 2024-05-08T10:55:00.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.875+0000 7f1701543640 1 -- 172.21.15.33:0/3267418810 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16fc0a5e40 con 0x7f16f404ff90 2024-05-08T10:55:00.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.875+0000 7f1701543640 1 -- 172.21.15.33:0/3267418810 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16fc0ad640 con 0x7f16f404ff90 2024-05-08T10:55:00.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.875+0000 7f1311206640 1 --2- 172.21.15.33:0/1232814918 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f12f8004ba0 0x7f12f8004fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.876+0000 7f1310a05640 1 -- 172.21.15.33:0/1232814918 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f12f8004ba0 msgr2=0x7f12f8004fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:00.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.876+0000 7f1310a05640 1 --2- 172.21.15.33:0/1232814918 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f12f8004ba0 0x7f12f8004fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:00.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.876+0000 7f1310a05640 1 -- 172.21.15.33:0/1232814918 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f12f8004160 msgr2=0x7f12f800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:00.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.876+0000 7f1310a05640 1 --2- 172.21.15.33:0/1232814918 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f12f8004160 0x7f12f800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:00.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.876+0000 7f1310a05640 1 -- 172.21.15.33:0/1232814918 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f130c06cd60 con 0x7f12f80037a0 2024-05-08T10:55:00.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.876+0000 7f1311a07640 1 --2- 172.21.15.33:0/1232814918 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f12f8004160 0x7f12f800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:55:00.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.876+0000 7f1311206640 1 --2- 172.21.15.33:0/1232814918 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f12f8004ba0 0x7f12f8004fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:55:00.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.876+0000 7f72e1ffb640 1 -- 172.21.15.33:0/3595648911 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72e40b2070 con 0x7f72dc03e830 2024-05-08T10:55:00.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.876+0000 7f72e1ffb640 1 -- 172.21.15.33:0/3595648911 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72e40ad440 con 0x7f72dc03e830 2024-05-08T10:55:00.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.876+0000 7f348f258640 1 -- 172.21.15.33:0/1690559675 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34880d0750 msgr2=0x7f34880b3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:00.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.876+0000 7f348f258640 1 --2- 172.21.15.33:0/1690559675 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34880d0750 0x7f34880b3680 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3478009870 tx=0x7f347802a270 comp rx=0 tx=0).stop 2024-05-08T10:55:00.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.875+0000 7f5f809f6640 1 Processor -- start 2024-05-08T10:55:00.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.876+0000 7f5f809f6640 1 -- start start 2024-05-08T10:55:00.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.876+0000 7f05d2657640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f05cc06df00 0x7f05cc0cfdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.876+0000 7f05d2657640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f05cc0d0300 0x7f05cc0ce020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.876+0000 7f05d2657640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05cc06c7a0 con 0x7f05cc145790 2024-05-08T10:55:00.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.876+0000 7f05d2657640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05cc0d0750 con 0x7f05cc06df00 2024-05-08T10:55:00.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.876+0000 7f05d2657640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05cc06ca10 con 0x7f05cc0d0300 2024-05-08T10:55:00.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.877+0000 7f348f258640 1 -- 172.21.15.33:0/1690559675 shutdown_connections 2024-05-08T10:55:00.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.877+0000 7f348f258640 1 --2- 172.21.15.33:0/1690559675 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34880d0750 0x7f34880b3680 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:00.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.877+0000 7f348f258640 1 --2- 172.21.15.33:0/1690559675 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f34881617c0 0x7f34880d4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:00.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.877+0000 7f348f258640 1 -- 172.21.15.33:0/1690559675 >> 172.21.15.33:0/1690559675 conn(0x7f34880d3b70 msgr2=0x7f34880d3f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:00.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.877+0000 7fd0cb481640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd0c40b4c60 0x7fd0c406bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.877+0000 7f5f809f6640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f5f7c0c8e10 0x7f5f7c16d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.877+0000 7f5f809f6640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f7c0d1130 con 0x7f5f7c0c6cb0 2024-05-08T10:55:00.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.877+0000 7f5f809f6640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f7c0cf7f0 con 0x7f5f7c0c7090 2024-05-08T10:55:00.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.877+0000 7f5f809f6640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f7c0c7970 con 0x7f5f7c0c8e10 2024-05-08T10:55:00.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.877+0000 7f72e943f640 1 -- 172.21.15.33:0/3595648911 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72dc03e830 msgr2=0x7f72dc053be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:00.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.877+0000 7f72e943f640 1 --2- 172.21.15.33:0/3595648911 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72dc03e830 0x7f72dc053be0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f72e4062820 tx=0x7f72e40a5100 comp rx=0 tx=0).stop 2024-05-08T10:55:00.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.877+0000 7fd0ca47f640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd0c40b4c60 0x7fd0c406bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.877+0000 7fd0ca47f640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd0c40b4c60 0x7fd0c406bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.33:58680/0 (socket says 172.21.15.33:58680) 2024-05-08T10:55:00.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.877+0000 7fd0ca47f640 1 -- 172.21.15.33:0/33056329 learned_addr learned my addr 172.21.15.33:0/33056329 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:00.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.877+0000 7fd0c9c7e640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fd0c406c1f0 0x7fd0c4071650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:43570/0 (socket says 172.21.15.33:43570) 2024-05-08T10:55:00.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.877+0000 7f5f7affd640 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f5f7c0c7090 0x7f5f7c0d0a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.33:47934/0 (socket says 172.21.15.33:47934) 2024-05-08T10:55:00.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.877+0000 7f5f7affd640 1 -- 172.21.15.33:0/744437630 learned_addr learned my addr 172.21.15.33:0/744437630 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-05-08T10:55:00.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.877+0000 7f5f7bfff640 1 --2- 172.21.15.33:0/744437630 >> v2:172.21.15.174:3300/0 conn(0x7f5f7c0c8e10 0x7f5f7c16d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.877+0000 7f05cbfff640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f05cc145790 0x7f05cc0cc330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:43568/0 (socket says 172.21.15.33:43568) 2024-05-08T10:55:00.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.877+0000 7f05cbfff640 1 -- 172.21.15.33:0/852120227 learned_addr learned my addr 172.21.15.33:0/852120227 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-05-08T10:55:00.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.877+0000 7f05d0bf4640 1 --2- 172.21.15.33:0/852120227 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f05cc0d0300 0x7f05cc0ce020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.877+0000 7f05cb7fe640 1 --2- 172.21.15.33:0/852120227 >> v2:172.21.15.33:3300/0 conn(0x7f05cc06df00 0x7f05cc0cfdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.877+0000 7f1310a05640 1 --2- 172.21.15.33:0/1232814918 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12f80037a0 0x7f12f8003c20 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f12fc00c160 tx=0x7f12f8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=404cd7cd68a590cf server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:00.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.874+0000 7f9fdcfae640 1 -- 172.21.15.33:0/2806313302 wait complete. 2024-05-08T10:55:00.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.876+0000 7f9fdcfae640 1 Processor -- start 2024-05-08T10:55:00.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.876+0000 7f9fdcfae640 1 -- start start 2024-05-08T10:55:00.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.877+0000 7fd0cb481640 1 -- 172.21.15.33:0/33056329 --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0c415e560 con 0x7fd0c406c1f0 2024-05-08T10:55:00.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.877+0000 7f9fdcfae640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9fd0050540 0x7f9fd0186780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.877+0000 7f9fdcfae640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9fd0051030 0x7f9fd0183140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.877+0000 7f9fdcfae640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9fd0054fd0 0x7f9fd00e2510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.877+0000 7f9fdcfae640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd0054370 con 0x7f9fd0051030 2024-05-08T10:55:00.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.877+0000 7f9fdcfae640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd0008d40 con 0x7f9fd0054fd0 2024-05-08T10:55:00.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.877+0000 7f9fdcfae640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd0009260 con 0x7f9fd0050540 2024-05-08T10:55:00.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.877+0000 7f9fd77fe640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9fd0050540 0x7f9fd0186780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.877+0000 7f9fd77fe640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9fd0050540 0x7f9fd0186780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.33:58686/0 (socket says 172.21.15.33:58686) 2024-05-08T10:55:00.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.877+0000 7f9fd77fe640 1 -- 172.21.15.33:0/390550757 learned_addr learned my addr 172.21.15.33:0/390550757 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:00.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.878+0000 7fd0cb481640 1 -- 172.21.15.33:0/33056329 --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0c415e840 con 0x7fd0c4071d60 2024-05-08T10:55:00.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.877+0000 7f9fd6ffd640 1 --2- 172.21.15.33:0/390550757 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9fd0051030 0x7f9fd0183140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.878+0000 7fd0cb481640 1 -- 172.21.15.33:0/33056329 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c40721f0 con 0x7fd0c40b4c60 2024-05-08T10:55:00.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.877+0000 7f72e943f640 1 -- 172.21.15.33:0/3595648911 shutdown_connections 2024-05-08T10:55:00.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.877+0000 7f72e943f640 1 --2- 172.21.15.33:0/3595648911 >> v2:172.21.15.174:3300/0 conn(0x7f72dc054120 0x7f72dc0e6c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:00.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.877+0000 7f72e943f640 1 --2- 172.21.15.33:0/3595648911 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72dc03e830 0x7f72dc053be0 secure :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f72e4062820 tx=0x7f72e40a5100 comp rx=0 tx=0).stop 2024-05-08T10:55:00.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.877+0000 7f72e943f640 1 --2- 172.21.15.33:0/3595648911 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f72dc0e30b0 0x7f72dc057d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:00.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.877+0000 7f72e943f640 1 -- 172.21.15.33:0/3595648911 >> 172.21.15.33:0/3595648911 conn(0x7f72dc0559d0 msgr2=0x7f72dc055de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:00.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.877+0000 7f1703547640 1 -- 172.21.15.33:0/3267418810 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f16f404ff90 msgr2=0x7f16f4037b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:00.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.877+0000 7f1703547640 1 --2- 172.21.15.33:0/3267418810 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f16f404ff90 0x7f16f4037b90 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f16fc069af0 tx=0x7f16fc0a5030 comp rx=0 tx=0).stop 2024-05-08T10:55:00.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.878+0000 7f348f258640 1 -- 172.21.15.33:0/1690559675 shutdown_connections 2024-05-08T10:55:00.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.878+0000 7f5f7bfff640 1 -- 172.21.15.33:0/744437630 >> v1:172.21.15.174:6789/0 conn(0x7f5f7c0c7090 legacy=0x7f5f7c0d0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:00.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.878+0000 7f5f7bfff640 1 -- 172.21.15.33:0/744437630 >> v1:172.21.15.33:6789/0 conn(0x7f5f7c0c6cb0 legacy=0x7f5f7c0d0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:00.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.878+0000 7f5f7a7fc640 1 -- 172.21.15.33:0/744437630 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1267200162 0 0) 0x7f5f7c0cf7f0 con 0x7f5f7c0c7090 2024-05-08T10:55:00.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.878+0000 7f5f7bfff640 1 -- 172.21.15.33:0/744437630 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f7c0cfad0 con 0x7f5f7c0c8e10 2024-05-08T10:55:00.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.878+0000 7f72e943f640 1 -- 172.21.15.33:0/3595648911 shutdown_connections 2024-05-08T10:55:00.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.878+0000 7f05d0bf4640 1 -- 172.21.15.33:0/852120227 >> v2:172.21.15.33:3300/0 conn(0x7f05cc06df00 msgr2=0x7f05cc0cfdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:00.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.878+0000 7f05d0bf4640 1 --2- 172.21.15.33:0/852120227 >> v2:172.21.15.33:3300/0 conn(0x7f05cc06df00 0x7f05cc0cfdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:00.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.878+0000 7f05d0bf4640 1 -- 172.21.15.33:0/852120227 >> v1:172.21.15.33:6789/0 conn(0x7f05cc145790 legacy=0x7f05cc0cc330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:00.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.878+0000 7f05d0bf4640 1 -- 172.21.15.33:0/852120227 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05cc06ccf0 con 0x7f05cc0d0300 2024-05-08T10:55:00.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.878+0000 7f9fd7fff640 1 --2- 172.21.15.33:0/390550757 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9fd0054fd0 0x7f9fd00e2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.878+0000 7f9fd77fe640 1 -- 172.21.15.33:0/390550757 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9fd0054fd0 msgr2=0x7f9fd00e2510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:00.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.878+0000 7fd0c947d640 1 -- 172.21.15.33:0/33056329 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1524183016 0 0) 0x7fd0c415e840 con 0x7fd0c4071d60 2024-05-08T10:55:00.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.878+0000 7fd0c947d640 1 -- 172.21.15.33:0/33056329 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0b0003520 con 0x7fd0c4071d60 2024-05-08T10:55:00.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.878+0000 7f9fd77fe640 1 --2- 172.21.15.33:0/390550757 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9fd0054fd0 0x7f9fd00e2510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:00.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.878+0000 7f348f258640 1 -- 172.21.15.33:0/1690559675 wait complete. 2024-05-08T10:55:00.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.878+0000 7f9fd77fe640 1 -- 172.21.15.33:0/390550757 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9fd0051030 msgr2=0x7f9fd0183140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:00.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.878+0000 7fd0c947d640 1 -- 172.21.15.33:0/33056329 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4247082728 0 0) 0x7fd0c415e560 con 0x7fd0c406c1f0 2024-05-08T10:55:00.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.878+0000 7f9fd77fe640 1 --2- 172.21.15.33:0/390550757 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9fd0051030 0x7f9fd0183140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:00.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.878+0000 7fd0c947d640 1 -- 172.21.15.33:0/33056329 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0c415e840 con 0x7fd0c406c1f0 2024-05-08T10:55:00.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.878+0000 7fd0c947d640 1 -- 172.21.15.33:0/33056329 <== mon.1 v1:172.21.15.174:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 173383030 0 0) 0x7fd0b0003520 con 0x7fd0c4071d60 2024-05-08T10:55:00.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.878+0000 7fd0c947d640 1 -- 172.21.15.33:0/33056329 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd0c40b4c60 msgr2=0x7fd0c406bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:00.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.878+0000 7fd0c947d640 1 --2- 172.21.15.33:0/33056329 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd0c40b4c60 0x7fd0c406bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:00.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.878+0000 7fd0c947d640 1 -- 172.21.15.33:0/33056329 >> v1:172.21.15.33:6789/0 conn(0x7fd0c406c1f0 legacy=0x7fd0c4071650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:00.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.878+0000 7fd0c947d640 1 -- 172.21.15.33:0/33056329 --> v1:172.21.15.174:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0c415eb20 con 0x7fd0c4071d60 2024-05-08T10:55:00.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.878+0000 7fd0c947d640 1 -- 172.21.15.33:0/33056329 <== mon.1 v1:172.21.15.174:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2948294915 0 0) 0x7fd0bc0019f0 con 0x7fd0c4071d60 2024-05-08T10:55:00.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.878+0000 7fd0c947d640 1 -- 172.21.15.33:0/33056329 >> v1:172.21.15.174:6789/0 conn(0x7fd0c4071d60 legacy=0x7fd0c40cd850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:00.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.878+0000 7f9fd77fe640 1 -- 172.21.15.33:0/390550757 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fd0186cc0 con 0x7f9fd0050540 2024-05-08T10:55:00.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.878+0000 7f9fd6ffd640 1 --2- 172.21.15.33:0/390550757 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9fd0051030 0x7f9fd0183140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:55:00.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.878+0000 7fd0c947d640 1 --2- 172.21.15.33:0/33056329 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd0b0003b40 0x7fd0b0003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.878+0000 7fd0c947d640 1 --2- 172.21.15.33:0/33056329 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd0b0004800 0x7fd0b0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.878+0000 7fd0c947d640 1 --2- 172.21.15.33:0/33056329 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd0b00051c0 0x7fd0b000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.879+0000 7fd0c947d640 1 -- 172.21.15.33:0/33056329 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c40721f0 con 0x7fd0b0004800 2024-05-08T10:55:00.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.879+0000 7fd0c947d640 1 -- 172.21.15.33:0/33056329 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b000bf00 con 0x7fd0b00051c0 2024-05-08T10:55:00.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.879+0000 7fd0c947d640 1 -- 172.21.15.33:0/33056329 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b000c100 con 0x7fd0b0003b40 2024-05-08T10:55:00.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.879+0000 7fd0ca47f640 1 --2- 172.21.15.33:0/33056329 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd0c40b4c60 0x7fd0c406bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T10:55:00.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.878+0000 7f72e943f640 1 -- 172.21.15.33:0/3595648911 wait complete. 2024-05-08T10:55:00.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.878+0000 7f9fd77fe640 1 --2- 172.21.15.33:0/390550757 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9fd0050540 0x7f9fd0186780 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f9fd8062820 tx=0x7f9fd8068ed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:00.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.878+0000 7f9fc3fff640 1 -- 172.21.15.33:0/390550757 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd8073320 con 0x7f9fd0050540 2024-05-08T10:55:00.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.878+0000 7f9fdcfae640 1 -- 172.21.15.33:0/390550757 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fd00e0b40 con 0x7f9fd0050540 2024-05-08T10:55:00.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.879+0000 7fd0c9c7e640 1 --2- 172.21.15.33:0/33056329 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd0b0004800 0x7fd0b0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.879+0000 7f9fdcfae640 1 -- 172.21.15.33:0/390550757 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fd00e1100 con 0x7f9fd0050540 2024-05-08T10:55:00.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.879+0000 7f9fc3fff640 1 -- 172.21.15.33:0/390550757 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fd80685f0 con 0x7f9fd0050540 2024-05-08T10:55:00.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.879+0000 7f9fc3fff640 1 -- 172.21.15.33:0/390550757 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd80911d0 con 0x7f9fd0050540 2024-05-08T10:55:00.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.879+0000 7f1703547640 1 -- 172.21.15.33:0/3267418810 shutdown_connections 2024-05-08T10:55:00.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.879+0000 7f1703547640 1 --2- 172.21.15.33:0/3267418810 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f16f404ff90 0x7f16f4037b90 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:00.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.879+0000 7f1703547640 1 --2- 172.21.15.33:0/3267418810 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f16f40eacc0 0x7f16f404fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:00.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.879+0000 7f1703547640 1 -- 172.21.15.33:0/3267418810 >> 172.21.15.33:0/3267418810 conn(0x7f16f4009f70 msgr2=0x7f16f400a350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:00.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.879+0000 7f1703547640 1 -- 172.21.15.33:0/3267418810 shutdown_connections 2024-05-08T10:55:00.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.879+0000 7fd0ca47f640 1 --2- 172.21.15.33:0/33056329 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd0b0003b40 0x7fd0b0003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.879+0000 7f5f7bfff640 1 --2- 172.21.15.33:0/744437630 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f7c0c8e10 0x7f5f7c16d030 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5f700097a0 tx=0x7f5f7002a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c3722cffec130c7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:00.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.879+0000 7fd0c9c7e640 1 -- 172.21.15.33:0/33056329 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd0b0003b40 msgr2=0x7fd0b0003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:00.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.879+0000 7fd0c9c7e640 1 --2- 172.21.15.33:0/33056329 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd0b0003b40 0x7fd0b0003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:00.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.879+0000 7fd0c9c7e640 1 -- 172.21.15.33:0/33056329 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd0b00051c0 msgr2=0x7fd0b000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:00.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.879+0000 7fd0c9c7e640 1 --2- 172.21.15.33:0/33056329 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd0b00051c0 0x7fd0b000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:00.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.879+0000 7fd0c9c7e640 1 -- 172.21.15.33:0/33056329 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0c415eb20 con 0x7fd0b0004800 2024-05-08T10:55:00.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.879+0000 7f1303fff640 1 -- 172.21.15.33:0/1232814918 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12fc007c20 con 0x7f12f80037a0 2024-05-08T10:55:00.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.879+0000 7f1303fff640 1 -- 172.21.15.33:0/1232814918 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12fc031620 con 0x7f12f80037a0 2024-05-08T10:55:00.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.879+0000 7f1303fff640 1 -- 172.21.15.33:0/1232814918 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12fc031a10 con 0x7f12f80037a0 2024-05-08T10:55:00.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.880+0000 7f131346a640 1 -- 172.21.15.33:0/1232814918 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12f80037a0 msgr2=0x7f12f8003c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:00.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.880+0000 7f5f7a7fc640 1 -- 172.21.15.33:0/744437630 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f70037070 con 0x7f5f7c0c8e10 2024-05-08T10:55:00.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.880+0000 7f5f7a7fc640 1 -- 172.21.15.33:0/744437630 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f70032440 con 0x7f5f7c0c8e10 2024-05-08T10:55:00.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.880+0000 7f72e943f640 1 Processor -- start 2024-05-08T10:55:00.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.880+0000 7f131346a640 1 --2- 172.21.15.33:0/1232814918 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12f80037a0 0x7f12f8003c20 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f12fc00c160 tx=0x7f12f8005830 comp rx=0 tx=0).stop 2024-05-08T10:55:00.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.880+0000 7f1311a07640 1 -- 172.21.15.33:0/1232814918 reap_dead start 2024-05-08T10:55:00.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.880+0000 7f131346a640 1 -- 172.21.15.33:0/1232814918 shutdown_connections 2024-05-08T10:55:00.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.880+0000 7f131346a640 1 -- 172.21.15.33:0/1232814918 >> 172.21.15.33:0/1232814918 conn(0x7f130c0b13e0 msgr2=0x7f130c0b17c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:00.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.880+0000 7f05d0bf4640 1 --2- 172.21.15.33:0/852120227 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f05cc0d0300 0x7f05cc0ce020 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f05bc0097a0 tx=0x7f05bc02a110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f5d45936b92519d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:00.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.880+0000 7f05caffd640 1 -- 172.21.15.33:0/852120227 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05bc037070 con 0x7f05cc0d0300 2024-05-08T10:55:00.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.880+0000 7f05caffd640 1 -- 172.21.15.33:0/852120227 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05bc032440 con 0x7f05cc0d0300 2024-05-08T10:55:00.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.880+0000 7f05caffd640 1 -- 172.21.15.33:0/852120227 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05bc02ae60 con 0x7f05cc0d0300 2024-05-08T10:55:00.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.880+0000 7f72e943f640 1 -- start start 2024-05-08T10:55:00.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.881+0000 7f348f258640 1 Processor -- start 2024-05-08T10:55:00.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.881+0000 7f131346a640 1 -- 172.21.15.33:0/1232814918 shutdown_connections 2024-05-08T10:55:00.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.881+0000 7f131346a640 1 -- 172.21.15.33:0/1232814918 wait complete. 2024-05-08T10:55:00.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.881+0000 7f348f258640 1 -- start start 2024-05-08T10:55:00.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.881+0000 7f5f809f6640 1 -- 172.21.15.33:0/744437630 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f7c0c8e10 msgr2=0x7f5f7c16d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:00.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.881+0000 7f5f809f6640 1 --2- 172.21.15.33:0/744437630 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f7c0c8e10 0x7f5f7c16d030 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5f700097a0 tx=0x7f5f7002a1a0 comp rx=0 tx=0).stop 2024-05-08T10:55:00.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.879+0000 7fd0ca47f640 1 --2- 172.21.15.33:0/33056329 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd0b0003b40 0x7fd0b0003f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:55:00.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.881+0000 7f5f809f6640 1 -- 172.21.15.33:0/744437630 shutdown_connections 2024-05-08T10:55:00.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.881+0000 7f5f809f6640 1 --2- 172.21.15.33:0/744437630 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f7c0c8e10 0x7f5f7c16d030 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:00.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.881+0000 7f5f809f6640 1 -- 172.21.15.33:0/744437630 >> 172.21.15.33:0/744437630 conn(0x7f5f7c0d3980 msgr2=0x7f5f7c0d3d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:00.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.881+0000 7f9fc3fff640 1 -- 172.21.15.33:0/390550757 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9fd8094030 con 0x7f9fd0050540 2024-05-08T10:55:00.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.881+0000 7fd0c9c7e640 1 --2- 172.21.15.33:0/33056329 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd0b0004800 0x7fd0b0004c80 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd0b4007fd0 tx=0x7fd0b0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4aebf3e06601b3d8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:00.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.881+0000 7f72e943f640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72dc054120 0x7f72dc052410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.879+0000 7f1703547640 1 -- 172.21.15.33:0/3267418810 wait complete. 2024-05-08T10:55:00.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.881+0000 7f72e943f640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f72dc0e30b0 0x7f72dc17e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.881+0000 7f1703547640 1 Processor -- start 2024-05-08T10:55:00.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.881+0000 7f05d2657640 1 -- 172.21.15.33:0/852120227 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f05cc0d0300 msgr2=0x7f05cc0ce020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:00.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.881+0000 7f05d2657640 1 --2- 172.21.15.33:0/852120227 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f05cc0d0300 0x7f05cc0ce020 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f05bc0097a0 tx=0x7f05bc02a110 comp rx=0 tx=0).stop 2024-05-08T10:55:00.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.881+0000 7fd0c947d640 1 -- 172.21.15.33:0/33056329 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b4001520 con 0x7fd0b0004800 2024-05-08T10:55:00.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.881+0000 7fd0c947d640 1 -- 172.21.15.33:0/33056329 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0b402e070 con 0x7fd0b0004800 2024-05-08T10:55:00.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.882+0000 7f05d2657640 1 -- 172.21.15.33:0/852120227 shutdown_connections 2024-05-08T10:55:00.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.882+0000 7f05d2657640 1 --2- 172.21.15.33:0/852120227 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f05cc0d0300 0x7f05cc0ce020 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:00.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.882+0000 7f05d2657640 1 --2- 172.21.15.33:0/852120227 >> v2:172.21.15.33:3300/0 conn(0x7f05cc06df00 0x7f05cc0cfdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:00.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.882+0000 7f72e943f640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f72dc16c1b0 0x7f72dc0e4c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.882+0000 7f05d2657640 1 -- 172.21.15.33:0/852120227 >> 172.21.15.33:0/852120227 conn(0x7f05cc06afc0 msgr2=0x7f05cc06b3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:00.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.881+0000 7fd0c947d640 1 -- 172.21.15.33:0/33056329 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b4007070 con 0x7fd0b0004800 2024-05-08T10:55:00.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.882+0000 7f72e943f640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72dc0e3490 con 0x7f72dc054120 2024-05-08T10:55:00.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.882+0000 7f72e943f640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72dc03bfb0 con 0x7f72dc16c1b0 2024-05-08T10:55:00.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.882+0000 7f72e27fc640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f72dc0e30b0 0x7f72dc17e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.882+0000 7f9fc3fff640 1 --2- 172.21.15.33:0/390550757 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f9fbc06b4d0 0x7f9fbc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.882+0000 7f9fc3fff640 1 -- 172.21.15.33:0/390550757 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9fd8103e70 con 0x7f9fd0050540 2024-05-08T10:55:00.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.882+0000 7f9fdcfae640 1 -- 172.21.15.33:0/390550757 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fb8005290 con 0x7f9fd0050540 2024-05-08T10:55:00.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.882+0000 7f5f809f6640 1 -- 172.21.15.33:0/744437630 shutdown_connections 2024-05-08T10:55:00.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.882+0000 7f72e27fc640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f72dc0e30b0 0x7f72dc17e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.33:58704/0 (socket says 172.21.15.33:58704) 2024-05-08T10:55:00.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.882+0000 7f72e27fc640 1 -- 172.21.15.33:0/778985573 learned_addr learned my addr 172.21.15.33:0/778985573 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:00.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.882+0000 7f72e2ffd640 1 --2- 172.21.15.33:0/778985573 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72dc054120 0x7f72dc052410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.882+0000 7f72e943f640 1 -- 172.21.15.33:0/778985573 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72dc0e7160 con 0x7f72dc0e30b0 2024-05-08T10:55:00.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.882+0000 7fd0cb481640 1 -- 172.21.15.33:0/33056329 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd0b0004800 msgr2=0x7fd0b0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:00.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.882+0000 7fd0cb481640 1 --2- 172.21.15.33:0/33056329 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd0b0004800 0x7fd0b0004c80 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd0b4007fd0 tx=0x7fd0b0005830 comp rx=0 tx=0).stop 2024-05-08T10:55:00.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.882+0000 7f05d2657640 1 -- 172.21.15.33:0/852120227 shutdown_connections 2024-05-08T10:55:00.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.882+0000 7f72e37fe640 1 --2- 172.21.15.33:0/778985573 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f72dc16c1b0 0x7f72dc0e4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.882+0000 7fd0cac80640 1 -- 172.21.15.33:0/33056329 reap_dead start 2024-05-08T10:55:00.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.882+0000 7f9fd6ffd640 1 --2- 172.21.15.33:0/390550757 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f9fbc06b4d0 0x7f9fbc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.882+0000 7f72e27fc640 1 -- 172.21.15.33:0/778985573 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f72dc16c1b0 msgr2=0x7f72dc0e4c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:00.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.882+0000 7f72e27fc640 1 --2- 172.21.15.33:0/778985573 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f72dc16c1b0 0x7f72dc0e4c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:00.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.882+0000 7f72e27fc640 1 -- 172.21.15.33:0/778985573 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72dc054120 msgr2=0x7f72dc052410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:00.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.883+0000 7f72e27fc640 1 --2- 172.21.15.33:0/778985573 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72dc054120 0x7f72dc052410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:00.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.882+0000 7f05d2657640 1 -- 172.21.15.33:0/852120227 wait complete. 2024-05-08T10:55:00.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.883+0000 7f348f258640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f34880b2ad0 0x7f34880cd5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.883+0000 7f72e27fc640 1 -- 172.21.15.33:0/778985573 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72dc16c770 con 0x7f72dc0e30b0 2024-05-08T10:55:00.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.883+0000 7f348f258640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34880d0750 0x7f348815ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.883+0000 7f348f258640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f34881617c0 0x7f34880cb650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.883+0000 7f348f258640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34880b3bc0 con 0x7f34880d0750 2024-05-08T10:55:00.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.883+0000 7f348f258640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34880cfa60 con 0x7f34881617c0 2024-05-08T10:55:00.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.883+0000 7f348f258640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34880b3d40 con 0x7f34880b2ad0 2024-05-08T10:55:00.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.883+0000 7f72e2ffd640 1 --2- 172.21.15.33:0/778985573 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72dc054120 0x7f72dc052410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T10:55:00.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.883+0000 7f9fd6ffd640 1 --2- 172.21.15.33:0/390550757 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f9fbc06b4d0 0x7f9fbc06d990 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9fd01870f0 tx=0x7f9fcc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:00.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.883+0000 7f131346a640 1 Processor -- start 2024-05-08T10:55:00.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.883+0000 7f72e27fc640 1 --2- 172.21.15.33:0/778985573 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f72dc0e30b0 0x7f72dc17e0b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f72e40508c0 tx=0x7f72e4069770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:00.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.883+0000 7f348d7f5640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f34881617c0 0x7f34880cb650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.883+0000 7f348d7f5640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f34881617c0 0x7f34880cb650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.33:50040/0 (socket says 172.21.15.33:50040) 2024-05-08T10:55:00.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.882+0000 7f1703547640 1 -- start start 2024-05-08T10:55:00.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.883+0000 7f348d7f5640 1 -- 172.21.15.33:0/4202469913 learned_addr learned my addr 172.21.15.33:0/4202469913 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:00.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.883+0000 7f131346a640 1 -- start start 2024-05-08T10:55:00.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.883+0000 7f3487fff640 1 --2- 172.21.15.33:0/4202469913 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34880d0750 0x7f348815ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.883+0000 7f348cff4640 1 --2- 172.21.15.33:0/4202469913 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f34880b2ad0 0x7f34880cd5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.882+0000 7f5f809f6640 1 -- 172.21.15.33:0/744437630 wait complete. 2024-05-08T10:55:00.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.884+0000 7fd0cb481640 1 -- 172.21.15.33:0/33056329 shutdown_connections 2024-05-08T10:55:00.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.884+0000 7fd0cb481640 1 -- 172.21.15.33:0/33056329 >> 172.21.15.33:0/33056329 conn(0x7fd0c40b23f0 msgr2=0x7fd0c40b27d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:00.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.884+0000 7f1703547640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f16f40380d0 0x7f16f4185930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.884+0000 7f05d2657640 1 Processor -- start 2024-05-08T10:55:00.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.884+0000 7f1703547640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f16f404ff90 0x7f16f402ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.884+0000 7f1703547640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f16f40eacc0 0x7f16f40e1830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.884+0000 7f1702545640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f16f40380d0 0x7f16f4185930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.884+0000 7f1703547640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16f4054780 con 0x7f16f40380d0 2024-05-08T10:55:00.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.884+0000 7f1703547640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16f4038c70 con 0x7f16f40eacc0 2024-05-08T10:55:00.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.884+0000 7f348d7f5640 1 -- 172.21.15.33:0/4202469913 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f34880b2ad0 msgr2=0x7f34880cd5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:00.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.884+0000 7f348d7f5640 1 --2- 172.21.15.33:0/4202469913 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f34880b2ad0 0x7f34880cd5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:00.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.884+0000 7f348d7f5640 1 -- 172.21.15.33:0/4202469913 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34880d0750 msgr2=0x7f348815ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:00.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.884+0000 7f348d7f5640 1 --2- 172.21.15.33:0/4202469913 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34880d0750 0x7f348815ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:00.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.884+0000 7fd0cb481640 1 -- 172.21.15.33:0/33056329 shutdown_connections 2024-05-08T10:55:00.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.884+0000 7f348d7f5640 1 -- 172.21.15.33:0/4202469913 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34880b6350 con 0x7f34881617c0 2024-05-08T10:55:00.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.884+0000 7f3487fff640 1 --2- 172.21.15.33:0/4202469913 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34880d0750 0x7f348815ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T10:55:00.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.884+0000 7fd0cb481640 1 -- 172.21.15.33:0/33056329 wait complete. 2024-05-08T10:55:00.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.884+0000 7f05d2657640 1 -- start start 2024-05-08T10:55:00.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.884+0000 7f1703547640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16f4054900 con 0x7f16f404ff90 2024-05-08T10:55:00.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.884+0000 7f1702545640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f16f40380d0 0x7f16f4185930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37736/0 (socket says 172.21.15.33:37736) 2024-05-08T10:55:00.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.884+0000 7f1702545640 1 -- 172.21.15.33:0/3457705382 learned_addr learned my addr 172.21.15.33:0/3457705382 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:00.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.884+0000 7f1701d44640 1 --2- 172.21.15.33:0/3457705382 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f16f404ff90 0x7f16f402ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.884+0000 7f1702d46640 1 --2- 172.21.15.33:0/3457705382 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f16f40eacc0 0x7f16f40e1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.884+0000 7f348d7f5640 1 --2- 172.21.15.33:0/4202469913 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f34881617c0 0x7f34880cb650 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f34780097c0 tx=0x7f34780046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:00.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.884+0000 7f5f809f6640 1 Processor -- start 2024-05-08T10:55:00.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.884+0000 7f131346a640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f12f80037a0 0x7f130c145cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.884+0000 7f1701d44640 1 -- 172.21.15.33:0/3457705382 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f16f40eacc0 msgr2=0x7f16f40e1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:00.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.884+0000 7f1701d44640 1 --2- 172.21.15.33:0/3457705382 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f16f40eacc0 0x7f16f40e1830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:00.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.884+0000 7f1701d44640 1 -- 172.21.15.33:0/3457705382 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f16f40380d0 msgr2=0x7f16f4185930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:00.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.884+0000 7f1701d44640 1 --2- 172.21.15.33:0/3457705382 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f16f40380d0 0x7f16f4185930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:00.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.884+0000 7f1701d44640 1 -- 172.21.15.33:0/3457705382 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16f404ce40 con 0x7f16f404ff90 2024-05-08T10:55:00.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.884+0000 7f1702d46640 1 --2- 172.21.15.33:0/3457705382 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f16f40eacc0 0x7f16f40e1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T10:55:00.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.885+0000 7f131346a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f130c149d80 0x7f130c0af5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.885+0000 7f131346a640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f130c15b250 0x7f130c14acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.885+0000 7f131346a640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f130c15dba0 con 0x7f130c149d80 2024-05-08T10:55:00.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.885+0000 7f131346a640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f130c15da20 con 0x7f130c15b250 2024-05-08T10:55:00.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.885+0000 7f131346a640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f130c06e3b0 con 0x7f12f80037a0 2024-05-08T10:55:00.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.885+0000 7f1311206640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f12f80037a0 0x7f130c145cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.885+0000 7f1311206640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f12f80037a0 0x7f130c145cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.33:58744/0 (socket says 172.21.15.33:58744) 2024-05-08T10:55:00.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.885+0000 7f1311206640 1 -- 172.21.15.33:0/2289633542 learned_addr learned my addr 172.21.15.33:0/2289633542 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:00.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.884+0000 7f34857fa640 1 -- 172.21.15.33:0/4202469913 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3478041020 con 0x7f34881617c0 2024-05-08T10:55:00.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.885+0000 7f1311a07640 1 --2- 172.21.15.33:0/2289633542 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f130c15b250 0x7f130c14acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.885+0000 7f1701d44640 1 --2- 172.21.15.33:0/3457705382 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f16f404ff90 0x7f16f402ec00 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f16fc06a460 tx=0x7f16fc069770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:00.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.885+0000 7f5f809f6640 1 -- start start 2024-05-08T10:55:00.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.885+0000 7f1310a05640 1 --2- 172.21.15.33:0/2289633542 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f130c149d80 0x7f130c0af5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.885+0000 7f1311206640 1 -- 172.21.15.33:0/2289633542 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f130c15b250 msgr2=0x7f130c14acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:00.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.885+0000 7f1311206640 1 --2- 172.21.15.33:0/2289633542 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f130c15b250 0x7f130c14acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:00.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.885+0000 7f1311206640 1 -- 172.21.15.33:0/2289633542 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f130c149d80 msgr2=0x7f130c0af5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:00.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.885+0000 7f1311206640 1 --2- 172.21.15.33:0/2289633542 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f130c149d80 0x7f130c0af5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:00.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.885+0000 7f1311206640 1 -- 172.21.15.33:0/2289633542 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f130c14caf0 con 0x7f12f80037a0 2024-05-08T10:55:00.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.885+0000 7f34857fa640 1 -- 172.21.15.33:0/4202469913 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f347803d620 con 0x7f34881617c0 2024-05-08T10:55:00.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.885+0000 7f34857fa640 1 -- 172.21.15.33:0/4202469913 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3478037040 con 0x7f34881617c0 2024-05-08T10:55:00.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.885+0000 7f1310a05640 1 --2- 172.21.15.33:0/2289633542 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f130c149d80 0x7f130c0af5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:55:00.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.885+0000 7f348f258640 1 -- 172.21.15.33:0/4202469913 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f348815b390 con 0x7f34881617c0 2024-05-08T10:55:00.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.885+0000 7f348f258640 1 -- 172.21.15.33:0/4202469913 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34880cb130 con 0x7f34881617c0 2024-05-08T10:55:00.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.885+0000 7f1311206640 1 --2- 172.21.15.33:0/2289633542 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f12f80037a0 0x7f130c145cb0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1308011650 tx=0x7f1308011a50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:00.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.885+0000 7f05d2657640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f05cc0d0300 0x7f05cc13d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.886+0000 7f05d2657640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f05cc145790 0x7f05cc0c5d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.886+0000 7f05d2657640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f05cc0cb0a0 0x7f05cc0c6d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.886+0000 7f05cbfff640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f05cc0d0300 0x7f05cc13d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.886+0000 7f05cbfff640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f05cc0d0300 0x7f05cc13d360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.33:50064/0 (socket says 172.21.15.33:50064) 2024-05-08T10:55:00.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.886+0000 7f05cbfff640 1 -- 172.21.15.33:0/1918160842 learned_addr learned my addr 172.21.15.33:0/1918160842 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:00.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.886+0000 7f05cb7fe640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f05cc145790 0x7f05cc0c5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.886+0000 7f05d0bf4640 1 --2- 172.21.15.33:0/1918160842 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f05cc0cb0a0 0x7f05cc0c6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.886+0000 7f05d2657640 1 -- 172.21.15.33:0/1918160842 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05cc0cca40 con 0x7f05cc0cb0a0 2024-05-08T10:55:00.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.886+0000 7f05d2657640 1 -- 172.21.15.33:0/1918160842 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05cc06d2b0 con 0x7f05cc0d0300 2024-05-08T10:55:00.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.886+0000 7fd0cb481640 1 Processor -- start 2024-05-08T10:55:00.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.886+0000 7f05d2657640 1 -- 172.21.15.33:0/1918160842 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05cc0ccbc0 con 0x7f05cc145790 2024-05-08T10:55:00.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.886+0000 7f5f809f6640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5f7c0c6cb0 0x7f5f7c1ffa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.886+0000 7f5f809f6640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f7c0c7090 0x7f5f7c15d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.886+0000 7f5f809f6640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5f7c0c8e10 0x7f5f7c15d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.886+0000 7f5f809f6640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7c0d4770 con 0x7f5f7c0c8e10 2024-05-08T10:55:00.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.886+0000 7f5f809f6640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7c0d45f0 con 0x7f5f7c0c7090 2024-05-08T10:55:00.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.886+0000 7f5f809f6640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7c0cf280 con 0x7f5f7c0c6cb0 2024-05-08T10:55:00.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.886+0000 7f5f7bfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5f7c0c8e10 0x7f5f7c15d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.886+0000 7fd0cb481640 1 -- start start 2024-05-08T10:55:00.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.886+0000 7f5f7bfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5f7c0c8e10 0x7f5f7c15d7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37760/0 (socket says 172.21.15.33:37760) 2024-05-08T10:55:00.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.886+0000 7f5f7bfff640 1 -- 172.21.15.33:0/60119558 learned_addr learned my addr 172.21.15.33:0/60119558 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:00.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.886+0000 7f5f7affd640 1 --2- 172.21.15.33:0/60119558 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f7c0c7090 0x7f5f7c15d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.886+0000 7f5f7b7fe640 1 --2- 172.21.15.33:0/60119558 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5f7c0c6cb0 0x7f5f7c1ffa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.886+0000 7f5f7bfff640 1 -- 172.21.15.33:0/60119558 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5f7c0c6cb0 msgr2=0x7f5f7c1ffa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:00.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.886+0000 7f5f7bfff640 1 --2- 172.21.15.33:0/60119558 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5f7c0c6cb0 0x7f5f7c1ffa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:00.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.887+0000 7f05cbfff640 1 -- 172.21.15.33:0/1918160842 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f05cc145790 msgr2=0x7f05cc0c5d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:00.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.887+0000 7f05cbfff640 1 --2- 172.21.15.33:0/1918160842 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f05cc145790 0x7f05cc0c5d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:00.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.887+0000 7f05cbfff640 1 -- 172.21.15.33:0/1918160842 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f05cc0cb0a0 msgr2=0x7f05cc0c6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:00.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.887+0000 7f05cbfff640 1 --2- 172.21.15.33:0/1918160842 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f05cc0cb0a0 0x7f05cc0c6d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:00.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.886+0000 7f5f7bfff640 1 -- 172.21.15.33:0/60119558 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f7c0c7090 msgr2=0x7f5f7c15d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:00.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.886+0000 7f5f7bfff640 1 --2- 172.21.15.33:0/60119558 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f7c0c7090 0x7f5f7c15d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:00.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.887+0000 7f05cbfff640 1 -- 172.21.15.33:0/1918160842 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05cc13da60 con 0x7f05cc0d0300 2024-05-08T10:55:00.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.887+0000 7f05d0bf4640 1 --2- 172.21.15.33:0/1918160842 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f05cc0cb0a0 0x7f05cc0c6d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T10:55:00.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.887+0000 7f5f7bfff640 1 -- 172.21.15.33:0/60119558 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f7c15be10 con 0x7f5f7c0c8e10 2024-05-08T10:55:00.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.887+0000 7f5f7bfff640 1 --2- 172.21.15.33:0/60119558 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5f7c0c8e10 0x7f5f7c15d7a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5f700098c0 tx=0x7f5f700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:00.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.887+0000 7f05cbfff640 1 --2- 172.21.15.33:0/1918160842 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f05cc0d0300 0x7f05cc13d360 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f05c000c400 tx=0x7f05c000c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:00.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.887+0000 7f348f258640 1 -- 172.21.15.33:0/4202469913 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3488069d20 con 0x7f34881617c0 2024-05-08T10:55:00.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.887+0000 7f5f63fff640 1 -- 172.21.15.33:0/60119558 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f70040020 con 0x7f5f7c0c8e10 2024-05-08T10:55:00.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.887+0000 7f5f63fff640 1 -- 172.21.15.33:0/60119558 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f70038040 con 0x7f5f7c0c8e10 2024-05-08T10:55:00.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.887+0000 7f5f809f6640 1 -- 172.21.15.33:0/60119558 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f7c15c0f0 con 0x7f5f7c0c8e10 2024-05-08T10:55:00.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.887+0000 7f05c8ff9640 1 -- 172.21.15.33:0/1918160842 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c0017070 con 0x7f05cc0d0300 2024-05-08T10:55:00.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.887+0000 7f5f63fff640 1 -- 172.21.15.33:0/60119558 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f70037070 con 0x7f5f7c0c8e10 2024-05-08T10:55:00.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.887+0000 7f5f809f6640 1 -- 172.21.15.33:0/60119558 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f7c1fff90 con 0x7f5f7c0c8e10 2024-05-08T10:55:00.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.887+0000 7f05d2657640 1 -- 172.21.15.33:0/1918160842 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05cc13dd40 con 0x7f05cc0d0300 2024-05-08T10:55:00.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.887+0000 7fd0cb481640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd0b0004800 0x7fd0c40a9430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.887+0000 7fd0cb481640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd0c415c090 0x7fd0c415d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.887+0000 7f05d2657640 1 -- 172.21.15.33:0/1918160842 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05cc13e300 con 0x7f05cc0d0300 2024-05-08T10:55:00.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.887+0000 7fd0cb481640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd0c4149e70 0x7fd0c406ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.888+0000 7fd0cb481640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c415f170 con 0x7fd0c4149e70 2024-05-08T10:55:00.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.888+0000 7fd0ca47f640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd0b0004800 0x7fd0c40a9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.888+0000 7fd0cb481640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c40b5040 con 0x7fd0c415c090 2024-05-08T10:55:00.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.888+0000 7fd0cb481640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c40cdf60 con 0x7fd0b0004800 2024-05-08T10:55:00.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.888+0000 7fd0ca47f640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd0b0004800 0x7fd0c40a9430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.33:58768/0 (socket says 172.21.15.33:58768) 2024-05-08T10:55:00.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.888+0000 7fd0ca47f640 1 -- 172.21.15.33:0/2795510110 learned_addr learned my addr 172.21.15.33:0/2795510110 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:00.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.888+0000 7f05c8ff9640 1 -- 172.21.15.33:0/1918160842 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05c0005ce0 con 0x7f05cc0d0300 2024-05-08T10:55:00.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.888+0000 7f05c8ff9640 1 -- 172.21.15.33:0/1918160842 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c0007310 con 0x7f05cc0d0300 2024-05-08T10:55:00.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.888+0000 7fd0cac80640 1 --2- 172.21.15.33:0/2795510110 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd0c4149e70 0x7fd0c406ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.888+0000 7fd0c9c7e640 1 --2- 172.21.15.33:0/2795510110 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd0c415c090 0x7fd0c415d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.888+0000 7fd0ca47f640 1 -- 172.21.15.33:0/2795510110 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd0c415c090 msgr2=0x7fd0c415d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:00.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.888+0000 7fd0ca47f640 1 --2- 172.21.15.33:0/2795510110 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd0c415c090 0x7fd0c415d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:00.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.888+0000 7fd0ca47f640 1 -- 172.21.15.33:0/2795510110 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd0c4149e70 msgr2=0x7fd0c406ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:00.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.888+0000 7fd0ca47f640 1 --2- 172.21.15.33:0/2795510110 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd0c4149e70 0x7fd0c406ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:00.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.888+0000 7fd0ca47f640 1 -- 172.21.15.33:0/2795510110 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0c40a9970 con 0x7fd0b0004800 2024-05-08T10:55:00.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.888+0000 7f9fc3fff640 1 -- 172.21.15.33:0/390550757 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9fd809b060 con 0x7f9fd0050540 2024-05-08T10:55:00.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.888+0000 7f1301ffb640 1 -- 172.21.15.33:0/2289633542 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1308015870 con 0x7f12f80037a0 2024-05-08T10:55:00.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.888+0000 7f1301ffb640 1 -- 172.21.15.33:0/2289633542 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1308015a10 con 0x7f12f80037a0 2024-05-08T10:55:00.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.888+0000 7f1301ffb640 1 -- 172.21.15.33:0/2289633542 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1308015de0 con 0x7f12f80037a0 2024-05-08T10:55:00.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.888+0000 7f131346a640 1 -- 172.21.15.33:0/2289633542 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f130c14a500 con 0x7f12f80037a0 2024-05-08T10:55:00.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.888+0000 7f72cb7fe640 1 -- 172.21.15.33:0/778985573 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72e40b2050 con 0x7f72dc0e30b0 2024-05-08T10:55:00.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.888+0000 7f72cb7fe640 1 -- 172.21.15.33:0/778985573 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72e40be070 con 0x7f72dc0e30b0 2024-05-08T10:55:00.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.888+0000 7f72cb7fe640 1 -- 172.21.15.33:0/778985573 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72e40b9450 con 0x7f72dc0e30b0 2024-05-08T10:55:00.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.888+0000 7f34857fa640 1 -- 172.21.15.33:0/4202469913 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3478044020 con 0x7f34881617c0 2024-05-08T10:55:00.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.888+0000 7f34857fa640 1 --2- 172.21.15.33:0/4202469913 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f347406b5a0 0x7f347406da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.889+0000 7f72e943f640 1 -- 172.21.15.33:0/778985573 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72dc0e41a0 con 0x7f72dc0e30b0 2024-05-08T10:55:00.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.889+0000 7fd0ca47f640 1 --2- 172.21.15.33:0/2795510110 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd0b0004800 0x7fd0c40a9430 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd0c0010980 tx=0x7fd0c0010e40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:00.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.889+0000 7f72e943f640 1 -- 172.21.15.33:0/778985573 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72dc0e4760 con 0x7f72dc0e30b0 2024-05-08T10:55:00.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.889+0000 7f348cff4640 1 --2- 172.21.15.33:0/4202469913 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f347406b5a0 0x7f347406da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.889+0000 7f131346a640 1 -- 172.21.15.33:0/2289633542 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f130c14d070 con 0x7f12f80037a0 2024-05-08T10:55:00.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.889+0000 7f34857fa640 1 -- 172.21.15.33:0/4202469913 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f34780aa770 con 0x7f34881617c0 2024-05-08T10:55:00.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.890+0000 7f5f809f6640 1 -- 172.21.15.33:0/60119558 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f7c04efc0 con 0x7f5f7c0c8e10 2024-05-08T10:55:00.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.890+0000 7fd0baffd640 1 -- 172.21.15.33:0/2795510110 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c000f040 con 0x7fd0b0004800 2024-05-08T10:55:00.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.890+0000 7fd0cb481640 1 -- 172.21.15.33:0/2795510110 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0c415c630 con 0x7fd0b0004800 2024-05-08T10:55:00.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.890+0000 7fd0cb481640 1 -- 172.21.15.33:0/2795510110 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0c415cbf0 con 0x7fd0b0004800 2024-05-08T10:55:00.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.891+0000 7f12ef7fe640 1 -- 172.21.15.33:0/2289633542 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f130c04efc0 con 0x7f12f80037a0 2024-05-08T10:55:00.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.888+0000 7f16f2ffd640 1 -- 172.21.15.33:0/3457705382 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16fc0b2040 con 0x7f16f404ff90 2024-05-08T10:55:00.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.888+0000 7f16f2ffd640 1 -- 172.21.15.33:0/3457705382 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16fc0b9670 con 0x7f16f404ff90 2024-05-08T10:55:00.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.888+0000 7f16f2ffd640 1 -- 172.21.15.33:0/3457705382 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16fc0b9a20 con 0x7f16f404ff90 2024-05-08T10:55:00.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.889+0000 7f1703547640 1 -- 172.21.15.33:0/3457705382 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16f41861f0 con 0x7f16f404ff90 2024-05-08T10:55:00.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.889+0000 7f1703547640 1 -- 172.21.15.33:0/3457705382 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16f41867b0 con 0x7f16f404ff90 2024-05-08T10:55:00.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.891+0000 7f16f0ff9640 1 -- 172.21.15.33:0/3457705382 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16f4005350 con 0x7f16f404ff90 2024-05-08T10:55:00.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.891+0000 7f348cff4640 1 --2- 172.21.15.33:0/4202469913 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f347406b5a0 0x7f347406da60 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f347c006fd0 tx=0x7f347c009060 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:00.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.890+0000 7f72e943f640 1 -- 172.21.15.33:0/778985573 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72dc0e3d30 con 0x7f72dc0e30b0 2024-05-08T10:55:00.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.890+0000 7f05d2657640 1 -- 172.21.15.33:0/1918160842 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05cc16a710 con 0x7f05cc0d0300 2024-05-08T10:55:00.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.891+0000 7f5f63fff640 1 -- 172.21.15.33:0/60119558 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5f70043020 con 0x7f5f7c0c8e10 2024-05-08T10:55:00.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.892+0000 7f1301ffb640 1 -- 172.21.15.33:0/2289633542 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f130800f460 con 0x7f12f80037a0 2024-05-08T10:55:00.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.892+0000 7fd0baffd640 1 -- 172.21.15.33:0/2795510110 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0c0006bd0 con 0x7fd0b0004800 2024-05-08T10:55:00.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.892+0000 7f72cb7fe640 1 -- 172.21.15.33:0/778985573 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f72e40a5d10 con 0x7f72dc0e30b0 2024-05-08T10:55:00.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.892+0000 7fd0baffd640 1 -- 172.21.15.33:0/2795510110 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c000ee20 con 0x7fd0b0004800 2024-05-08T10:55:00.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.892+0000 7f05c8ff9640 1 -- 172.21.15.33:0/1918160842 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f05c001a070 con 0x7f05cc0d0300 2024-05-08T10:55:00.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.892+0000 7f5f63fff640 1 --2- 172.21.15.33:0/60119558 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f5f6806b500 0x7f5f6806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.892+0000 7f5f63fff640 1 -- 172.21.15.33:0/60119558 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5f700aa530 con 0x7f5f7c0c8e10 2024-05-08T10:55:00.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.892+0000 7f5f7b7fe640 1 --2- 172.21.15.33:0/60119558 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f5f6806b500 0x7f5f6806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.892+0000 7f1301ffb640 1 --2- 172.21.15.33:0/2289633542 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f12f006b5a0 0x7f12f006da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.892+0000 7f05c8ff9640 1 --2- 172.21.15.33:0/1918160842 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f05b806b5d0 0x7f05b806da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.892+0000 7f1301ffb640 1 -- 172.21.15.33:0/2289633542 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f130808ab30 con 0x7f12f80037a0 2024-05-08T10:55:00.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.893+0000 7f72cb7fe640 1 --2- 172.21.15.33:0/778985573 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f72d006b5a0 0x7f72d006da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.892+0000 7f16f2ffd640 1 -- 172.21.15.33:0/3457705382 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f16fc0c2030 con 0x7f16f404ff90 2024-05-08T10:55:00.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.893+0000 7f05c8ff9640 1 -- 172.21.15.33:0/1918160842 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f05c0089540 con 0x7f05cc0d0300 2024-05-08T10:55:00.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.893+0000 7f72cb7fe640 1 -- 172.21.15.33:0/778985573 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f72e4125970 con 0x7f72dc0e30b0 2024-05-08T10:55:00.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.893+0000 7f72e2ffd640 1 --2- 172.21.15.33:0/778985573 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f72d006b5a0 0x7f72d006da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.893+0000 7f05cb7fe640 1 --2- 172.21.15.33:0/1918160842 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f05b806b5d0 0x7f05b806da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.893+0000 7f16f2ffd640 1 --2- 172.21.15.33:0/3457705382 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f16e006b500 0x7f16e006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.893+0000 7f16f2ffd640 1 -- 172.21.15.33:0/3457705382 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f16fc1258f0 con 0x7f16f404ff90 2024-05-08T10:55:00.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.893+0000 7f1310a05640 1 --2- 172.21.15.33:0/2289633542 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f12f006b5a0 0x7f12f006da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.893+0000 7f1702545640 1 --2- 172.21.15.33:0/3457705382 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f16e006b500 0x7f16e006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.893+0000 7f5f7b7fe640 1 --2- 172.21.15.33:0/60119558 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f5f6806b500 0x7f5f6806d9c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5f74000f60 tx=0x7f5f74009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:00.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.894+0000 7f05cb7fe640 1 --2- 172.21.15.33:0/1918160842 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f05b806b5d0 0x7f05b806da90 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f05cc0b40a0 tx=0x7f05c400b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:00.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.894+0000 7fd0baffd640 1 -- 172.21.15.33:0/2795510110 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd0c0005990 con 0x7fd0b0004800 2024-05-08T10:55:00.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.894+0000 7f1702545640 1 --2- 172.21.15.33:0/3457705382 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f16e006b500 0x7f16e006d9c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f16f4034090 tx=0x7f16ec008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:00.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.894+0000 7f72e2ffd640 1 --2- 172.21.15.33:0/778985573 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f72d006b5a0 0x7f72d006da60 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f72dc0e21b0 tx=0x7f72d4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:00.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.894+0000 7f34857fa640 1 -- 172.21.15.33:0/4202469913 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f347804b030 con 0x7f34881617c0 2024-05-08T10:55:00.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.894+0000 7f1310a05640 1 --2- 172.21.15.33:0/2289633542 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f12f006b5a0 0x7f12f006da60 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f12fc034000 tx=0x7f12fc02f000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:00.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.894+0000 7fd0b8ff9640 1 -- 172.21.15.33:0/2795510110 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0ac005290 con 0x7fd0b0004800 2024-05-08T10:55:00.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.894+0000 7fd0baffd640 1 --2- 172.21.15.33:0/2795510110 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fd0a806b4d0 0x7fd0a806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:00.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.895+0000 7fd0baffd640 1 -- 172.21.15.33:0/2795510110 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd0c008a9f0 con 0x7fd0b0004800 2024-05-08T10:55:00.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.895+0000 7fd0c9c7e640 1 --2- 172.21.15.33:0/2795510110 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fd0a806b4d0 0x7fd0a806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:00.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.895+0000 7fd0c9c7e640 1 --2- 172.21.15.33:0/2795510110 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fd0a806b4d0 0x7fd0a806d990 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd0b4032000 tx=0x7fd0b4009030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:00.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.896+0000 7f16f2ffd640 1 -- 172.21.15.33:0/3457705382 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f16fc0e2080 con 0x7f16f404ff90 2024-05-08T10:55:00.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.899+0000 7f5f63fff640 1 -- 172.21.15.33:0/60119558 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5f7004a070 con 0x7f5f7c0c8e10 2024-05-08T10:55:00.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.899+0000 7f05c8ff9640 1 -- 172.21.15.33:0/1918160842 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f05cc16a710 con 0x7f05cc0d0300 2024-05-08T10:55:00.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.901+0000 7f1301ffb640 1 -- 172.21.15.33:0/2289633542 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1308019030 con 0x7f12f80037a0 2024-05-08T10:55:00.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.905+0000 7fd0baffd640 1 -- 172.21.15.33:0/2795510110 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd0c0018030 con 0x7fd0b0004800 2024-05-08T10:55:00.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:00.910+0000 7f72cb7fe640 1 -- 172.21.15.33:0/778985573 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f72e40f47d0 con 0x7f72dc0e30b0 2024-05-08T10:55:01.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.311+0000 7f9fdcfae640 1 -- 172.21.15.33:0/390550757 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9fb8005580 con 0x7f9fd0050540 2024-05-08T10:55:01.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.312+0000 7f9fc3fff640 1 -- 172.21.15.33:0/390550757 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9fd80d2c50 con 0x7f9fd0050540 2024-05-08T10:55:01.309 INFO:teuthology.orchestra.run.smithi033.stdout:55834574854 2024-05-08T10:55:01.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.315+0000 7f9fc1ffb640 1 -- 172.21.15.33:0/390550757 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f9fbc06b4d0 msgr2=0x7f9fbc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:01.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.315+0000 7f9fc1ffb640 1 --2- 172.21.15.33:0/390550757 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f9fbc06b4d0 0x7f9fbc06d990 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9fd01870f0 tx=0x7f9fcc009040 comp rx=0 tx=0).stop 2024-05-08T10:55:01.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.315+0000 7f9fc1ffb640 1 -- 172.21.15.33:0/390550757 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9fd0050540 msgr2=0x7f9fd0186780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:01.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.315+0000 7f9fc1ffb640 1 --2- 172.21.15.33:0/390550757 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9fd0050540 0x7f9fd0186780 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f9fd8062820 tx=0x7f9fd8068ed0 comp rx=0 tx=0).stop 2024-05-08T10:55:01.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.315+0000 7f9fc1ffb640 1 -- 172.21.15.33:0/390550757 shutdown_connections 2024-05-08T10:55:01.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.315+0000 7f9fc1ffb640 1 --2- 172.21.15.33:0/390550757 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f9fbc06b4d0 0x7f9fbc06d990 secure :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9fd01870f0 tx=0x7f9fcc009040 comp rx=0 tx=0).stop 2024-05-08T10:55:01.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.316+0000 7f9fc1ffb640 1 --2- 172.21.15.33:0/390550757 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9fd0054fd0 0x7f9fd00e2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:01.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.316+0000 7f9fc1ffb640 1 --2- 172.21.15.33:0/390550757 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9fd0051030 0x7f9fd0183140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:01.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.316+0000 7f9fc1ffb640 1 --2- 172.21.15.33:0/390550757 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9fd0050540 0x7f9fd0186780 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:01.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.316+0000 7f9fc1ffb640 1 -- 172.21.15.33:0/390550757 >> 172.21.15.33:0/390550757 conn(0x7f9fd0055bc0 msgr2=0x7f9fd00078c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:01.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.317+0000 7f9fc1ffb640 1 -- 172.21.15.33:0/390550757 shutdown_connections 2024-05-08T10:55:01.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.317+0000 7f9fc1ffb640 1 -- 172.21.15.33:0/390550757 wait complete. 2024-05-08T10:55:01.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.321+0000 7f348f258640 1 -- 172.21.15.33:0/4202469913 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f348815c040 con 0x7f34881617c0 2024-05-08T10:55:01.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.322+0000 7f34857fa640 1 -- 172.21.15.33:0/4202469913 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3478078f80 con 0x7f34881617c0 2024-05-08T10:55:01.319 INFO:teuthology.orchestra.run.smithi033.stdout:55834574854 2024-05-08T10:55:01.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.322+0000 7f16f0ff9640 1 -- 172.21.15.33:0/3457705382 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f16f404a230 con 0x7f16f404ff90 2024-05-08T10:55:01.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.323+0000 7fd0b8ff9640 1 -- 172.21.15.33:0/2795510110 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fd0ac005850 con 0x7fd0b0004800 2024-05-08T10:55:01.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.323+0000 7fd0baffd640 1 -- 172.21.15.33:0/2795510110 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd0c00597b0 con 0x7fd0b0004800 2024-05-08T10:55:01.321 INFO:teuthology.orchestra.run.smithi033.stdout:55834574854 2024-05-08T10:55:01.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.323+0000 7f16f2ffd640 1 -- 172.21.15.33:0/3457705382 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f16fc0c9020 con 0x7f16f404ff90 2024-05-08T10:55:01.321 INFO:teuthology.orchestra.run.smithi033.stdout:55834574854 2024-05-08T10:55:01.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.325+0000 7f348f258640 1 -- 172.21.15.33:0/4202469913 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f347406b5a0 msgr2=0x7f347406da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:01.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.325+0000 7f348f258640 1 --2- 172.21.15.33:0/4202469913 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f347406b5a0 0x7f347406da60 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f347c006fd0 tx=0x7f347c009060 comp rx=0 tx=0).stop 2024-05-08T10:55:01.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.325+0000 7f348f258640 1 -- 172.21.15.33:0/4202469913 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f34881617c0 msgr2=0x7f34880cb650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:01.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.325+0000 7f348f258640 1 --2- 172.21.15.33:0/4202469913 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f34881617c0 0x7f34880cb650 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f34780097c0 tx=0x7f34780046c0 comp rx=0 tx=0).stop 2024-05-08T10:55:01.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.325+0000 7f348f258640 1 -- 172.21.15.33:0/4202469913 shutdown_connections 2024-05-08T10:55:01.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.326+0000 7f348f258640 1 --2- 172.21.15.33:0/4202469913 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f347406b5a0 0x7f347406da60 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:01.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.326+0000 7f348f258640 1 --2- 172.21.15.33:0/4202469913 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f34881617c0 0x7f34880cb650 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:01.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.326+0000 7f348f258640 1 --2- 172.21.15.33:0/4202469913 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34880d0750 0x7f348815ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:01.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.326+0000 7f348f258640 1 --2- 172.21.15.33:0/4202469913 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f34880b2ad0 0x7f34880cd5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:01.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.326+0000 7f348f258640 1 -- 172.21.15.33:0/4202469913 >> 172.21.15.33:0/4202469913 conn(0x7f34880d3b70 msgr2=0x7f348806b350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:01.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.326+0000 7f348f258640 1 -- 172.21.15.33:0/4202469913 shutdown_connections 2024-05-08T10:55:01.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.326+0000 7f348f258640 1 -- 172.21.15.33:0/4202469913 wait complete. 2024-05-08T10:55:01.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.327+0000 7fd0cb481640 1 -- 172.21.15.33:0/2795510110 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fd0a806b4d0 msgr2=0x7fd0a806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:01.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.327+0000 7fd0cb481640 1 --2- 172.21.15.33:0/2795510110 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fd0a806b4d0 0x7fd0a806d990 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd0b4032000 tx=0x7fd0b4009030 comp rx=0 tx=0).stop 2024-05-08T10:55:01.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.327+0000 7fd0cb481640 1 -- 172.21.15.33:0/2795510110 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd0b0004800 msgr2=0x7fd0c40a9430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:01.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.327+0000 7fd0cb481640 1 --2- 172.21.15.33:0/2795510110 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd0b0004800 0x7fd0c40a9430 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd0c0010980 tx=0x7fd0c0010e40 comp rx=0 tx=0).stop 2024-05-08T10:55:01.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.327+0000 7fd0cb481640 1 -- 172.21.15.33:0/2795510110 shutdown_connections 2024-05-08T10:55:01.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.327+0000 7fd0cb481640 1 --2- 172.21.15.33:0/2795510110 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fd0a806b4d0 0x7fd0a806d990 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:01.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.327+0000 7fd0cb481640 1 --2- 172.21.15.33:0/2795510110 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd0c4149e70 0x7fd0c406ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:01.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.327+0000 7fd0cb481640 1 --2- 172.21.15.33:0/2795510110 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd0c415c090 0x7fd0c415d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:01.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.327+0000 7f1703547640 1 -- 172.21.15.33:0/3457705382 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f16e006b500 msgr2=0x7f16e006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:01.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.327+0000 7f1703547640 1 --2- 172.21.15.33:0/3457705382 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f16e006b500 0x7f16e006d9c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f16f4034090 tx=0x7f16ec008040 comp rx=0 tx=0).stop 2024-05-08T10:55:01.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.327+0000 7fd0cb481640 1 --2- 172.21.15.33:0/2795510110 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd0b0004800 0x7fd0c40a9430 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:01.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.327+0000 7fd0cb481640 1 -- 172.21.15.33:0/2795510110 >> 172.21.15.33:0/2795510110 conn(0x7fd0c40b23f0 msgr2=0x7fd0c40ce690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:01.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.327+0000 7f1703547640 1 -- 172.21.15.33:0/3457705382 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f16f404ff90 msgr2=0x7f16f402ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:01.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.327+0000 7f1703547640 1 --2- 172.21.15.33:0/3457705382 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f16f404ff90 0x7f16f402ec00 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f16fc06a460 tx=0x7f16fc069770 comp rx=0 tx=0).stop 2024-05-08T10:55:01.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.327+0000 7f05d2657640 1 -- 172.21.15.33:0/1918160842 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f05cc069d20 con 0x7f05cc0d0300 2024-05-08T10:55:01.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.327+0000 7f5f809f6640 1 -- 172.21.15.33:0/60119558 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5f7c0d20a0 con 0x7f5f7c0c8e10 2024-05-08T10:55:01.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.327+0000 7f1703547640 1 -- 172.21.15.33:0/3457705382 shutdown_connections 2024-05-08T10:55:01.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.327+0000 7f1703547640 1 --2- 172.21.15.33:0/3457705382 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f16e006b500 0x7f16e006d9c0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:01.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.327+0000 7f1703547640 1 --2- 172.21.15.33:0/3457705382 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f16f40eacc0 0x7f16f40e1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:01.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.327+0000 7f1703547640 1 --2- 172.21.15.33:0/3457705382 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f16f404ff90 0x7f16f402ec00 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:01.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.327+0000 7f1703547640 1 --2- 172.21.15.33:0/3457705382 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f16f40380d0 0x7f16f4185930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:01.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.327+0000 7f1703547640 1 -- 172.21.15.33:0/3457705382 >> 172.21.15.33:0/3457705382 conn(0x7f16f4009f70 msgr2=0x7f16f40e9e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:01.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.327+0000 7fd0cb481640 1 -- 172.21.15.33:0/2795510110 shutdown_connections 2024-05-08T10:55:01.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.327+0000 7fd0cb481640 1 -- 172.21.15.33:0/2795510110 wait complete. 2024-05-08T10:55:01.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.328+0000 7f05c8ff9640 1 -- 172.21.15.33:0/1918160842 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f05c0057d50 con 0x7f05cc0d0300 2024-05-08T10:55:01.329 INFO:teuthology.orchestra.run.smithi033.stdout:55834574854 2024-05-08T10:55:01.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.328+0000 7f5f63fff640 1 -- 172.21.15.33:0/60119558 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5f700793a0 con 0x7f5f7c0c8e10 2024-05-08T10:55:01.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.328+0000 7f1703547640 1 -- 172.21.15.33:0/3457705382 shutdown_connections 2024-05-08T10:55:01.330 INFO:teuthology.orchestra.run.smithi033.stdout:55834574855 2024-05-08T10:55:01.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.328+0000 7f1703547640 1 -- 172.21.15.33:0/3457705382 wait complete. 2024-05-08T10:55:01.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.329+0000 7f12ef7fe640 1 -- 172.21.15.33:0/2289633542 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f130c068150 con 0x7f12f80037a0 2024-05-08T10:55:01.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.331+0000 7f1301ffb640 1 -- 172.21.15.33:0/2289633542 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1308059990 con 0x7f12f80037a0 2024-05-08T10:55:01.331 INFO:teuthology.orchestra.run.smithi033.stdout:55834574855 2024-05-08T10:55:01.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.331+0000 7f05d2657640 1 -- 172.21.15.33:0/1918160842 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f05b806b5d0 msgr2=0x7f05b806da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:01.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.331+0000 7f5f809f6640 1 -- 172.21.15.33:0/60119558 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f5f6806b500 msgr2=0x7f5f6806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:01.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.331+0000 7f5f809f6640 1 --2- 172.21.15.33:0/60119558 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f5f6806b500 0x7f5f6806d9c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5f74000f60 tx=0x7f5f74009040 comp rx=0 tx=0).stop 2024-05-08T10:55:01.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.331+0000 7f05d2657640 1 --2- 172.21.15.33:0/1918160842 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f05b806b5d0 0x7f05b806da90 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f05cc0b40a0 tx=0x7f05c400b040 comp rx=0 tx=0).stop 2024-05-08T10:55:01.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.331+0000 7f5f809f6640 1 -- 172.21.15.33:0/60119558 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5f7c0c8e10 msgr2=0x7f5f7c15d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:01.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.331+0000 7f5f809f6640 1 --2- 172.21.15.33:0/60119558 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5f7c0c8e10 0x7f5f7c15d7a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5f700098c0 tx=0x7f5f700046c0 comp rx=0 tx=0).stop 2024-05-08T10:55:01.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.332+0000 7f05d2657640 1 -- 172.21.15.33:0/1918160842 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f05cc0d0300 msgr2=0x7f05cc13d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:01.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.332+0000 7f05d2657640 1 --2- 172.21.15.33:0/1918160842 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f05cc0d0300 0x7f05cc13d360 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f05c000c400 tx=0x7f05c000c8c0 comp rx=0 tx=0).stop 2024-05-08T10:55:01.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.332+0000 7f5f809f6640 1 -- 172.21.15.33:0/60119558 shutdown_connections 2024-05-08T10:55:01.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.332+0000 7f5f809f6640 1 --2- 172.21.15.33:0/60119558 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f5f6806b500 0x7f5f6806d9c0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:01.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.332+0000 7f5f809f6640 1 --2- 172.21.15.33:0/60119558 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5f7c0c8e10 0x7f5f7c15d7a0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:01.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.332+0000 7f5f809f6640 1 --2- 172.21.15.33:0/60119558 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f7c0c7090 0x7f5f7c15d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:01.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.332+0000 7f5f809f6640 1 --2- 172.21.15.33:0/60119558 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5f7c0c6cb0 0x7f5f7c1ffa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:01.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.332+0000 7f05d2657640 1 -- 172.21.15.33:0/1918160842 shutdown_connections 2024-05-08T10:55:01.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.332+0000 7f5f809f6640 1 -- 172.21.15.33:0/60119558 >> 172.21.15.33:0/60119558 conn(0x7f5f7c0d3980 msgr2=0x7f5f7c0d14f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:01.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.332+0000 7f05d2657640 1 --2- 172.21.15.33:0/1918160842 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f05b806b5d0 0x7f05b806da90 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:01.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.332+0000 7f05d2657640 1 --2- 172.21.15.33:0/1918160842 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f05cc0cb0a0 0x7f05cc0c6d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:01.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.332+0000 7f05d2657640 1 --2- 172.21.15.33:0/1918160842 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f05cc145790 0x7f05cc0c5d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:01.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.332+0000 7f5f809f6640 1 -- 172.21.15.33:0/60119558 shutdown_connections 2024-05-08T10:55:01.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.332+0000 7f5f809f6640 1 -- 172.21.15.33:0/60119558 wait complete. 2024-05-08T10:55:01.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.332+0000 7f05d2657640 1 --2- 172.21.15.33:0/1918160842 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f05cc0d0300 0x7f05cc13d360 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:01.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.332+0000 7f05d2657640 1 -- 172.21.15.33:0/1918160842 >> 172.21.15.33:0/1918160842 conn(0x7f05cc06afc0 msgr2=0x7f05cc141be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:01.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.332+0000 7f05d2657640 1 -- 172.21.15.33:0/1918160842 shutdown_connections 2024-05-08T10:55:01.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.333+0000 7f05d2657640 1 -- 172.21.15.33:0/1918160842 wait complete. 2024-05-08T10:55:01.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.334+0000 7f72e943f640 1 -- 172.21.15.33:0/778985573 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f72dc0057d0 con 0x7f72dc0e30b0 2024-05-08T10:55:01.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.335+0000 7f12ef7fe640 1 -- 172.21.15.33:0/2289633542 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f12f006b5a0 msgr2=0x7f12f006da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:01.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.335+0000 7f12ef7fe640 1 --2- 172.21.15.33:0/2289633542 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f12f006b5a0 0x7f12f006da60 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f12fc034000 tx=0x7f12fc02f000 comp rx=0 tx=0).stop 2024-05-08T10:55:01.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.335+0000 7f12ef7fe640 1 -- 172.21.15.33:0/2289633542 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f12f80037a0 msgr2=0x7f130c145cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:01.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.335+0000 7f12ef7fe640 1 --2- 172.21.15.33:0/2289633542 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f12f80037a0 0x7f130c145cb0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1308011650 tx=0x7f1308011a50 comp rx=0 tx=0).stop 2024-05-08T10:55:01.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.335+0000 7f12ef7fe640 1 -- 172.21.15.33:0/2289633542 shutdown_connections 2024-05-08T10:55:01.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.335+0000 7f12ef7fe640 1 --2- 172.21.15.33:0/2289633542 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f12f006b5a0 0x7f12f006da60 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:01.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.335+0000 7f12ef7fe640 1 --2- 172.21.15.33:0/2289633542 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f130c15b250 0x7f130c14acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:01.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.335+0000 7f12ef7fe640 1 --2- 172.21.15.33:0/2289633542 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f130c149d80 0x7f130c0af5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:01.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.335+0000 7f12ef7fe640 1 --2- 172.21.15.33:0/2289633542 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f12f80037a0 0x7f130c145cb0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:01.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.335+0000 7f12ef7fe640 1 -- 172.21.15.33:0/2289633542 >> 172.21.15.33:0/2289633542 conn(0x7f130c0b13e0 msgr2=0x7f130c0cfd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:01.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.335+0000 7f72cb7fe640 1 -- 172.21.15.33:0/778985573 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f72e40f40d0 con 0x7f72dc0e30b0 2024-05-08T10:55:01.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.335+0000 7f12ef7fe640 1 -- 172.21.15.33:0/2289633542 shutdown_connections 2024-05-08T10:55:01.339 INFO:teuthology.orchestra.run.smithi033.stdout:55834574854 2024-05-08T10:55:01.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.335+0000 7f12ef7fe640 1 -- 172.21.15.33:0/2289633542 wait complete. 2024-05-08T10:55:01.340 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574854 for osd.2 2024-05-08T10:55:01.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.339+0000 7f72e943f640 1 -- 172.21.15.33:0/778985573 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f72d006b5a0 msgr2=0x7f72d006da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:01.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.339+0000 7f72e943f640 1 --2- 172.21.15.33:0/778985573 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f72d006b5a0 0x7f72d006da60 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f72dc0e21b0 tx=0x7f72d4008040 comp rx=0 tx=0).stop 2024-05-08T10:55:01.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.339+0000 7f72e943f640 1 -- 172.21.15.33:0/778985573 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f72dc0e30b0 msgr2=0x7f72dc17e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:01.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.339+0000 7f72e943f640 1 --2- 172.21.15.33:0/778985573 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f72dc0e30b0 0x7f72dc17e0b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f72e40508c0 tx=0x7f72e4069770 comp rx=0 tx=0).stop 2024-05-08T10:55:01.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.339+0000 7f72e943f640 1 -- 172.21.15.33:0/778985573 shutdown_connections 2024-05-08T10:55:01.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.339+0000 7f72e943f640 1 --2- 172.21.15.33:0/778985573 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f72d006b5a0 0x7f72d006da60 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:01.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.339+0000 7f72e943f640 1 --2- 172.21.15.33:0/778985573 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f72dc16c1b0 0x7f72dc0e4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:01.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.339+0000 7f72e943f640 1 --2- 172.21.15.33:0/778985573 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f72dc0e30b0 0x7f72dc17e0b0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:01.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.339+0000 7f72e943f640 1 --2- 172.21.15.33:0/778985573 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72dc054120 0x7f72dc052410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:01.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.339+0000 7f72e943f640 1 -- 172.21.15.33:0/778985573 >> 172.21.15.33:0/778985573 conn(0x7f72dc0559d0 msgr2=0x7f72dc0dd120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:01.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.340+0000 7f72e943f640 1 -- 172.21.15.33:0/778985573 shutdown_connections 2024-05-08T10:55:01.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:01.340+0000 7f72e943f640 1 -- 172.21.15.33:0/778985573 wait complete. 2024-05-08T10:55:01.348 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574854 for osd.7 2024-05-08T10:55:01.349 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574854 for osd.5 2024-05-08T10:55:01.350 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574854 for osd.4 2024-05-08T10:55:01.350 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574854 for osd.6 2024-05-08T10:55:01.351 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574855 for osd.1 2024-05-08T10:55:01.353 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574855 for osd.0 2024-05-08T10:55:01.355 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574854 for osd.3 2024-05-08T10:55:02.342 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-08T10:55:02.349 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-08T10:55:02.350 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-08T10:55:02.350 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-08T10:55:02.350 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-08T10:55:02.352 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-08T10:55:02.354 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-08T10:55:02.356 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-08T10:55:02.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.521+0000 7ffbcf59e640 1 Processor -- start 2024-05-08T10:55:02.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.521+0000 7ffbcf59e640 1 -- start start 2024-05-08T10:55:02.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.523+0000 7ffbcf59e640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffbd00712a0 0x7ffbd00af050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:02.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.523+0000 7ffbcf59e640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ffbd00b46b0 0x7ffbd0163b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:02.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.523+0000 7ffbcf59e640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbd00b2f10 con 0x7ffbd006cd40 2024-05-08T10:55:02.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.523+0000 7ffbcf59e640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbd006d660 con 0x7ffbd00b46b0 2024-05-08T10:55:02.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.523+0000 7ffbcf59e640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd006d940 con 0x7ffbd00712a0 2024-05-08T10:55:02.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.523+0000 7ffbcdd9b640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7ffbd006cd40 0x7ffbd0071680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:43586/0 (socket says 172.21.15.33:43586) 2024-05-08T10:55:02.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.523+0000 7ffbcdd9b640 1 -- 172.21.15.33:0/1732871989 learned_addr learned my addr 172.21.15.33:0/1732871989 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-05-08T10:55:02.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.523+0000 7ffbced9d640 1 --2- 172.21.15.33:0/1732871989 >> v2:172.21.15.174:3300/0 conn(0x7ffbd00b46b0 0x7ffbd0163b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:02.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.523+0000 7ffbce59c640 1 --2- 172.21.15.33:0/1732871989 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffbd00712a0 0x7ffbd00af050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:02.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.524+0000 7ffbced9d640 1 -- 172.21.15.33:0/1732871989 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffbd00712a0 msgr2=0x7ffbd00af050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:02.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.524+0000 7ffbced9d640 1 --2- 172.21.15.33:0/1732871989 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffbd00712a0 0x7ffbd00af050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:02.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.524+0000 7ffbced9d640 1 -- 172.21.15.33:0/1732871989 >> v1:172.21.15.33:6789/0 conn(0x7ffbd006cd40 legacy=0x7ffbd0071680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:02.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.524+0000 7ffbced9d640 1 -- 172.21.15.33:0/1732871989 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbd00b3180 con 0x7ffbd00b46b0 2024-05-08T10:55:02.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.525+0000 7ffbced9d640 1 --2- 172.21.15.33:0/1732871989 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffbd00b46b0 0x7ffbd0163b40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ffbc800aea0 tx=0x7ffbc802c750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac534d087084278 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:02.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.525+0000 7ffbcd59a640 1 -- 172.21.15.33:0/1732871989 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc8038070 con 0x7ffbd00b46b0 2024-05-08T10:55:02.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.526+0000 7ffbcd59a640 1 -- 172.21.15.33:0/1732871989 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbc8008640 con 0x7ffbd00b46b0 2024-05-08T10:55:02.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.527+0000 7ffbcf59e640 1 -- 172.21.15.33:0/1732871989 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffbd00b46b0 msgr2=0x7ffbd0163b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:02.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.527+0000 7ffbcf59e640 1 --2- 172.21.15.33:0/1732871989 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffbd00b46b0 0x7ffbd0163b40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ffbc800aea0 tx=0x7ffbc802c750 comp rx=0 tx=0).stop 2024-05-08T10:55:02.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.527+0000 7ffbcf59e640 1 -- 172.21.15.33:0/1732871989 shutdown_connections 2024-05-08T10:55:02.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.527+0000 7ffbcf59e640 1 --2- 172.21.15.33:0/1732871989 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffbd00b46b0 0x7ffbd0163b40 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:02.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.527+0000 7ffbcf59e640 1 --2- 172.21.15.33:0/1732871989 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffbd00712a0 0x7ffbd00af050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:02.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.527+0000 7ffbcf59e640 1 -- 172.21.15.33:0/1732871989 >> 172.21.15.33:0/1732871989 conn(0x7ffbd006aba0 msgr2=0x7ffbd006afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:02.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.527+0000 7ffbcf59e640 1 -- 172.21.15.33:0/1732871989 shutdown_connections 2024-05-08T10:55:02.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.527+0000 7ffbcf59e640 1 -- 172.21.15.33:0/1732871989 wait complete. 2024-05-08T10:55:02.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.530+0000 7ffbcf59e640 1 Processor -- start 2024-05-08T10:55:02.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.530+0000 7ffbcf59e640 1 -- start start 2024-05-08T10:55:02.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.531+0000 7ffbcf59e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffbd006cd40 0x7ffbd0200d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:02.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.531+0000 7ffbcf59e640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffbd00712a0 0x7ffbd0153af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:02.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.531+0000 7ffbcf59e640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffbd00b46b0 0x7ffbd015af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:02.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.531+0000 7ffbcf59e640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd00af710 con 0x7ffbd006cd40 2024-05-08T10:55:02.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.531+0000 7ffbcf59e640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd00af590 con 0x7ffbd00b46b0 2024-05-08T10:55:02.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.531+0000 7ffbcf59e640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd0071d90 con 0x7ffbd00712a0 2024-05-08T10:55:02.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.532+0000 7ffbce59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffbd006cd40 0x7ffbd0200d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:02.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.532+0000 7ffbce59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffbd006cd40 0x7ffbd0200d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37786/0 (socket says 172.21.15.33:37786) 2024-05-08T10:55:02.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.532+0000 7ffbce59c640 1 -- 172.21.15.33:0/2656465718 learned_addr learned my addr 172.21.15.33:0/2656465718 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:02.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.532+0000 7ffbcdd9b640 1 --2- 172.21.15.33:0/2656465718 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffbd00712a0 0x7ffbd0153af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:02.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.532+0000 7ffbced9d640 1 --2- 172.21.15.33:0/2656465718 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffbd00b46b0 0x7ffbd015af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:02.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.532+0000 7ffbce59c640 1 -- 172.21.15.33:0/2656465718 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffbd00712a0 msgr2=0x7ffbd0153af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:02.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.532+0000 7ffbce59c640 1 --2- 172.21.15.33:0/2656465718 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffbd00712a0 0x7ffbd0153af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:02.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.532+0000 7ffbce59c640 1 -- 172.21.15.33:0/2656465718 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffbd00b46b0 msgr2=0x7ffbd015af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:02.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.532+0000 7ffbce59c640 1 --2- 172.21.15.33:0/2656465718 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffbd00b46b0 0x7ffbd015af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:02.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.532+0000 7ffbce59c640 1 -- 172.21.15.33:0/2656465718 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbd0154030 con 0x7ffbd006cd40 2024-05-08T10:55:02.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.532+0000 7ffbced9d640 1 --2- 172.21.15.33:0/2656465718 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffbd00b46b0 0x7ffbd015af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T10:55:02.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.532+0000 7ffbce59c640 1 --2- 172.21.15.33:0/2656465718 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffbd006cd40 0x7ffbd0200d20 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ffbc400c7f0 tx=0x7ffbc400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:02.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.533+0000 7ffbbeffd640 1 -- 172.21.15.33:0/2656465718 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc4015070 con 0x7ffbd006cd40 2024-05-08T10:55:02.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.533+0000 7ffbcf59e640 1 -- 172.21.15.33:0/2656465718 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbd015b4a0 con 0x7ffbd006cd40 2024-05-08T10:55:02.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.533+0000 7ffbcf59e640 1 -- 172.21.15.33:0/2656465718 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbd015ba20 con 0x7ffbd006cd40 2024-05-08T10:55:02.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.537+0000 7ffbbeffd640 1 -- 172.21.15.33:0/2656465718 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbc4004220 con 0x7ffbd006cd40 2024-05-08T10:55:02.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.537+0000 7ffbbeffd640 1 -- 172.21.15.33:0/2656465718 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc4007620 con 0x7ffbd006cd40 2024-05-08T10:55:02.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.538+0000 7ffbbeffd640 1 -- 172.21.15.33:0/2656465718 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ffbc4007840 con 0x7ffbd006cd40 2024-05-08T10:55:02.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.539+0000 7ffbbeffd640 1 --2- 172.21.15.33:0/2656465718 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7ffbb006b5d0 0x7ffbb006da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:02.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.539+0000 7ffbbeffd640 1 -- 172.21.15.33:0/2656465718 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffbc408a0a0 con 0x7ffbd006cd40 2024-05-08T10:55:02.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.540+0000 7ffbcf59e640 1 -- 172.21.15.33:0/2656465718 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbb4005290 con 0x7ffbd006cd40 2024-05-08T10:55:02.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.550+0000 7ffbbeffd640 1 -- 172.21.15.33:0/2656465718 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ffbc40588b0 con 0x7ffbd006cd40 2024-05-08T10:55:02.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.557+0000 7ffbcdd9b640 1 --2- 172.21.15.33:0/2656465718 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7ffbb006b5d0 0x7ffbb006da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:02.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.566+0000 7ffbcdd9b640 1 --2- 172.21.15.33:0/2656465718 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7ffbb006b5d0 0x7ffbb006da90 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ffbd0159610 tx=0x7ffbc0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:02.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.574+0000 7fce57874640 1 Processor -- start 2024-05-08T10:55:02.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.574+0000 7fce57874640 1 -- start start 2024-05-08T10:55:02.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.575+0000 7f21af35f640 1 Processor -- start 2024-05-08T10:55:02.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.575+0000 7f21af35f640 1 -- start start 2024-05-08T10:55:02.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.575+0000 7f49a40ea640 1 Processor -- start 2024-05-08T10:55:02.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.576+0000 7f49a40ea640 1 -- start start 2024-05-08T10:55:02.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.576+0000 7fce57874640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fce5006e7d0 0x7fce50143730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:02.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.576+0000 7fce57874640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fce500d0600 0x7fce50070d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:02.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.576+0000 7fce57874640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce5015dff0 con 0x7fce500b3230 2024-05-08T10:55:02.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.576+0000 7fce57874640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce5015dac0 con 0x7fce5006e7d0 2024-05-08T10:55:02.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.576+0000 7fce57874640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce5015e2d0 con 0x7fce500d0600 2024-05-08T10:55:02.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.576+0000 7fce54e0f640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fce500b3230 0x7fce500cfef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:43588/0 (socket says 172.21.15.33:43588) 2024-05-08T10:55:02.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.576+0000 7fce54e0f640 1 -- 172.21.15.33:0/865575301 learned_addr learned my addr 172.21.15.33:0/865575301 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-05-08T10:55:02.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.577+0000 7fce55e11640 1 --2- 172.21.15.33:0/865575301 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fce500d0600 0x7fce50070d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:02.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.578+0000 7fce55610640 1 --2- 172.21.15.33:0/865575301 >> v2:172.21.15.33:3300/0 conn(0x7fce5006e7d0 0x7fce50143730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:02.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.578+0000 7f49a40ea640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f499c0b3230 0x7f499c070d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:02.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.578+0000 7f49a1e86640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f499c0cfef0 0x7f499c0d02d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:43592/0 (socket says 172.21.15.33:43592) 2024-05-08T10:55:02.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.578+0000 7f49a1685640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f499c0b3230 0x7f499c070d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:02.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.578+0000 7f49a1685640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f499c0b3230 0x7f499c070d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.33:58796/0 (socket says 172.21.15.33:58796) 2024-05-08T10:55:02.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.578+0000 7f49a40ea640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f499c0b3690 0x7f499c071240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:02.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.579+0000 7f49a1e86640 1 -- 172.21.15.33:0/974305940 learned_addr learned my addr 172.21.15.33:0/974305940 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-05-08T10:55:02.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.579+0000 7f49a40ea640 1 -- 172.21.15.33:0/974305940 --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f499c15dd10 con 0x7f499c0cfef0 2024-05-08T10:55:02.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.577+0000 7f21af35f640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f21a00dfef0 0x7f21a00085d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:02.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.577+0000 7f21af35f640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f21a00e42d0 0x7f21a00539f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:02.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.577+0000 7f21af35f640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21a0056590 con 0x7f21a00e02d0 2024-05-08T10:55:02.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.577+0000 7f21af35f640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21a00094b0 con 0x7f21a00e42d0 2024-05-08T10:55:02.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.577+0000 7f21af35f640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21a0056870 con 0x7f21a00dfef0 2024-05-08T10:55:02.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.577+0000 7f21ae35d640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f21a00dfef0 0x7f21a00085d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:02.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.577+0000 7f21ae35d640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f21a00dfef0 0x7f21a00085d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.33:50104/0 (socket says 172.21.15.33:50104) 2024-05-08T10:55:02.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.577+0000 7f21aeb5e640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f21a00e42d0 0x7f21a00539f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:02.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.577+0000 7f21ae35d640 1 -- 172.21.15.33:0/4203373412 learned_addr learned my addr 172.21.15.33:0/4203373412 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:02.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.578+0000 7f21ae35d640 1 -- 172.21.15.33:0/4203373412 >> v2:172.21.15.33:3300/0 conn(0x7f21a00e42d0 msgr2=0x7f21a00539f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:02.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.578+0000 7f21ae35d640 1 --2- 172.21.15.33:0/4203373412 >> v2:172.21.15.33:3300/0 conn(0x7f21a00e42d0 0x7f21a00539f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:02.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.578+0000 7f21ae35d640 1 -- 172.21.15.33:0/4203373412 >> v1:172.21.15.174:6789/0 conn(0x7f21a00e02d0 legacy=0x7f21a00e3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:02.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.578+0000 7f21ae35d640 1 -- 172.21.15.33:0/4203373412 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21a0008e60 con 0x7f21a00dfef0 2024-05-08T10:55:02.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.579+0000 7f49a40ea640 1 -- 172.21.15.33:0/974305940 --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f499c15dac0 con 0x7f499c0b3690 2024-05-08T10:55:02.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.579+0000 7f49a40ea640 1 -- 172.21.15.33:0/974305940 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f499c15dff0 con 0x7f499c0b3230 2024-05-08T10:55:02.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.578+0000 7fce55e11640 1 -- 172.21.15.33:0/865575301 >> v2:172.21.15.33:3300/0 conn(0x7fce5006e7d0 msgr2=0x7fce50143730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:02.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.579+0000 7f91688ac640 1 Processor -- start 2024-05-08T10:55:02.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.578+0000 7fce55e11640 1 --2- 172.21.15.33:0/865575301 >> v2:172.21.15.33:3300/0 conn(0x7fce5006e7d0 0x7fce50143730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:02.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.578+0000 7fe3a54c4640 1 Processor -- start 2024-05-08T10:55:02.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.578+0000 7fe3a54c4640 1 -- start start 2024-05-08T10:55:02.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.578+0000 7fce55e11640 1 -- 172.21.15.33:0/865575301 >> v1:172.21.15.33:6789/0 conn(0x7fce500b3230 legacy=0x7fce500cfef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:02.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.578+0000 7fce55e11640 1 -- 172.21.15.33:0/865575301 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce5015e5b0 con 0x7fce500d0600 2024-05-08T10:55:02.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.579+0000 7f91688ac640 1 -- start start 2024-05-08T10:55:02.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.579+0000 7f49a2687640 1 --2- 172.21.15.33:0/974305940 >> v2:172.21.15.33:3300/0 conn(0x7f499c0b3690 0x7f499c071240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:02.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.579+0000 7fe3a54c4640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe3a00b2ff0 0x7fe3a00b4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:02.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.579+0000 7fce55e11640 1 --2- 172.21.15.33:0/865575301 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fce500d0600 0x7fce50070d00 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fce400097a0 tx=0x7fce4002a0d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bce156cf6892156a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:02.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.580+0000 7fe3a54c4640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3a006d6b0 con 0x7fe3a0162820 2024-05-08T10:55:02.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.580+0000 7fe3a54c4640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3a01630e0 con 0x7fe3a00cfd60 2024-05-08T10:55:02.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.580+0000 7fe3a54c4640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3a01633c0 con 0x7fe3a00b2ff0 2024-05-08T10:55:02.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.580+0000 7fe39effd640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe3a00b2ff0 0x7fe3a00b4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:02.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.580+0000 7fe39effd640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe3a00b2ff0 0x7fe3a00b4920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.33:50118/0 (socket says 172.21.15.33:50118) 2024-05-08T10:55:02.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.580+0000 7f49a2687640 1 -- 172.21.15.33:0/974305940 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f499c0b3230 msgr2=0x7f499c070d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:02.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.580+0000 7fe39effd640 1 -- 172.21.15.33:0/2396949659 learned_addr learned my addr 172.21.15.33:0/2396949659 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:02.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.580+0000 7f49a2687640 1 --2- 172.21.15.33:0/974305940 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f499c0b3230 0x7f499c070d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:02.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.580+0000 7f49a2687640 1 -- 172.21.15.33:0/974305940 >> v1:172.21.15.33:6789/0 conn(0x7f499c0cfef0 legacy=0x7f499c0d02d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:02.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.580+0000 7f49a2687640 1 -- 172.21.15.33:0/974305940 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f499c15e2d0 con 0x7f499c0b3690 2024-05-08T10:55:02.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.580+0000 7fce47fff640 1 -- 172.21.15.33:0/865575301 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce40037070 con 0x7fce500d0600 2024-05-08T10:55:02.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.580+0000 7f21ae35d640 1 --2- 172.21.15.33:0/4203373412 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f21a00dfef0 0x7f21a00085d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f21a0038840 tx=0x7f219802a310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e6375b9e5fe613f3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:02.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.580+0000 7f0cfb22c640 1 Processor -- start 2024-05-08T10:55:02.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.580+0000 7fce47fff640 1 -- 172.21.15.33:0/865575301 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce4002ade0 con 0x7fce500d0600 2024-05-08T10:55:02.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.581+0000 7f49a2687640 1 --2- 172.21.15.33:0/974305940 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f499c0b3690 0x7f499c071240 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f4994009d90 tx=0x7f499402e9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0cce189d2a6ca5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:02.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.581+0000 7f21ad35b640 1 -- 172.21.15.33:0/4203373412 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2198037070 con 0x7f21a00dfef0 2024-05-08T10:55:02.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.581+0000 7f21ad35b640 1 -- 172.21.15.33:0/4203373412 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2198032640 con 0x7f21a00dfef0 2024-05-08T10:55:02.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.581+0000 7f21ad35b640 1 -- 172.21.15.33:0/4203373412 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f219802ae60 con 0x7f21a00dfef0 2024-05-08T10:55:02.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.581+0000 7fce47fff640 1 -- 172.21.15.33:0/865575301 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce40032660 con 0x7fce500d0600 2024-05-08T10:55:02.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.581+0000 7f91688ac640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f91640afb50 0x7f916406def0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:02.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.581+0000 7f91688ac640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f916415dfe0 0x7f916406aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:02.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.581+0000 7f91688ac640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91640d0900 con 0x7f916415dc00 2024-05-08T10:55:02.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.581+0000 7f91688ac640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91640d06e0 con 0x7f91640afb50 2024-05-08T10:55:02.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.581+0000 7f91688ac640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91640d0be0 con 0x7f916415dfe0 2024-05-08T10:55:02.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.581+0000 7f916259c640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f916415dc00 0x7f9164162400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:43612/0 (socket says 172.21.15.33:43612) 2024-05-08T10:55:02.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.581+0000 7f916259c640 1 -- 172.21.15.33:0/3205469440 learned_addr learned my addr 172.21.15.33:0/3205469440 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-05-08T10:55:02.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.580+0000 7fe39effd640 1 -- 172.21.15.33:0/2396949659 >> v1:172.21.15.174:6789/0 conn(0x7fe3a00cfd60 legacy=0x7fe3a00d0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:02.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.580+0000 7fe39effd640 1 -- 172.21.15.33:0/2396949659 >> v1:172.21.15.33:6789/0 conn(0x7fe3a0162820 legacy=0x7fe3a006cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:02.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.580+0000 7fe39dffb640 1 -- 172.21.15.33:0/2396949659 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 652738273 0 0) 0x7fe3a006d6b0 con 0x7fe3a0162820 2024-05-08T10:55:02.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.580+0000 7fe39effd640 1 -- 172.21.15.33:0/2396949659 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3a01636a0 con 0x7fe3a00b2ff0 2024-05-08T10:55:02.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.581+0000 7fce57874640 1 -- 172.21.15.33:0/865575301 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fce500d0600 msgr2=0x7fce50070d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:02.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.581+0000 7fce57874640 1 --2- 172.21.15.33:0/865575301 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fce500d0600 0x7fce50070d00 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fce400097a0 tx=0x7fce4002a0d0 comp rx=0 tx=0).stop 2024-05-08T10:55:02.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.582+0000 7fce57874640 1 -- 172.21.15.33:0/865575301 shutdown_connections 2024-05-08T10:55:02.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.582+0000 7f49a0e84640 1 -- 172.21.15.33:0/974305940 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4994037070 con 0x7f499c0b3690 2024-05-08T10:55:02.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.582+0000 7fce57874640 1 --2- 172.21.15.33:0/865575301 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fce500d0600 0x7fce50070d00 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:02.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.582+0000 7fce57874640 1 --2- 172.21.15.33:0/865575301 >> v2:172.21.15.33:3300/0 conn(0x7fce5006e7d0 0x7fce50143730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:02.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.582+0000 7f21af35f640 1 -- 172.21.15.33:0/4203373412 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f21a00dfef0 msgr2=0x7f21a00085d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:02.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.582+0000 7f21af35f640 1 --2- 172.21.15.33:0/4203373412 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f21a00dfef0 0x7f21a00085d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f21a0038840 tx=0x7f219802a310 comp rx=0 tx=0).stop 2024-05-08T10:55:02.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.582+0000 7f9161d9b640 1 --2- 172.21.15.33:0/3205469440 >> v2:172.21.15.33:3300/0 conn(0x7f91640afb50 0x7f916406def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:02.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.582+0000 7fce57874640 1 -- 172.21.15.33:0/865575301 >> 172.21.15.33:0/865575301 conn(0x7fce5006afc0 msgr2=0x7fce5006b3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:02.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.582+0000 7fce57874640 1 -- 172.21.15.33:0/865575301 shutdown_connections 2024-05-08T10:55:02.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.582+0000 7f49a0e84640 1 -- 172.21.15.33:0/974305940 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4994033850 con 0x7f499c0b3690 2024-05-08T10:55:02.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.582+0000 7f49a0e84640 1 -- 172.21.15.33:0/974305940 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4994033c20 con 0x7f499c0b3690 2024-05-08T10:55:02.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.582+0000 7f9162d9d640 1 --2- 172.21.15.33:0/3205469440 >> v2:172.21.15.174:3300/0 conn(0x7f916415dfe0 0x7f916406aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:02.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.582+0000 7f21af35f640 1 -- 172.21.15.33:0/4203373412 shutdown_connections 2024-05-08T10:55:02.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.582+0000 7f21af35f640 1 --2- 172.21.15.33:0/4203373412 >> v2:172.21.15.33:3300/0 conn(0x7f21a00e42d0 0x7f21a00539f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:02.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.582+0000 7f21af35f640 1 --2- 172.21.15.33:0/4203373412 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f21a00dfef0 0x7f21a00085d0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:02.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.582+0000 7f21af35f640 1 -- 172.21.15.33:0/4203373412 >> 172.21.15.33:0/4203373412 conn(0x7f21a001ef40 msgr2=0x7f21a0055c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:02.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.582+0000 7fce57874640 1 -- 172.21.15.33:0/865575301 wait complete. 2024-05-08T10:55:02.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.581+0000 7f0cfb22c640 1 -- start start 2024-05-08T10:55:02.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.582+0000 7f21af35f640 1 -- 172.21.15.33:0/4203373412 shutdown_connections 2024-05-08T10:55:02.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.582+0000 7f21af35f640 1 -- 172.21.15.33:0/4203373412 wait complete. 2024-05-08T10:55:02.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.582+0000 7f0cfb22c640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0cf406d2c0 0x7f0cf40cf2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:02.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.582+0000 7f0cf8fc8640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f0cf4158580 0x7f0cf415bb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:43618/0 (socket says 172.21.15.33:43618) 2024-05-08T10:55:02.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.582+0000 7f0cf8fc8640 1 -- 172.21.15.33:0/4106677067 learned_addr learned my addr 172.21.15.33:0/4106677067 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-05-08T10:55:02.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.582+0000 7f44bdafe640 1 Processor -- start 2024-05-08T10:55:02.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.582+0000 7f44bdafe640 1 -- start start 2024-05-08T10:55:02.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.582+0000 7f916159a640 1 -- 172.21.15.33:0/3205469440 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1406714299 0 0) 0x7f91640d0900 con 0x7f916415dc00 2024-05-08T10:55:02.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.582+0000 7f916159a640 1 -- 172.21.15.33:0/3205469440 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f914c003520 con 0x7f916415dc00 2024-05-08T10:55:02.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.583+0000 7f0cfb22c640 1 -- 172.21.15.33:0/4106677067 --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cf406f3f0 con 0x7f0cf4158580 2024-05-08T10:55:02.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.583+0000 7f0cf3fff640 1 --2- 172.21.15.33:0/4106677067 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0cf406d2c0 0x7f0cf40cf2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:02.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.583+0000 7fe39effd640 1 --2- 172.21.15.33:0/2396949659 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe3a00b2ff0 0x7fe3a00b4920 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe3900097f0 tx=0x7fe39002a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=afd543e57566d264 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:02.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.583+0000 7f0cfb22c640 1 -- 172.21.15.33:0/4106677067 --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cf40cf810 con 0x7f0cf40af6a0 2024-05-08T10:55:02.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.583+0000 7f0cfb22c640 1 -- 172.21.15.33:0/4106677067 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf40cee40 con 0x7f0cf406d2c0 2024-05-08T10:55:02.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.583+0000 7f49a40ea640 1 -- 172.21.15.33:0/974305940 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f499c0b3690 msgr2=0x7f499c071240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:02.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.583+0000 7f49a40ea640 1 --2- 172.21.15.33:0/974305940 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f499c0b3690 0x7f499c071240 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f4994009d90 tx=0x7f499402e9f0 comp rx=0 tx=0).stop 2024-05-08T10:55:02.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.583+0000 7f9161d9b640 1 -- 172.21.15.33:0/3205469440 >> v2:172.21.15.174:3300/0 conn(0x7f916415dfe0 msgr2=0x7f916406aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:02.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.583+0000 7f9161d9b640 1 --2- 172.21.15.33:0/3205469440 >> v2:172.21.15.174:3300/0 conn(0x7f916415dfe0 0x7f916406aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:02.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.583+0000 7f9161d9b640 1 -- 172.21.15.33:0/3205469440 >> v1:172.21.15.33:6789/0 conn(0x7f916415dc00 legacy=0x7f9164162400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:02.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.583+0000 7fe39dffb640 1 -- 172.21.15.33:0/2396949659 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe390037070 con 0x7fe3a00b2ff0 2024-05-08T10:55:02.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.583+0000 7fe39dffb640 1 -- 172.21.15.33:0/2396949659 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe390032440 con 0x7fe3a00b2ff0 2024-05-08T10:55:02.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.583+0000 7fe39dffb640 1 -- 172.21.15.33:0/2396949659 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe390032810 con 0x7fe3a00b2ff0 2024-05-08T10:55:02.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.584+0000 7f49a40ea640 1 -- 172.21.15.33:0/974305940 shutdown_connections 2024-05-08T10:55:02.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.584+0000 7f49a40ea640 1 --2- 172.21.15.33:0/974305940 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f499c0b3230 0x7f499c070d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:02.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.584+0000 7f49a40ea640 1 --2- 172.21.15.33:0/974305940 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f499c0b3690 0x7f499c071240 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:02.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.584+0000 7f49a40ea640 1 -- 172.21.15.33:0/974305940 >> 172.21.15.33:0/974305940 conn(0x7f499c06afc0 msgr2=0x7f499c06b3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:02.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.584+0000 7f44bdafe640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f44b815b030 0x7f44b813caf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:02.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.584+0000 7fce57874640 1 Processor -- start 2024-05-08T10:55:02.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.584+0000 7fce57874640 1 -- start start 2024-05-08T10:55:02.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.584+0000 7f44bdafe640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f44b8068b00 0x7f44b80b2930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:02.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.583+0000 7f9161d9b640 1 -- 172.21.15.33:0/3205469440 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91640d0ec0 con 0x7f91640afb50 2024-05-08T10:55:02.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.584+0000 7f21af35f640 1 Processor -- start 2024-05-08T10:55:02.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.584+0000 7f49a40ea640 1 -- 172.21.15.33:0/974305940 shutdown_connections 2024-05-08T10:55:02.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.584+0000 7f49a40ea640 1 -- 172.21.15.33:0/974305940 wait complete. 2024-05-08T10:55:02.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.584+0000 7f44bcafc640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f44b815b030 0x7f44b813caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:02.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.584+0000 7f44bcafc640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f44b815b030 0x7f44b813caf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37826/0 (socket says 172.21.15.33:37826) 2024-05-08T10:55:02.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.584+0000 7f44bd2fd640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f44b80b2e70 0x7f44b80cf740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:43626/0 (socket says 172.21.15.33:43626) 2024-05-08T10:55:02.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.584+0000 7f44b7fff640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f44b8068b00 0x7f44b80b2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:02.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.584+0000 7f44bcafc640 1 -- 172.21.15.33:0/3399353769 learned_addr learned my addr 172.21.15.33:0/3399353769 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:02.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.585+0000 7f44bdafe640 1 -- 172.21.15.33:0/3399353769 --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44b813d030 con 0x7f44b80b2e70 2024-05-08T10:55:02.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.585+0000 7fe3a54c4640 1 -- 172.21.15.33:0/2396949659 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe3a00b2ff0 msgr2=0x7fe3a00b4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:02.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.585+0000 7fe3a54c4640 1 --2- 172.21.15.33:0/2396949659 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe3a00b2ff0 0x7fe3a00b4920 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe3900097f0 tx=0x7fe39002a1a0 comp rx=0 tx=0).stop 2024-05-08T10:55:02.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.584+0000 7f21af35f640 1 -- start start 2024-05-08T10:55:02.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.584+0000 7f9161d9b640 1 --2- 172.21.15.33:0/3205469440 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91640afb50 0x7f916406def0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f91640d03a0 tx=0x7f915802a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dda8cc8f738f3f8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:02.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.585+0000 7f44bdafe640 1 -- 172.21.15.33:0/3399353769 --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44b815a550 con 0x7f44b815b030 2024-05-08T10:55:02.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.583+0000 7f0cf37fe640 1 -- 172.21.15.33:0/4106677067 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 11028454 0 0) 0x7f0cf406f3f0 con 0x7f0cf4158580 2024-05-08T10:55:02.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.583+0000 7f0cf37fe640 1 -- 172.21.15.33:0/4106677067 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0cdc003520 con 0x7f0cf4158580 2024-05-08T10:55:02.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.583+0000 7f0cf37fe640 1 -- 172.21.15.33:0/4106677067 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 553194915 0 0) 0x7f0cf40cf810 con 0x7f0cf40af6a0 2024-05-08T10:55:02.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.583+0000 7f0cf37fe640 1 -- 172.21.15.33:0/4106677067 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0cf406f3f0 con 0x7f0cf40af6a0 2024-05-08T10:55:02.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.585+0000 7f44bdafe640 1 -- 172.21.15.33:0/3399353769 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44b815a830 con 0x7f44b8068b00 2024-05-08T10:55:02.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.584+0000 7f0cf37fe640 1 -- 172.21.15.33:0/4106677067 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1128712173 0 0) 0x7f0cdc003520 con 0x7f0cf4158580 2024-05-08T10:55:02.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.584+0000 7f0cf37fe640 1 -- 172.21.15.33:0/4106677067 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0cf406d2c0 msgr2=0x7f0cf40cf2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:02.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.584+0000 7f0cf37fe640 1 --2- 172.21.15.33:0/4106677067 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0cf406d2c0 0x7f0cf40cf2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:02.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.584+0000 7f0cf37fe640 1 -- 172.21.15.33:0/4106677067 >> v1:172.21.15.174:6789/0 conn(0x7f0cf40af6a0 legacy=0x7f0cf40cffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:02.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.584+0000 7f0cf37fe640 1 -- 172.21.15.33:0/4106677067 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cf406d780 con 0x7f0cf4158580 2024-05-08T10:55:02.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.584+0000 7f0cf37fe640 1 -- 172.21.15.33:0/4106677067 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2948294915 0 0) 0x7f0cec0019f0 con 0x7f0cf4158580 2024-05-08T10:55:02.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.584+0000 7f0cf37fe640 1 -- 172.21.15.33:0/4106677067 >> v1:172.21.15.33:6789/0 conn(0x7f0cf4158580 legacy=0x7f0cf415bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:02.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.584+0000 7f0cf37fe640 1 --2- 172.21.15.33:0/4106677067 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0cdc003b70 0x7f0cdc003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:02.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.584+0000 7f0cf37fe640 1 --2- 172.21.15.33:0/4106677067 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0cdc004800 0x7f0cdc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:02.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.584+0000 7f0cf37fe640 1 --2- 172.21.15.33:0/4106677067 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0cdc0051c0 0x7f0cdc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:02.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.584+0000 7f0cf37fe640 1 -- 172.21.15.33:0/4106677067 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf40cee40 con 0x7f0cdc004800 2024-05-08T10:55:02.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.584+0000 7f0cf8fc8640 1 --2- 172.21.15.33:0/4106677067 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0cdc003b70 0x7f0cdc003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:02.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.584+0000 7f0cf37fe640 1 -- 172.21.15.33:0/4106677067 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cdc00c060 con 0x7f0cdc003b70 2024-05-08T10:55:02.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.585+0000 7f0cf37fe640 1 -- 172.21.15.33:0/4106677067 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cdc00c260 con 0x7f0cdc0051c0 2024-05-08T10:55:02.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.585+0000 7f0cf8fc8640 1 -- 172.21.15.33:0/4106677067 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0cdc0051c0 msgr2=0x7f0cdc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:02.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.585+0000 7f0cf97c9640 1 --2- 172.21.15.33:0/4106677067 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0cdc0051c0 0x7f0cdc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:02.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.585+0000 7f0cf8fc8640 1 --2- 172.21.15.33:0/4106677067 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0cdc0051c0 0x7f0cdc00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:02.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.585+0000 7fce57874640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fce5006e7d0 0x7fce5013a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:02.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.585+0000 7f0cf8fc8640 1 -- 172.21.15.33:0/4106677067 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0cdc004800 msgr2=0x7f0cdc004c80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T10:55:02.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.585+0000 7fce57874640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce500b3230 0x7fce501362c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:02.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.585+0000 7f916159a640 1 -- 172.21.15.33:0/3205469440 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9158037070 con 0x7f91640afb50 2024-05-08T10:55:02.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.585+0000 7fce57874640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fce500d0600 0x7fce5013ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:02.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.585+0000 7fce57874640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce500b2f50 con 0x7fce500b3230 2024-05-08T10:55:02.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.585+0000 7f916159a640 1 -- 172.21.15.33:0/3205469440 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9158032440 con 0x7f91640afb50 2024-05-08T10:55:02.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.585+0000 7fce57874640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce500b2dd0 con 0x7fce5006e7d0 2024-05-08T10:55:02.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.585+0000 7fce57874640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce500b36c0 con 0x7fce500d0600 2024-05-08T10:55:02.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.585+0000 7f916159a640 1 -- 172.21.15.33:0/3205469440 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9158037070 con 0x7f91640afb50 2024-05-08T10:55:02.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.585+0000 7fce55610640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fce5006e7d0 0x7fce5013a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:02.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.585+0000 7fce55610640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fce5006e7d0 0x7fce5013a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.33:50146/0 (socket says 172.21.15.33:50146) 2024-05-08T10:55:02.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.585+0000 7fce55610640 1 -- 172.21.15.33:0/2997285814 learned_addr learned my addr 172.21.15.33:0/2997285814 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:02.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.585+0000 7fce54e0f640 1 --2- 172.21.15.33:0/2997285814 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce500b3230 0x7fce501362c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:02.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.585+0000 7fe3a54c4640 1 -- 172.21.15.33:0/2396949659 shutdown_connections 2024-05-08T10:55:02.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.586+0000 7f21af35f640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f21a00dfef0 0x7f21a00da7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:02.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.585+0000 7fe3a54c4640 1 --2- 172.21.15.33:0/2396949659 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe3a00b2ff0 0x7fe3a00b4920 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:02.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.586+0000 7f21af35f640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21a00e42d0 0x7f21a0051090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:02.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.585+0000 7fe3a54c4640 1 -- 172.21.15.33:0/2396949659 >> 172.21.15.33:0/2396949659 conn(0x7fe3a006aba0 msgr2=0x7fe3a006afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:02.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.586+0000 7f21ae35d640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f21a00dfef0 0x7f21a00da7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:02.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.586+0000 7f21ae35d640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f21a00dfef0 0x7f21a00da7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.33:58834/0 (socket says 172.21.15.33:58834) 2024-05-08T10:55:02.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.586+0000 7f21ae35d640 1 -- 172.21.15.33:0/4179467709 learned_addr learned my addr 172.21.15.33:0/4179467709 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:02.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.586+0000 7f21af35f640 1 --2- 172.21.15.33:0/4179467709 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f21a00dae50 0x7f21a0173370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:02.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.586+0000 7fe3a54c4640 1 -- 172.21.15.33:0/2396949659 shutdown_connections 2024-05-08T10:55:02.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.585+0000 7f0cf8fc8640 1 --2- 172.21.15.33:0/4106677067 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0cdc004800 0x7f0cdc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:02.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.585+0000 7f0cf8fc8640 1 -- 172.21.15.33:0/4106677067 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cdc003520 con 0x7f0cdc003b70 2024-05-08T10:55:02.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.586+0000 7f0cf97c9640 1 --2- 172.21.15.33:0/4106677067 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0cdc0051c0 0x7f0cdc00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:55:02.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.586+0000 7f21af35f640 1 -- 172.21.15.33:0/4179467709 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21a0008b10 con 0x7f21a00e42d0 2024-05-08T10:55:02.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.586+0000 7f21af35f640 1 -- 172.21.15.33:0/4179467709 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21a0056b50 con 0x7f21a00dae50 2024-05-08T10:55:02.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.586+0000 7f21aeb5e640 1 --2- 172.21.15.33:0/4179467709 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f21a00dae50 0x7f21a0173370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:02.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.586+0000 7f21af35f640 1 -- 172.21.15.33:0/4179467709 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21a00e4910 con 0x7f21a00dfef0 2024-05-08T10:55:02.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.586+0000 7fce54e0f640 1 -- 172.21.15.33:0/2997285814 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fce500d0600 msgr2=0x7fce5013ca60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T10:55:02.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.586+0000 7f91688ac640 1 -- 172.21.15.33:0/3205469440 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91640afb50 msgr2=0x7f916406def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:02.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.586+0000 7f91688ac640 1 --2- 172.21.15.33:0/3205469440 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91640afb50 0x7f916406def0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f91640d03a0 tx=0x7f915802a130 comp rx=0 tx=0).stop 2024-05-08T10:55:02.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.586+0000 7f0cf8fc8640 1 --2- 172.21.15.33:0/4106677067 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0cdc003b70 0x7f0cdc003f90 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0cec00a730 tx=0x7f0cdc005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=caa5c7b7692201e6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:02.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.585+0000 7f44b7fff640 1 -- 172.21.15.33:0/3399353769 >> v2:172.21.15.33:3300/0 conn(0x7f44b815b030 msgr2=0x7f44b813caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:02.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.585+0000 7f44b7fff640 1 --2- 172.21.15.33:0/3399353769 >> v2:172.21.15.33:3300/0 conn(0x7f44b815b030 0x7f44b813caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:02.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.585+0000 7f44b7fff640 1 -- 172.21.15.33:0/3399353769 >> v1:172.21.15.33:6789/0 conn(0x7f44b80b2e70 legacy=0x7f44b80cf740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:02.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.586+0000 7fce54e0f640 1 --2- 172.21.15.33:0/2997285814 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fce500d0600 0x7fce5013ca60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:02.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.586+0000 7f44b7fff640 1 -- 172.21.15.33:0/3399353769 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44b815ab10 con 0x7f44b8068b00 2024-05-08T10:55:02.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.586+0000 7fce54e0f640 1 -- 172.21.15.33:0/2997285814 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fce5006e7d0 msgr2=0x7fce5013a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:02.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.586+0000 7fce54e0f640 1 --2- 172.21.15.33:0/2997285814 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fce5006e7d0 0x7fce5013a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:02.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.586+0000 7f0cf37fe640 1 -- 172.21.15.33:0/4106677067 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cec00a350 con 0x7f0cdc003b70 2024-05-08T10:55:02.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.586+0000 7f0cf37fe640 1 -- 172.21.15.33:0/4106677067 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cec02f070 con 0x7f0cdc003b70 2024-05-08T10:55:02.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.586+0000 7f0cf37fe640 1 -- 172.21.15.33:0/4106677067 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cec02bc00 con 0x7f0cdc003b70 2024-05-08T10:55:02.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.586+0000 7f91688ac640 1 -- 172.21.15.33:0/3205469440 shutdown_connections 2024-05-08T10:55:02.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.586+0000 7f91688ac640 1 --2- 172.21.15.33:0/3205469440 >> v2:172.21.15.174:3300/0 conn(0x7f916415dfe0 0x7f916406aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:02.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.586+0000 7f91688ac640 1 --2- 172.21.15.33:0/3205469440 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91640afb50 0x7f916406def0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:02.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.586+0000 7f91688ac640 1 -- 172.21.15.33:0/3205469440 >> 172.21.15.33:0/3205469440 conn(0x7f916406bcb0 msgr2=0x7f916406c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:02.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.586+0000 7fce54e0f640 1 -- 172.21.15.33:0/2997285814 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce5015d220 con 0x7fce500b3230 2024-05-08T10:55:02.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.586+0000 7fce54e0f640 1 --2- 172.21.15.33:0/2997285814 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce500b3230 0x7fce501362c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fce4c00caf0 tx=0x7fce4c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:02.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.587+0000 7f49a40ea640 1 Processor -- start 2024-05-08T10:55:02.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.587+0000 7f49a40ea640 1 -- start start 2024-05-08T10:55:02.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.586+0000 7fe3a54c4640 1 -- 172.21.15.33:0/2396949659 wait complete. 2024-05-08T10:55:02.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.587+0000 7f91688ac640 1 -- 172.21.15.33:0/3205469440 shutdown_connections 2024-05-08T10:55:02.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.587+0000 7fce45ffb640 1 -- 172.21.15.33:0/2997285814 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce4c00aca0 con 0x7fce500b3230 2024-05-08T10:55:02.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.587+0000 7f21adb5c640 1 --2- 172.21.15.33:0/4179467709 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21a00e42d0 0x7f21a0051090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:02.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.588+0000 7f49a40ea640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f499c0b3230 0x7f499c13a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:02.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.588+0000 7f49a40ea640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f499c0b3690 0x7f499c13c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:02.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.588+0000 7f49a40ea640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f499c0cfef0 0x7f499c140ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:02.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.588+0000 7f49a40ea640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f499c1439a0 con 0x7f499c0b3690 2024-05-08T10:55:02.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.588+0000 7f49a40ea640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f499c15e890 con 0x7f499c0cfef0 2024-05-08T10:55:02.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.588+0000 7f49a40ea640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f499c143b20 con 0x7f499c0b3230 2024-05-08T10:55:02.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.588+0000 7f49a1685640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f499c0b3690 0x7f499c13c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:02.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.588+0000 7f49a1685640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f499c0b3690 0x7f499c13c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37864/0 (socket says 172.21.15.33:37864) 2024-05-08T10:55:02.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.588+0000 7f49a1685640 1 -- 172.21.15.33:0/3003419451 learned_addr learned my addr 172.21.15.33:0/3003419451 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:02.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.588+0000 7f49a2687640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f499c0cfef0 0x7f499c140ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:02.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.588+0000 7f49a2687640 1 -- 172.21.15.33:0/3003419451 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f499c0b3230 msgr2=0x7f499c13a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:02.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.588+0000 7f49a2687640 1 --2- 172.21.15.33:0/3003419451 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f499c0b3230 0x7f499c13a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:02.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.588+0000 7f49a2687640 1 -- 172.21.15.33:0/3003419451 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f499c0b3690 msgr2=0x7f499c13c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:02.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.588+0000 7f49a2687640 1 --2- 172.21.15.33:0/3003419451 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f499c0b3690 0x7f499c13c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:02.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.588+0000 7f49a2687640 1 -- 172.21.15.33:0/3003419451 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f499c1efec0 con 0x7f499c0cfef0 2024-05-08T10:55:02.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.588+0000 7f49a2687640 1 --2- 172.21.15.33:0/3003419451 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f499c0cfef0 0x7f499c140ac0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4994036000 tx=0x7f4994004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:02.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.589+0000 7f49927fc640 1 -- 172.21.15.33:0/3003419451 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f499404d070 con 0x7f499c0cfef0 2024-05-08T10:55:02.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.588+0000 7f44b7fff640 1 --2- 172.21.15.33:0/3399353769 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f44b8068b00 0x7f44b80b2930 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f44ac0097a0 tx=0x7f44ac02a080 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd245f4989499b12 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:02.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.588+0000 7f44b77fe640 1 -- 172.21.15.33:0/3399353769 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44ac037070 con 0x7f44b8068b00 2024-05-08T10:55:02.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.588+0000 7f44b77fe640 1 -- 172.21.15.33:0/3399353769 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44ac02ad10 con 0x7f44b8068b00 2024-05-08T10:55:02.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.588+0000 7f44b77fe640 1 -- 172.21.15.33:0/3399353769 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44ac032660 con 0x7f44b8068b00 2024-05-08T10:55:02.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.587+0000 7f0cfb22c640 1 -- 172.21.15.33:0/4106677067 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0cdc003b70 msgr2=0x7f0cdc003f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:02.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.587+0000 7f0cfb22c640 1 --2- 172.21.15.33:0/4106677067 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0cdc003b70 0x7f0cdc003f90 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0cec00a730 tx=0x7f0cdc005830 comp rx=0 tx=0).stop 2024-05-08T10:55:02.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.587+0000 7f0cf97c9640 1 -- 172.21.15.33:0/4106677067 reap_dead start 2024-05-08T10:55:02.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.587+0000 7f91688ac640 1 -- 172.21.15.33:0/3205469440 wait complete. 2024-05-08T10:55:02.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.587+0000 7fce57874640 1 -- 172.21.15.33:0/2997285814 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce50158060 con 0x7fce500b3230 2024-05-08T10:55:02.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.588+0000 7fce57874640 1 -- 172.21.15.33:0/2997285814 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce5015d4c0 con 0x7fce500b3230 2024-05-08T10:55:02.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.588+0000 7fce45ffb640 1 -- 172.21.15.33:0/2997285814 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce4c00ae40 con 0x7fce500b3230 2024-05-08T10:55:02.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.588+0000 7fce45ffb640 1 -- 172.21.15.33:0/2997285814 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce4c012640 con 0x7fce500b3230 2024-05-08T10:55:02.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.589+0000 7f49927fc640 1 -- 172.21.15.33:0/3003419451 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4994033650 con 0x7f499c0cfef0 2024-05-08T10:55:02.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.589+0000 7f49927fc640 1 -- 172.21.15.33:0/3003419451 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4994037040 con 0x7f499c0cfef0 2024-05-08T10:55:02.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.589+0000 7f49a40ea640 1 -- 172.21.15.33:0/3003419451 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f499c1f01a0 con 0x7f499c0cfef0 2024-05-08T10:55:02.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.589+0000 7fe3a54c4640 1 Processor -- start 2024-05-08T10:55:02.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.589+0000 7f0cfb22c640 1 -- 172.21.15.33:0/4106677067 shutdown_connections 2024-05-08T10:55:02.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.589+0000 7f0cfb22c640 1 -- 172.21.15.33:0/4106677067 >> 172.21.15.33:0/4106677067 conn(0x7f0cf406bcb0 msgr2=0x7f0cf406c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:02.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.589+0000 7f91688ac640 1 Processor -- start 2024-05-08T10:55:02.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.589+0000 7f44bdafe640 1 -- 172.21.15.33:0/3399353769 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f44b8068b00 msgr2=0x7f44b80b2930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:02.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.589+0000 7f44bdafe640 1 --2- 172.21.15.33:0/3399353769 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f44b8068b00 0x7f44b80b2930 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f44ac0097a0 tx=0x7f44ac02a080 comp rx=0 tx=0).stop 2024-05-08T10:55:02.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.589+0000 7f91688ac640 1 -- start start 2024-05-08T10:55:02.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.589+0000 7f0cfb22c640 1 -- 172.21.15.33:0/4106677067 shutdown_connections 2024-05-08T10:55:02.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.589+0000 7f49a40ea640 1 -- 172.21.15.33:0/3003419451 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f499c1f0760 con 0x7f499c0cfef0 2024-05-08T10:55:02.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.589+0000 7f0cfb22c640 1 -- 172.21.15.33:0/4106677067 wait complete. 2024-05-08T10:55:02.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.588+0000 7f21ae35d640 1 -- 172.21.15.33:0/4179467709 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f21a00dae50 msgr2=0x7f21a0173370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:02.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.588+0000 7f21ae35d640 1 --2- 172.21.15.33:0/4179467709 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f21a00dae50 0x7f21a0173370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:02.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.588+0000 7f21ae35d640 1 -- 172.21.15.33:0/4179467709 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21a00e42d0 msgr2=0x7f21a0051090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:02.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.590+0000 7f21ae35d640 1 --2- 172.21.15.33:0/4179467709 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21a00e42d0 0x7f21a0051090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:02.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.590+0000 7f21ae35d640 1 -- 172.21.15.33:0/4179467709 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21a00519a0 con 0x7f21a00dfef0 2024-05-08T10:55:02.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.590+0000 7f21adb5c640 1 --2- 172.21.15.33:0/4179467709 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21a00e42d0 0x7f21a0051090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:55:02.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.590+0000 7f44bdafe640 1 -- 172.21.15.33:0/3399353769 shutdown_connections 2024-05-08T10:55:02.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.590+0000 7f44bdafe640 1 --2- 172.21.15.33:0/3399353769 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f44b8068b00 0x7f44b80b2930 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:02.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.590+0000 7f44bdafe640 1 --2- 172.21.15.33:0/3399353769 >> v2:172.21.15.33:3300/0 conn(0x7f44b815b030 0x7f44b813caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:02.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.590+0000 7f44bdafe640 1 -- 172.21.15.33:0/3399353769 >> 172.21.15.33:0/3399353769 conn(0x7f44b806ad80 msgr2=0x7f44b806b190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:02.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.590+0000 7f44bdafe640 1 -- 172.21.15.33:0/3399353769 shutdown_connections 2024-05-08T10:55:02.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.590+0000 7f44bdafe640 1 -- 172.21.15.33:0/3399353769 wait complete. 2024-05-08T10:55:02.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.590+0000 7fce45ffb640 1 -- 172.21.15.33:0/2997285814 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fce4c0127e0 con 0x7fce500b3230 2024-05-08T10:55:02.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.590+0000 7fce57874640 1 -- 172.21.15.33:0/2997285814 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce30005290 con 0x7fce500b3230 2024-05-08T10:55:02.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.591+0000 7f91688ac640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f916415dc00 0x7f916414a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:02.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.591+0000 7f21ae35d640 1 --2- 172.21.15.33:0/4179467709 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f21a00dfef0 0x7f21a00da7c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2198009960 tx=0x7f21980046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:02.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.591+0000 7f91688ac640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f916415dfe0 0x7f91641546f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:02.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.591+0000 7f916259c640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f916415dc00 0x7f916414a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:02.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.591+0000 7f916259c640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f916415dc00 0x7f916414a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.33:58850/0 (socket says 172.21.15.33:58850) 2024-05-08T10:55:02.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.591+0000 7f219effd640 1 -- 172.21.15.33:0/4179467709 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2198037040 con 0x7f21a00dfef0 2024-05-08T10:55:02.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.591+0000 7f219effd640 1 -- 172.21.15.33:0/4179467709 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2198042070 con 0x7f21a00dfef0 2024-05-08T10:55:02.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.591+0000 7f219effd640 1 -- 172.21.15.33:0/4179467709 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f219802ae60 con 0x7f21a00dfef0 2024-05-08T10:55:02.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.591+0000 7f916259c640 1 -- 172.21.15.33:0/4241519536 learned_addr learned my addr 172.21.15.33:0/4241519536 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:02.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.591+0000 7f49927fc640 1 -- 172.21.15.33:0/3003419451 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4994050070 con 0x7f499c0cfef0 2024-05-08T10:55:02.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.591+0000 7f9161d9b640 1 --2- 172.21.15.33:0/4241519536 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f916415dfe0 0x7f91641546f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:02.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.591+0000 7f91688ac640 1 --2- 172.21.15.33:0/4241519536 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9164154c30 0x7f9164156bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:02.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.590+0000 7fe3a54c4640 1 -- start start 2024-05-08T10:55:02.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.592+0000 7f9162d9d640 1 --2- 172.21.15.33:0/4241519536 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9164154c30 0x7f9164156bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:02.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.592+0000 7f91688ac640 1 -- 172.21.15.33:0/4241519536 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f916406b260 con 0x7f9164154c30 2024-05-08T10:55:02.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.592+0000 7f91688ac640 1 -- 172.21.15.33:0/4241519536 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f916406b0e0 con 0x7f916415dfe0 2024-05-08T10:55:02.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.592+0000 7f91688ac640 1 -- 172.21.15.33:0/4241519536 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f916406b3e0 con 0x7f916415dc00 2024-05-08T10:55:02.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.592+0000 7f49927fc640 1 --2- 172.21.15.33:0/3003419451 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f498006b5a0 0x7f498006da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:02.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.592+0000 7f49927fc640 1 -- 172.21.15.33:0/3003419451 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f49940af590 con 0x7f499c0cfef0 2024-05-08T10:55:02.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.592+0000 7f44bdafe640 1 Processor -- start 2024-05-08T10:55:02.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.592+0000 7f0cfb22c640 1 Processor -- start 2024-05-08T10:55:02.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.592+0000 7f9162d9d640 1 -- 172.21.15.33:0/4241519536 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f916415dc00 msgr2=0x7f916414a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:02.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.592+0000 7f49a1e86640 1 --2- 172.21.15.33:0/3003419451 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f498006b5a0 0x7f498006da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:02.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.592+0000 7f0cfb22c640 1 -- start start 2024-05-08T10:55:02.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.592+0000 7f9162d9d640 1 --2- 172.21.15.33:0/4241519536 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f916415dc00 0x7f916414a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:02.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.592+0000 7f9162d9d640 1 -- 172.21.15.33:0/4241519536 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f916415dfe0 msgr2=0x7f91641546f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:02.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.592+0000 7f9162d9d640 1 --2- 172.21.15.33:0/4241519536 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f916415dfe0 0x7f91641546f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:02.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.592+0000 7f44bdafe640 1 -- start start 2024-05-08T10:55:02.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.592+0000 7f9162d9d640 1 -- 172.21.15.33:0/4241519536 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f916414ac70 con 0x7f9164154c30 2024-05-08T10:55:02.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.593+0000 7f9162d9d640 1 --2- 172.21.15.33:0/4241519536 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9164154c30 0x7f9164156bb0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f915c009f90 tx=0x7f915c00e570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:02.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.591+0000 7fce45ffb640 1 --2- 172.21.15.33:0/2997285814 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fce3406b520 0x7fce3406d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:02.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.591+0000 7fce45ffb640 1 -- 172.21.15.33:0/2997285814 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fce4c08e170 con 0x7fce500b3230 2024-05-08T10:55:02.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.592+0000 7fce55610640 1 --2- 172.21.15.33:0/2997285814 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fce3406b520 0x7fce3406d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:02.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.593+0000 7fe3a54c4640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe3a00b2ff0 0x7fe3a02005f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:02.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.593+0000 7f21af35f640 1 -- 172.21.15.33:0/4179467709 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21a0051c80 con 0x7f21a00dfef0 2024-05-08T10:55:02.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.593+0000 7fe3a54c4640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe3a00cfd60 0x7fe3a0161140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:02.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.593+0000 7f21af35f640 1 -- 172.21.15.33:0/4179467709 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21a0052240 con 0x7f21a00dfef0 2024-05-08T10:55:02.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.593+0000 7f49a1e86640 1 --2- 172.21.15.33:0/3003419451 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f498006b5a0 0x7f498006da60 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f499c13b7a0 tx=0x7f4998007a40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:02.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.593+0000 7fe3a54c4640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3a0162820 0x7fe3a00b1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:02.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.593+0000 7fe39effd640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe3a00b2ff0 0x7fe3a02005f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:02.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.593+0000 7fce55610640 1 --2- 172.21.15.33:0/2997285814 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fce3406b520 0x7fce3406d9e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fce5015b060 tx=0x7fce48009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:02.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.593+0000 7fe39e7fc640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe3a00cfd60 0x7fe3a0161140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:02.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.593+0000 7fe39e7fc640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe3a00cfd60 0x7fe3a0161140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.33:58854/0 (socket says 172.21.15.33:58854) 2024-05-08T10:55:02.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.593+0000 7f49a40ea640 1 -- 172.21.15.33:0/3003419451 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f499c069d20 con 0x7f499c0cfef0 2024-05-08T10:55:02.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.593+0000 7fe39effd640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe3a00b2ff0 0x7fe3a02005f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.33:50192/0 (socket says 172.21.15.33:50192) 2024-05-08T10:55:02.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.594+0000 7fe39f7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3a0162820 0x7fe3a00b1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:02.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.594+0000 7fe39f7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3a0162820 0x7fe3a00b1610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37880/0 (socket says 172.21.15.33:37880) 2024-05-08T10:55:02.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.594+0000 7fe39e7fc640 1 -- 172.21.15.33:0/181962248 learned_addr learned my addr 172.21.15.33:0/181962248 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:02.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.594+0000 7fe3a54c4640 1 -- 172.21.15.33:0/181962248 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a00b33d0 con 0x7fe3a0162820 2024-05-08T10:55:02.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.594+0000 7fe3a54c4640 1 -- 172.21.15.33:0/181962248 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a006ca80 con 0x7fe3a00b2ff0 2024-05-08T10:55:02.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.594+0000 7f44bdafe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44b8068b00 0x7f44b81f2e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:02.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.594+0000 7fe3a54c4640 1 -- 172.21.15.33:0/181962248 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a0162c90 con 0x7fe3a00cfd60 2024-05-08T10:55:02.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.594+0000 7f0cfb22c640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0cdc003b70 0x7f0cf413df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:02.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.594+0000 7f44bcafc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44b8068b00 0x7f44b81f2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:02.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.594+0000 7f0cfb22c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0cf40b5430 0x7f0cf4156b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:02.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.594+0000 7f44bcafc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44b8068b00 0x7f44b81f2e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37890/0 (socket says 172.21.15.33:37890) 2024-05-08T10:55:02.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.594+0000 7f0cf8fc8640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0cdc003b70 0x7f0cf413df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:02.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.594+0000 7f0cfb22c640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0cf4157070 0x7f0cf415bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:02.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.594+0000 7f0cfb22c640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf406da60 con 0x7f0cf40b5430 2024-05-08T10:55:02.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.594+0000 7f0cfb22c640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf40cead0 con 0x7f0cdc003b70 2024-05-08T10:55:02.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.594+0000 7f0cf8fc8640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0cdc003b70 0x7f0cf413df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.33:50196/0 (socket says 172.21.15.33:50196) 2024-05-08T10:55:02.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.594+0000 7f0cfb22c640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf4158960 con 0x7f0cf4157070 2024-05-08T10:55:02.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.594+0000 7f0cf8fc8640 1 -- 172.21.15.33:0/679993142 learned_addr learned my addr 172.21.15.33:0/679993142 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:02.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.594+0000 7f44bcafc640 1 -- 172.21.15.33:0/1172667219 learned_addr learned my addr 172.21.15.33:0/1172667219 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:02.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.595+0000 7f44bdafe640 1 --2- 172.21.15.33:0/1172667219 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f44b80b2e70 0x7f44b8203d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:02.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.595+0000 7f0cf97c9640 1 --2- 172.21.15.33:0/679993142 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0cf4157070 0x7f0cf415bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:02.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.595+0000 7f44bdafe640 1 --2- 172.21.15.33:0/1172667219 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f44b815b030 0x7f44b8204290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:02.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.595+0000 7f0cf8fc8640 1 -- 172.21.15.33:0/679993142 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0cf4157070 msgr2=0x7f0cf415bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:02.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.595+0000 7f0cf8fc8640 1 --2- 172.21.15.33:0/679993142 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0cf4157070 0x7f0cf415bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:02.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.595+0000 7f0cf8fc8640 1 -- 172.21.15.33:0/679993142 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0cf40b5430 msgr2=0x7f0cf4156b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:02.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.595+0000 7f0cf8fc8640 1 --2- 172.21.15.33:0/679993142 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0cf40b5430 0x7f0cf4156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:02.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.595+0000 7f0cf8fc8640 1 -- 172.21.15.33:0/679993142 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cf40b4390 con 0x7f0cdc003b70 2024-05-08T10:55:02.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.594+0000 7fe39f7fe640 1 -- 172.21.15.33:0/181962248 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe3a00cfd60 msgr2=0x7fe3a0161140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:02.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.594+0000 7fe39f7fe640 1 --2- 172.21.15.33:0/181962248 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe3a00cfd60 0x7fe3a0161140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:02.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.594+0000 7fe39f7fe640 1 -- 172.21.15.33:0/181962248 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe3a00b2ff0 msgr2=0x7fe3a02005f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:02.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.594+0000 7fe39f7fe640 1 --2- 172.21.15.33:0/181962248 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe3a00b2ff0 0x7fe3a02005f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:02.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.594+0000 7fe39f7fe640 1 -- 172.21.15.33:0/181962248 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3a0161a50 con 0x7fe3a0162820 2024-05-08T10:55:02.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.595+0000 7fe39f7fe640 1 --2- 172.21.15.33:0/181962248 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3a0162820 0x7fe3a00b1610 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe39800cac0 tx=0x7fe39800cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:02.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.595+0000 7f44bdafe640 1 -- 172.21.15.33:0/1172667219 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44b815e760 con 0x7f44b8068b00 2024-05-08T10:55:02.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.595+0000 7f44bdafe640 1 -- 172.21.15.33:0/1172667219 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44b815e5e0 con 0x7f44b815b030 2024-05-08T10:55:02.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.595+0000 7f44bdafe640 1 -- 172.21.15.33:0/1172667219 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44b80cfe50 con 0x7f44b80b2e70 2024-05-08T10:55:02.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.595+0000 7f44bd2fd640 1 --2- 172.21.15.33:0/1172667219 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f44b815b030 0x7f44b8204290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:02.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.595+0000 7f44b7fff640 1 --2- 172.21.15.33:0/1172667219 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f44b80b2e70 0x7f44b8203d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:02.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.595+0000 7f0cf8fc8640 1 --2- 172.21.15.33:0/679993142 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0cdc003b70 0x7f0cf413df90 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0cec00a730 tx=0x7f0cf406d950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:02.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.595+0000 7f219effd640 1 -- 172.21.15.33:0/4179467709 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f21980309b0 con 0x7f21a00dfef0 2024-05-08T10:55:02.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.595+0000 7f21af35f640 1 -- 172.21.15.33:0/4179467709 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21a00057e0 con 0x7f21a00dfef0 2024-05-08T10:55:02.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.596+0000 7f219effd640 1 --2- 172.21.15.33:0/4179467709 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f218c06b5d0 0x7f218c06da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:02.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.596+0000 7f44bcafc640 1 -- 172.21.15.33:0/1172667219 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f44b80b2e70 msgr2=0x7f44b8203d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:02.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.596+0000 7f44bcafc640 1 --2- 172.21.15.33:0/1172667219 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f44b80b2e70 0x7f44b8203d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:02.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.596+0000 7f44bcafc640 1 -- 172.21.15.33:0/1172667219 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f44b815b030 msgr2=0x7f44b8204290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:02.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.596+0000 7f44bcafc640 1 --2- 172.21.15.33:0/1172667219 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f44b815b030 0x7f44b8204290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:02.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.596+0000 7f44bcafc640 1 -- 172.21.15.33:0/1172667219 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44b812ce50 con 0x7f44b8068b00 2024-05-08T10:55:02.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.596+0000 7f44bd2fd640 1 --2- 172.21.15.33:0/1172667219 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f44b815b030 0x7f44b8204290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T10:55:02.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.596+0000 7f219effd640 1 -- 172.21.15.33:0/4179467709 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f21980aa820 con 0x7f21a00dfef0 2024-05-08T10:55:02.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.596+0000 7f44bcafc640 1 --2- 172.21.15.33:0/1172667219 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44b8068b00 0x7f44b81f2e60 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f44a800d940 tx=0x7f44a800de00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:02.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.596+0000 7f21adb5c640 1 --2- 172.21.15.33:0/4179467709 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f218c06b5d0 0x7f218c06da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:02.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.596+0000 7f21adb5c640 1 --2- 172.21.15.33:0/4179467709 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f218c06b5d0 0x7f218c06da90 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f21a80508c0 tx=0x7f21a806d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:02.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.598+0000 7f9152ffd640 1 -- 172.21.15.33:0/4241519536 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f915c00ed40 con 0x7f9164154c30 2024-05-08T10:55:02.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.598+0000 7fe3877fe640 1 -- 172.21.15.33:0/181962248 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe398017070 con 0x7fe3a0162820 2024-05-08T10:55:02.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.598+0000 7f9152ffd640 1 -- 172.21.15.33:0/4241519536 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f915c003990 con 0x7f9164154c30 2024-05-08T10:55:02.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.598+0000 7f44b57fa640 1 -- 172.21.15.33:0/1172667219 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a8018020 con 0x7f44b8068b00 2024-05-08T10:55:02.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.598+0000 7fe3a54c4640 1 -- 172.21.15.33:0/181962248 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3a0161d30 con 0x7fe3a0162820 2024-05-08T10:55:02.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.598+0000 7f91688ac640 1 -- 172.21.15.33:0/4241519536 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9164155190 con 0x7f9164154c30 2024-05-08T10:55:02.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.598+0000 7f9152ffd640 1 -- 172.21.15.33:0/4241519536 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f915c003d80 con 0x7f9164154c30 2024-05-08T10:55:02.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.598+0000 7fe3a54c4640 1 -- 172.21.15.33:0/181962248 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3a015cff0 con 0x7fe3a0162820 2024-05-08T10:55:02.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.598+0000 7f44b57fa640 1 -- 172.21.15.33:0/1172667219 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44a8009760 con 0x7f44b8068b00 2024-05-08T10:55:02.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.598+0000 7f91688ac640 1 -- 172.21.15.33:0/4241519536 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f916415a1f0 con 0x7f9164154c30 2024-05-08T10:55:02.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.598+0000 7fce45ffb640 1 -- 172.21.15.33:0/2997285814 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fce4c058d60 con 0x7fce500b3230 2024-05-08T10:55:02.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.599+0000 7f0cf17fa640 1 -- 172.21.15.33:0/679993142 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cec00a350 con 0x7f0cdc003b70 2024-05-08T10:55:02.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.599+0000 7f0cf17fa640 1 -- 172.21.15.33:0/679993142 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cec004d70 con 0x7f0cdc003b70 2024-05-08T10:55:02.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.599+0000 7f0cf17fa640 1 -- 172.21.15.33:0/679993142 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cec02bd10 con 0x7f0cdc003b70 2024-05-08T10:55:02.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.599+0000 7f49927fc640 1 -- 172.21.15.33:0/3003419451 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f499407dec0 con 0x7f499c0cfef0 2024-05-08T10:55:02.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.599+0000 7fe3877fe640 1 -- 172.21.15.33:0/181962248 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe398003b70 con 0x7fe3a0162820 2024-05-08T10:55:02.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.599+0000 7fe3877fe640 1 -- 172.21.15.33:0/181962248 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe39800a760 con 0x7fe3a0162820 2024-05-08T10:55:02.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.599+0000 7f0cfb22c640 1 -- 172.21.15.33:0/679993142 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cf40b4670 con 0x7f0cdc003b70 2024-05-08T10:55:02.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.599+0000 7f0cfb22c640 1 -- 172.21.15.33:0/679993142 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cf40b4c30 con 0x7f0cdc003b70 2024-05-08T10:55:02.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.600+0000 7fe3a54c4640 1 -- 172.21.15.33:0/181962248 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe380005290 con 0x7fe3a0162820 2024-05-08T10:55:02.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.600+0000 7f9152ffd640 1 -- 172.21.15.33:0/4241519536 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f915c01b020 con 0x7f9164154c30 2024-05-08T10:55:02.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.601+0000 7f0cfb22c640 1 -- 172.21.15.33:0/679993142 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cf4069d20 con 0x7f0cdc003b70 2024-05-08T10:55:02.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.601+0000 7f9152ffd640 1 --2- 172.21.15.33:0/4241519536 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f914406b500 0x7f914406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:02.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.601+0000 7f9152ffd640 1 -- 172.21.15.33:0/4241519536 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f915c08a210 con 0x7f9164154c30 2024-05-08T10:55:02.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.601+0000 7f219effd640 1 -- 172.21.15.33:0/4179467709 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2198079680 con 0x7f21a00dfef0 2024-05-08T10:55:02.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.601+0000 7f916259c640 1 --2- 172.21.15.33:0/4241519536 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f914406b500 0x7f914406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:02.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.601+0000 7f0cf17fa640 1 -- 172.21.15.33:0/679993142 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0cec034470 con 0x7f0cdc003b70 2024-05-08T10:55:02.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.602+0000 7f0cf17fa640 1 --2- 172.21.15.33:0/679993142 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f0ce006b500 0x7f0ce006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:02.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.602+0000 7f0cf17fa640 1 -- 172.21.15.33:0/679993142 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0cec0aad70 con 0x7f0cdc003b70 2024-05-08T10:55:02.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.602+0000 7fe3877fe640 1 -- 172.21.15.33:0/181962248 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe39801a070 con 0x7fe3a0162820 2024-05-08T10:55:02.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.602+0000 7fe3877fe640 1 --2- 172.21.15.33:0/181962248 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fe38c06b4d0 0x7fe38c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:02.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.603+0000 7fe3877fe640 1 -- 172.21.15.33:0/181962248 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe398089820 con 0x7fe3a0162820 2024-05-08T10:55:02.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.601+0000 7f44b57fa640 1 -- 172.21.15.33:0/1172667219 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a8009b50 con 0x7f44b8068b00 2024-05-08T10:55:02.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.601+0000 7f44bdafe640 1 -- 172.21.15.33:0/1172667219 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44b812d130 con 0x7f44b8068b00 2024-05-08T10:55:02.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.601+0000 7f44bdafe640 1 -- 172.21.15.33:0/1172667219 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44b812d6f0 con 0x7f44b8068b00 2024-05-08T10:55:02.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.603+0000 7f0cf3fff640 1 --2- 172.21.15.33:0/679993142 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f0ce006b500 0x7f0ce006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:02.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.603+0000 7f91688ac640 1 -- 172.21.15.33:0/4241519536 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91641556b0 con 0x7f9164154c30 2024-05-08T10:55:02.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.603+0000 7fe39effd640 1 --2- 172.21.15.33:0/181962248 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fe38c06b4d0 0x7fe38c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:02.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.603+0000 7f916259c640 1 --2- 172.21.15.33:0/4241519536 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f914406b500 0x7f914406d9c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f91540011e0 tx=0x7f9154009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:02.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.603+0000 7f44bdafe640 1 -- 172.21.15.33:0/1172667219 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44b804efc0 con 0x7f44b8068b00 2024-05-08T10:55:02.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.604+0000 7fe39effd640 1 --2- 172.21.15.33:0/181962248 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fe38c06b4d0 0x7fe38c06d990 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe390034000 tx=0x7fe39002e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:02.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.604+0000 7f0cf3fff640 1 --2- 172.21.15.33:0/679993142 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f0ce006b500 0x7f0ce006d9c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0cf4156ac0 tx=0x7f0ce4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:02.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.606+0000 7f0cf17fa640 1 -- 172.21.15.33:0/679993142 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0cec079be0 con 0x7f0cdc003b70 2024-05-08T10:55:02.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.611+0000 7fe3877fe640 1 -- 172.21.15.33:0/181962248 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe398057fb0 con 0x7fe3a0162820 2024-05-08T10:55:02.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.613+0000 7f44b57fa640 1 -- 172.21.15.33:0/1172667219 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f44a801b020 con 0x7f44b8068b00 2024-05-08T10:55:02.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.614+0000 7f44b57fa640 1 --2- 172.21.15.33:0/1172667219 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f44a406b4d0 0x7f44a406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:02.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.615+0000 7f44b7fff640 1 --2- 172.21.15.33:0/1172667219 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f44a406b4d0 0x7f44a406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:02.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.615+0000 7f44b7fff640 1 --2- 172.21.15.33:0/1172667219 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f44a406b4d0 0x7f44a406d990 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f44ac034000 tx=0x7f44ac02e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:02.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.621+0000 7f44b57fa640 1 -- 172.21.15.33:0/1172667219 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f44a8057410 con 0x7f44b8068b00 2024-05-08T10:55:02.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.621+0000 7f9152ffd640 1 -- 172.21.15.33:0/4241519536 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f91641556b0 con 0x7f9164154c30 2024-05-08T10:55:02.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.630+0000 7f44b57fa640 1 -- 172.21.15.33:0/1172667219 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f44a8022020 con 0x7f44b8068b00 2024-05-08T10:55:02.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.961+0000 7ffbcf59e640 1 -- 172.21.15.33:0/2656465718 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ffbb4005580 con 0x7ffbd006cd40 2024-05-08T10:55:02.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.962+0000 7ffbbeffd640 1 -- 172.21.15.33:0/2656465718 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ffbc405c950 con 0x7ffbd006cd40 2024-05-08T10:55:02.959 INFO:teuthology.orchestra.run.smithi033.stdout:55834574856 2024-05-08T10:55:02.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.965+0000 7ffbbcff9640 1 -- 172.21.15.33:0/2656465718 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7ffbb006b5d0 msgr2=0x7ffbb006da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:02.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.965+0000 7ffbbcff9640 1 --2- 172.21.15.33:0/2656465718 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7ffbb006b5d0 0x7ffbb006da90 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ffbd0159610 tx=0x7ffbc0009040 comp rx=0 tx=0).stop 2024-05-08T10:55:02.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.965+0000 7ffbbcff9640 1 -- 172.21.15.33:0/2656465718 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffbd006cd40 msgr2=0x7ffbd0200d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:02.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.965+0000 7ffbbcff9640 1 --2- 172.21.15.33:0/2656465718 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffbd006cd40 0x7ffbd0200d20 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ffbc400c7f0 tx=0x7ffbc400ccb0 comp rx=0 tx=0).stop 2024-05-08T10:55:02.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.966+0000 7ffbbcff9640 1 -- 172.21.15.33:0/2656465718 shutdown_connections 2024-05-08T10:55:02.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.966+0000 7ffbbcff9640 1 --2- 172.21.15.33:0/2656465718 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7ffbb006b5d0 0x7ffbb006da90 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:02.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.966+0000 7ffbbcff9640 1 --2- 172.21.15.33:0/2656465718 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffbd00b46b0 0x7ffbd015af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:02.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.966+0000 7ffbbcff9640 1 --2- 172.21.15.33:0/2656465718 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffbd00712a0 0x7ffbd0153af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:02.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.966+0000 7ffbbcff9640 1 --2- 172.21.15.33:0/2656465718 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffbd006cd40 0x7ffbd0200d20 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:02.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.966+0000 7ffbbcff9640 1 -- 172.21.15.33:0/2656465718 >> 172.21.15.33:0/2656465718 conn(0x7ffbd006aba0 msgr2=0x7ffbd00b0690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:02.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.966+0000 7ffbbcff9640 1 -- 172.21.15.33:0/2656465718 shutdown_connections 2024-05-08T10:55:02.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:02.966+0000 7ffbbcff9640 1 -- 172.21.15.33:0/2656465718 wait complete. 2024-05-08T10:55:02.980 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.2 2024-05-08T10:55:02.981 DEBUG:teuthology.parallel:result is None 2024-05-08T10:55:03.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.009+0000 7f44bdafe640 1 -- 172.21.15.33:0/1172667219 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f44b815d450 con 0x7f44b8068b00 2024-05-08T10:55:03.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.009+0000 7f44b57fa640 1 -- 172.21.15.33:0/1172667219 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f44a8059370 con 0x7f44b8068b00 2024-05-08T10:55:03.007 INFO:teuthology.orchestra.run.smithi033.stdout:55834574856 2024-05-08T10:55:03.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.011+0000 7f44bdafe640 1 -- 172.21.15.33:0/1172667219 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f44a406b4d0 msgr2=0x7f44a406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:03.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.011+0000 7f44bdafe640 1 --2- 172.21.15.33:0/1172667219 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f44a406b4d0 0x7f44a406d990 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f44ac034000 tx=0x7f44ac02e000 comp rx=0 tx=0).stop 2024-05-08T10:55:03.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.012+0000 7f44bdafe640 1 -- 172.21.15.33:0/1172667219 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44b8068b00 msgr2=0x7f44b81f2e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:03.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.012+0000 7f44bdafe640 1 --2- 172.21.15.33:0/1172667219 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44b8068b00 0x7f44b81f2e60 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f44a800d940 tx=0x7f44a800de00 comp rx=0 tx=0).stop 2024-05-08T10:55:03.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.012+0000 7f44bdafe640 1 -- 172.21.15.33:0/1172667219 shutdown_connections 2024-05-08T10:55:03.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.012+0000 7f44bdafe640 1 --2- 172.21.15.33:0/1172667219 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f44a406b4d0 0x7f44a406d990 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:03.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.012+0000 7f44bdafe640 1 --2- 172.21.15.33:0/1172667219 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f44b815b030 0x7f44b8204290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:03.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.012+0000 7f44bdafe640 1 --2- 172.21.15.33:0/1172667219 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f44b80b2e70 0x7f44b8203d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:03.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.012+0000 7f44bdafe640 1 --2- 172.21.15.33:0/1172667219 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44b8068b00 0x7f44b81f2e60 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:03.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.012+0000 7f44bdafe640 1 -- 172.21.15.33:0/1172667219 >> 172.21.15.33:0/1172667219 conn(0x7f44b806ad80 msgr2=0x7f44b806b160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:03.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.012+0000 7f44bdafe640 1 -- 172.21.15.33:0/1172667219 shutdown_connections 2024-05-08T10:55:03.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.012+0000 7f44bdafe640 1 -- 172.21.15.33:0/1172667219 wait complete. 2024-05-08T10:55:03.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.012+0000 7fce57874640 1 -- 172.21.15.33:0/2997285814 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fce30005850 con 0x7fce500b3230 2024-05-08T10:55:03.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.013+0000 7fce45ffb640 1 -- 172.21.15.33:0/2997285814 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fce4c058660 con 0x7fce500b3230 2024-05-08T10:55:03.011 INFO:teuthology.orchestra.run.smithi033.stdout:55834574857 2024-05-08T10:55:03.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.014+0000 7f21af35f640 1 -- 172.21.15.33:0/4179467709 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f21a000f3c0 con 0x7f21a00dfef0 2024-05-08T10:55:03.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.014+0000 7f219effd640 1 -- 172.21.15.33:0/4179467709 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2198078f80 con 0x7f21a00dfef0 2024-05-08T10:55:03.012 INFO:teuthology.orchestra.run.smithi033.stdout:55834574856 2024-05-08T10:55:03.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.016+0000 7fce57874640 1 -- 172.21.15.33:0/2997285814 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fce3406b520 msgr2=0x7fce3406d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:03.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.017+0000 7fce57874640 1 --2- 172.21.15.33:0/2997285814 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fce3406b520 0x7fce3406d9e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fce5015b060 tx=0x7fce48009190 comp rx=0 tx=0).stop 2024-05-08T10:55:03.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.017+0000 7fce57874640 1 -- 172.21.15.33:0/2997285814 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce500b3230 msgr2=0x7fce501362c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:03.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.017+0000 7fce57874640 1 --2- 172.21.15.33:0/2997285814 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce500b3230 0x7fce501362c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fce4c00caf0 tx=0x7fce4c00a060 comp rx=0 tx=0).stop 2024-05-08T10:55:03.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.017+0000 7fce57874640 1 -- 172.21.15.33:0/2997285814 shutdown_connections 2024-05-08T10:55:03.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.017+0000 7fce57874640 1 --2- 172.21.15.33:0/2997285814 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fce3406b520 0x7fce3406d9e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:03.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.017+0000 7fce57874640 1 --2- 172.21.15.33:0/2997285814 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fce500d0600 0x7fce5013ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:03.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.017+0000 7fce57874640 1 --2- 172.21.15.33:0/2997285814 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce500b3230 0x7fce501362c0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:03.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.017+0000 7fce57874640 1 --2- 172.21.15.33:0/2997285814 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fce5006e7d0 0x7fce5013a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:03.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.017+0000 7fce57874640 1 -- 172.21.15.33:0/2997285814 >> 172.21.15.33:0/2997285814 conn(0x7fce5006afc0 msgr2=0x7fce501574d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:03.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.018+0000 7fce57874640 1 -- 172.21.15.33:0/2997285814 shutdown_connections 2024-05-08T10:55:03.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.018+0000 7f21af35f640 1 -- 172.21.15.33:0/4179467709 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f218c06b5d0 msgr2=0x7f218c06da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:03.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.018+0000 7f21af35f640 1 --2- 172.21.15.33:0/4179467709 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f218c06b5d0 0x7f218c06da90 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f21a80508c0 tx=0x7f21a806d040 comp rx=0 tx=0).stop 2024-05-08T10:55:03.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.018+0000 7f21af35f640 1 -- 172.21.15.33:0/4179467709 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f21a00dfef0 msgr2=0x7f21a00da7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:03.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.018+0000 7f21af35f640 1 --2- 172.21.15.33:0/4179467709 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f21a00dfef0 0x7f21a00da7c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2198009960 tx=0x7f21980046c0 comp rx=0 tx=0).stop 2024-05-08T10:55:03.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.018+0000 7f21af35f640 1 -- 172.21.15.33:0/4179467709 shutdown_connections 2024-05-08T10:55:03.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.018+0000 7f21af35f640 1 --2- 172.21.15.33:0/4179467709 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f218c06b5d0 0x7f218c06da90 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:03.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.018+0000 7f21af35f640 1 --2- 172.21.15.33:0/4179467709 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f21a00dae50 0x7f21a0173370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:03.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.018+0000 7f21af35f640 1 --2- 172.21.15.33:0/4179467709 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21a00e42d0 0x7f21a0051090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:03.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.018+0000 7f21af35f640 1 --2- 172.21.15.33:0/4179467709 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f21a00dfef0 0x7f21a00da7c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:03.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.018+0000 7f21af35f640 1 -- 172.21.15.33:0/4179467709 >> 172.21.15.33:0/4179467709 conn(0x7f21a001ef40 msgr2=0x7f21a000ca60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:03.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.018+0000 7f21af35f640 1 -- 172.21.15.33:0/4179467709 shutdown_connections 2024-05-08T10:55:03.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.018+0000 7f21af35f640 1 -- 172.21.15.33:0/4179467709 wait complete. 2024-05-08T10:55:03.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.018+0000 7fce57874640 1 -- 172.21.15.33:0/2997285814 wait complete. 2024-05-08T10:55:03.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.025+0000 7f49a40ea640 1 -- 172.21.15.33:0/3003419451 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f499c142150 con 0x7f499c0cfef0 2024-05-08T10:55:03.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.026+0000 7f49927fc640 1 -- 172.21.15.33:0/3003419451 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4994081f60 con 0x7f499c0cfef0 2024-05-08T10:55:03.023 INFO:teuthology.orchestra.run.smithi033.stdout:55834574856 2024-05-08T10:55:03.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.028+0000 7f0cfb22c640 1 -- 172.21.15.33:0/679993142 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f0cf4153da0 con 0x7f0cdc003b70 2024-05-08T10:55:03.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.028+0000 7f0cf17fa640 1 -- 172.21.15.33:0/679993142 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0cec0794e0 con 0x7f0cdc003b70 2024-05-08T10:55:03.025 INFO:teuthology.orchestra.run.smithi033.stdout:55834574856 2024-05-08T10:55:03.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.029+0000 7f49a40ea640 1 -- 172.21.15.33:0/3003419451 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f498006b5a0 msgr2=0x7f498006da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:03.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.029+0000 7f49a40ea640 1 --2- 172.21.15.33:0/3003419451 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f498006b5a0 0x7f498006da60 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f499c13b7a0 tx=0x7f4998007a40 comp rx=0 tx=0).stop 2024-05-08T10:55:03.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.029+0000 7f49a40ea640 1 -- 172.21.15.33:0/3003419451 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f499c0cfef0 msgr2=0x7f499c140ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:03.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.029+0000 7f49a40ea640 1 --2- 172.21.15.33:0/3003419451 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f499c0cfef0 0x7f499c140ac0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4994036000 tx=0x7f4994004a40 comp rx=0 tx=0).stop 2024-05-08T10:55:03.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.029+0000 7f49a40ea640 1 -- 172.21.15.33:0/3003419451 shutdown_connections 2024-05-08T10:55:03.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.029+0000 7f49a40ea640 1 --2- 172.21.15.33:0/3003419451 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f498006b5a0 0x7f498006da60 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:03.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.029+0000 7f49a40ea640 1 --2- 172.21.15.33:0/3003419451 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f499c0cfef0 0x7f499c140ac0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:03.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.029+0000 7f49a40ea640 1 --2- 172.21.15.33:0/3003419451 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f499c0b3690 0x7f499c13c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:03.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.030+0000 7f49a40ea640 1 --2- 172.21.15.33:0/3003419451 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f499c0b3230 0x7f499c13a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:03.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.030+0000 7f49a40ea640 1 -- 172.21.15.33:0/3003419451 >> 172.21.15.33:0/3003419451 conn(0x7f499c06afc0 msgr2=0x7f499c0d02d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:03.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.030+0000 7f49a40ea640 1 -- 172.21.15.33:0/3003419451 shutdown_connections 2024-05-08T10:55:03.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.030+0000 7f49a40ea640 1 -- 172.21.15.33:0/3003419451 wait complete. 2024-05-08T10:55:03.029 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.5 2024-05-08T10:55:03.029 DEBUG:teuthology.parallel:result is None 2024-05-08T10:55:03.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.032+0000 7f0cfb22c640 1 -- 172.21.15.33:0/679993142 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f0ce006b500 msgr2=0x7f0ce006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:03.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.032+0000 7f0cfb22c640 1 --2- 172.21.15.33:0/679993142 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f0ce006b500 0x7f0ce006d9c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0cf4156ac0 tx=0x7f0ce4008040 comp rx=0 tx=0).stop 2024-05-08T10:55:03.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.032+0000 7f0cfb22c640 1 -- 172.21.15.33:0/679993142 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0cdc003b70 msgr2=0x7f0cf413df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:03.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.032+0000 7f0cfb22c640 1 --2- 172.21.15.33:0/679993142 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0cdc003b70 0x7f0cf413df90 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0cec00a730 tx=0x7f0cf406d950 comp rx=0 tx=0).stop 2024-05-08T10:55:03.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.032+0000 7f0cfb22c640 1 -- 172.21.15.33:0/679993142 shutdown_connections 2024-05-08T10:55:03.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.032+0000 7f0cfb22c640 1 --2- 172.21.15.33:0/679993142 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f0ce006b500 0x7f0ce006d9c0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:03.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.032+0000 7f0cfb22c640 1 --2- 172.21.15.33:0/679993142 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0cf4157070 0x7f0cf415bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:03.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.032+0000 7f0cfb22c640 1 --2- 172.21.15.33:0/679993142 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0cf40b5430 0x7f0cf4156b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:03.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.032+0000 7f0cfb22c640 1 --2- 172.21.15.33:0/679993142 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0cdc003b70 0x7f0cf413df90 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:03.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.032+0000 7f0cfb22c640 1 -- 172.21.15.33:0/679993142 >> 172.21.15.33:0/679993142 conn(0x7f0cf406bcb0 msgr2=0x7f0cf41545a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:03.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.033+0000 7f0cfb22c640 1 -- 172.21.15.33:0/679993142 shutdown_connections 2024-05-08T10:55:03.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.033+0000 7f0cfb22c640 1 -- 172.21.15.33:0/679993142 wait complete. 2024-05-08T10:55:03.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.033+0000 7fe3a54c4640 1 -- 172.21.15.33:0/181962248 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fe380005580 con 0x7fe3a0162820 2024-05-08T10:55:03.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.033+0000 7fe3877fe640 1 -- 172.21.15.33:0/181962248 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe39805c050 con 0x7fe3a0162820 2024-05-08T10:55:03.032 INFO:teuthology.orchestra.run.smithi033.stdout:55834574856 2024-05-08T10:55:03.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.033+0000 7f91688ac640 1 -- 172.21.15.33:0/4241519536 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9164069d20 con 0x7f9164154c30 2024-05-08T10:55:03.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.034+0000 7f9152ffd640 1 -- 172.21.15.33:0/4241519536 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f915c0589a0 con 0x7f9164154c30 2024-05-08T10:55:03.032 INFO:teuthology.orchestra.run.smithi033.stdout:55834574857 2024-05-08T10:55:03.034 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.0 2024-05-08T10:55:03.034 DEBUG:teuthology.parallel:result is None 2024-05-08T10:55:03.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.036+0000 7f91688ac640 1 -- 172.21.15.33:0/4241519536 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f914406b500 msgr2=0x7f914406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:03.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.036+0000 7f91688ac640 1 --2- 172.21.15.33:0/4241519536 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f914406b500 0x7f914406d9c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f91540011e0 tx=0x7f9154009040 comp rx=0 tx=0).stop 2024-05-08T10:55:03.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.036+0000 7f91688ac640 1 -- 172.21.15.33:0/4241519536 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9164154c30 msgr2=0x7f9164156bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:03.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.036+0000 7f91688ac640 1 --2- 172.21.15.33:0/4241519536 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9164154c30 0x7f9164156bb0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f915c009f90 tx=0x7f915c00e570 comp rx=0 tx=0).stop 2024-05-08T10:55:03.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.036+0000 7fe3a54c4640 1 -- 172.21.15.33:0/181962248 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fe38c06b4d0 msgr2=0x7fe38c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:03.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.036+0000 7fe3a54c4640 1 --2- 172.21.15.33:0/181962248 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fe38c06b4d0 0x7fe38c06d990 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe390034000 tx=0x7fe39002e000 comp rx=0 tx=0).stop 2024-05-08T10:55:03.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.036+0000 7f91688ac640 1 -- 172.21.15.33:0/4241519536 shutdown_connections 2024-05-08T10:55:03.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.036+0000 7fe3a54c4640 1 -- 172.21.15.33:0/181962248 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3a0162820 msgr2=0x7fe3a00b1610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:03.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.036+0000 7fe3a54c4640 1 --2- 172.21.15.33:0/181962248 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3a0162820 0x7fe3a00b1610 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe39800cac0 tx=0x7fe39800cf80 comp rx=0 tx=0).stop 2024-05-08T10:55:03.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.036+0000 7f91688ac640 1 --2- 172.21.15.33:0/4241519536 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f914406b500 0x7f914406d9c0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:03.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.036+0000 7f91688ac640 1 --2- 172.21.15.33:0/4241519536 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9164154c30 0x7f9164156bb0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:03.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.036+0000 7f91688ac640 1 --2- 172.21.15.33:0/4241519536 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f916415dfe0 0x7f91641546f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:03.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.036+0000 7f91688ac640 1 --2- 172.21.15.33:0/4241519536 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f916415dc00 0x7f916414a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:03.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.036+0000 7f91688ac640 1 -- 172.21.15.33:0/4241519536 >> 172.21.15.33:0/4241519536 conn(0x7f916406bcb0 msgr2=0x7f91640b0680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:03.037 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.3 2024-05-08T10:55:03.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.037+0000 7fe3a54c4640 1 -- 172.21.15.33:0/181962248 shutdown_connections 2024-05-08T10:55:03.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.037+0000 7fe3a54c4640 1 --2- 172.21.15.33:0/181962248 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fe38c06b4d0 0x7fe38c06d990 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:03.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.037+0000 7fe3a54c4640 1 --2- 172.21.15.33:0/181962248 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3a0162820 0x7fe3a00b1610 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:03.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.037+0000 7fe3a54c4640 1 --2- 172.21.15.33:0/181962248 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe3a00cfd60 0x7fe3a0161140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:03.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.037+0000 7f91688ac640 1 -- 172.21.15.33:0/4241519536 shutdown_connections 2024-05-08T10:55:03.038 DEBUG:teuthology.parallel:result is None 2024-05-08T10:55:03.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.037+0000 7fe3a54c4640 1 --2- 172.21.15.33:0/181962248 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe3a00b2ff0 0x7fe3a02005f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:03.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.037+0000 7fe3a54c4640 1 -- 172.21.15.33:0/181962248 >> 172.21.15.33:0/181962248 conn(0x7fe3a006aba0 msgr2=0x7fe3a01583d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:03.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.037+0000 7f91688ac640 1 -- 172.21.15.33:0/4241519536 wait complete. 2024-05-08T10:55:03.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.037+0000 7fe3a54c4640 1 -- 172.21.15.33:0/181962248 shutdown_connections 2024-05-08T10:55:03.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.037+0000 7fe3a54c4640 1 -- 172.21.15.33:0/181962248 wait complete. 2024-05-08T10:55:03.043 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.7 2024-05-08T10:55:03.043 DEBUG:teuthology.parallel:result is None 2024-05-08T10:55:03.048 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.1 2024-05-08T10:55:03.048 DEBUG:teuthology.parallel:result is None 2024-05-08T10:55:03.049 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.6 2024-05-08T10:55:03.049 DEBUG:teuthology.parallel:result is None 2024-05-08T10:55:03.051 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.4 2024-05-08T10:55:03.051 DEBUG:teuthology.parallel:result is None 2024-05-08T10:55:03.051 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-08T10:55:03.052 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T10:55:03.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.198+0000 7f5ac1322640 1 Processor -- start 2024-05-08T10:55:03.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.199+0000 7f5ac1322640 1 -- start start 2024-05-08T10:55:03.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.199+0000 7f5ac1322640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f5abc0cc290 0x7f5abc15b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:03.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.199+0000 7f5ac1322640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5abc06d7d0 0x7f5abc06dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:03.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.199+0000 7f5ac1322640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f5abc15e520 0x7f5abc15e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:03.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.199+0000 7f5ac1322640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5abc06e170 con 0x7f5abc15e520 2024-05-08T10:55:03.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.199+0000 7f5ac1322640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5abc15bec0 con 0x7f5abc0cc290 2024-05-08T10:55:03.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.199+0000 7f5ac1322640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5abc0d0770 con 0x7f5abc06d7d0 2024-05-08T10:55:03.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.200+0000 7f5abb7fe640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f5abc15e520 0x7f5abc15e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:03.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.200+0000 7f5abb7fe640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f5abc15e520 0x7f5abc15e9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37914/0 (socket says 172.21.15.33:37914) 2024-05-08T10:55:03.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.200+0000 7f5abb7fe640 1 -- 172.21.15.33:0/2616628780 learned_addr learned my addr 172.21.15.33:0/2616628780 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:03.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.200+0000 7f5abaffd640 1 --2- 172.21.15.33:0/2616628780 >> v2:172.21.15.174:3300/0 conn(0x7f5abc0cc290 0x7f5abc15b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:03.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.200+0000 7f5aba7fc640 1 --2- 172.21.15.33:0/2616628780 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5abc06d7d0 0x7f5abc06dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:03.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.200+0000 7f5abb7fe640 1 -- 172.21.15.33:0/2616628780 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5abc06d7d0 msgr2=0x7f5abc06dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:03.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.200+0000 7f5abb7fe640 1 --2- 172.21.15.33:0/2616628780 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5abc06d7d0 0x7f5abc06dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:03.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.200+0000 7f5abb7fe640 1 -- 172.21.15.33:0/2616628780 >> v2:172.21.15.174:3300/0 conn(0x7f5abc0cc290 msgr2=0x7f5abc15b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:03.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.200+0000 7f5abb7fe640 1 --2- 172.21.15.33:0/2616628780 >> v2:172.21.15.174:3300/0 conn(0x7f5abc0cc290 0x7f5abc15b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:03.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.200+0000 7f5abb7fe640 1 -- 172.21.15.33:0/2616628780 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5abc0cfb60 con 0x7f5abc15e520 2024-05-08T10:55:03.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.201+0000 7f5abb7fe640 1 --2- 172.21.15.33:0/2616628780 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5abc15e520 0x7f5abc15e9b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5abc0d0a30 tx=0x7f5ab402a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85445ceb8151b2d1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:03.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.201+0000 7f5ab9ffb640 1 -- 172.21.15.33:0/2616628780 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ab4036070 con 0x7f5abc15e520 2024-05-08T10:55:03.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.201+0000 7f5ab9ffb640 1 -- 172.21.15.33:0/2616628780 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ab4031600 con 0x7f5abc15e520 2024-05-08T10:55:03.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.201+0000 7f5ab9ffb640 1 -- 172.21.15.33:0/2616628780 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ab40319d0 con 0x7f5abc15e520 2024-05-08T10:55:03.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.201+0000 7f5ac1322640 1 -- 172.21.15.33:0/2616628780 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5abc15e520 msgr2=0x7f5abc15e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:03.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.201+0000 7f5ac1322640 1 --2- 172.21.15.33:0/2616628780 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5abc15e520 0x7f5abc15e9b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5abc0d0a30 tx=0x7f5ab402a610 comp rx=0 tx=0).stop 2024-05-08T10:55:03.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.201+0000 7f5ac1322640 1 -- 172.21.15.33:0/2616628780 shutdown_connections 2024-05-08T10:55:03.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.201+0000 7f5ac1322640 1 --2- 172.21.15.33:0/2616628780 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5abc15e520 0x7f5abc15e9b0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:03.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.201+0000 7f5ac1322640 1 --2- 172.21.15.33:0/2616628780 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5abc06d7d0 0x7f5abc06dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:03.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.201+0000 7f5ac1322640 1 --2- 172.21.15.33:0/2616628780 >> v2:172.21.15.174:3300/0 conn(0x7f5abc0cc290 0x7f5abc15b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:03.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.201+0000 7f5ac1322640 1 -- 172.21.15.33:0/2616628780 >> 172.21.15.33:0/2616628780 conn(0x7f5abc06aba0 msgr2=0x7f5abc06afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:03.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.201+0000 7f5ac1322640 1 -- 172.21.15.33:0/2616628780 shutdown_connections 2024-05-08T10:55:03.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.201+0000 7f5ac1322640 1 -- 172.21.15.33:0/2616628780 wait complete. 2024-05-08T10:55:03.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.203+0000 7f5ac1322640 1 Processor -- start 2024-05-08T10:55:03.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.203+0000 7f5ac1322640 1 -- start start 2024-05-08T10:55:03.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.203+0000 7f5ac1322640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5abc06d7d0 0x7f5abc0b1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:03.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.203+0000 7f5ac1322640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5abc0cc290 0x7f5abc1423f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:03.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.204+0000 7f5ac1322640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5abc15e520 0x7f5abc142c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:03.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.204+0000 7f5ac1322640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5abc0d0400 con 0x7f5abc06d7d0 2024-05-08T10:55:03.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.204+0000 7f5ac1322640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5abc0d0120 con 0x7f5abc15e520 2024-05-08T10:55:03.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.204+0000 7f5ac1322640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5abc0b36b0 con 0x7f5abc0cc290 2024-05-08T10:55:03.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.204+0000 7f5abaffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5abc06d7d0 0x7f5abc0b1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:03.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.204+0000 7f5abaffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5abc06d7d0 0x7f5abc0b1e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37926/0 (socket says 172.21.15.33:37926) 2024-05-08T10:55:03.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.204+0000 7f5abaffd640 1 -- 172.21.15.33:0/139668422 learned_addr learned my addr 172.21.15.33:0/139668422 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:03.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.204+0000 7f5abb7fe640 1 --2- 172.21.15.33:0/139668422 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5abc15e520 0x7f5abc142c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:03.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.204+0000 7f5aba7fc640 1 --2- 172.21.15.33:0/139668422 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5abc0cc290 0x7f5abc1423f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:03.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.204+0000 7f5abaffd640 1 -- 172.21.15.33:0/139668422 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5abc0cc290 msgr2=0x7f5abc1423f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:03.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.204+0000 7f5abaffd640 1 --2- 172.21.15.33:0/139668422 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5abc0cc290 0x7f5abc1423f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:03.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.204+0000 7f5abaffd640 1 -- 172.21.15.33:0/139668422 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5abc15e520 msgr2=0x7f5abc142c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:03.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.204+0000 7f5abaffd640 1 --2- 172.21.15.33:0/139668422 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5abc15e520 0x7f5abc142c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:03.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.204+0000 7f5abaffd640 1 -- 172.21.15.33:0/139668422 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5abc142930 con 0x7f5abc06d7d0 2024-05-08T10:55:03.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.204+0000 7f5abb7fe640 1 --2- 172.21.15.33:0/139668422 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5abc15e520 0x7f5abc142c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:55:03.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.204+0000 7f5aba7fc640 1 --2- 172.21.15.33:0/139668422 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5abc0cc290 0x7f5abc1423f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:55:03.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.204+0000 7f5abaffd640 1 --2- 172.21.15.33:0/139668422 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5abc06d7d0 0x7f5abc0b1e20 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5aac00d800 tx=0x7f5aac00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:03.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.204+0000 7f5aa37fe640 1 -- 172.21.15.33:0/139668422 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aac00b6c0 con 0x7f5abc06d7d0 2024-05-08T10:55:03.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.204+0000 7f5aa37fe640 1 -- 172.21.15.33:0/139668422 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5aac019070 con 0x7f5abc06d7d0 2024-05-08T10:55:03.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.204+0000 7f5ac1322640 1 -- 172.21.15.33:0/139668422 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5abc0ad970 con 0x7f5abc06d7d0 2024-05-08T10:55:03.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.204+0000 7f5aa37fe640 1 -- 172.21.15.33:0/139668422 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aac00ba80 con 0x7f5abc06d7d0 2024-05-08T10:55:03.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.204+0000 7f5ac1322640 1 -- 172.21.15.33:0/139668422 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5abc0adf30 con 0x7f5abc06d7d0 2024-05-08T10:55:03.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.205+0000 7f5ac1322640 1 -- 172.21.15.33:0/139668422 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5abc069d20 con 0x7f5abc06d7d0 2024-05-08T10:55:03.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.206+0000 7f5aa37fe640 1 -- 172.21.15.33:0/139668422 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5aac00bc20 con 0x7f5abc06d7d0 2024-05-08T10:55:03.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.206+0000 7f5aa37fe640 1 --2- 172.21.15.33:0/139668422 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f5aa806b500 0x7f5aa806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:03.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.206+0000 7f5aa37fe640 1 -- 172.21.15.33:0/139668422 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5aac08a670 con 0x7f5abc06d7d0 2024-05-08T10:55:03.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.207+0000 7f5aba7fc640 1 --2- 172.21.15.33:0/139668422 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f5aa806b500 0x7f5aa806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:03.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.207+0000 7f5aba7fc640 1 --2- 172.21.15.33:0/139668422 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f5aa806b500 0x7f5aa806d9c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5abc15eaa0 tx=0x7f5ab0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:03.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.210+0000 7f5aa37fe640 1 -- 172.21.15.33:0/139668422 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5abc142930 con 0x7f5abc06d7d0 2024-05-08T10:55:03.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.386+0000 7f5ac1322640 1 -- 172.21.15.33:0/139668422 --> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5abc0707a0 con 0x7f5aa806b500 2024-05-08T10:55:03.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.393+0000 7f5aa37fe640 1 -- 172.21.15.33:0/139668422 <== mgr.4103 v2:172.21.15.174:6832/261355069 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251837 (secure 0 0 0) 0x7f5abc0707a0 con 0x7f5aa806b500 2024-05-08T10:55:03.393 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:55:03.394 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-05-08T10:55:03.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.395+0000 7f5ac1322640 1 -- 172.21.15.33:0/139668422 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f5aa806b500 msgr2=0x7f5aa806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:03.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.396+0000 7f5ac1322640 1 --2- 172.21.15.33:0/139668422 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f5aa806b500 0x7f5aa806d9c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5abc15eaa0 tx=0x7f5ab0008040 comp rx=0 tx=0).stop 2024-05-08T10:55:03.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.396+0000 7f5ac1322640 1 -- 172.21.15.33:0/139668422 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5abc06d7d0 msgr2=0x7f5abc0b1e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:03.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.396+0000 7f5ac1322640 1 --2- 172.21.15.33:0/139668422 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5abc06d7d0 0x7f5abc0b1e20 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5aac00d800 tx=0x7f5aac00dcc0 comp rx=0 tx=0).stop 2024-05-08T10:55:03.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.396+0000 7f5ac1322640 1 -- 172.21.15.33:0/139668422 shutdown_connections 2024-05-08T10:55:03.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.396+0000 7f5ac1322640 1 --2- 172.21.15.33:0/139668422 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f5aa806b500 0x7f5aa806d9c0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:03.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.396+0000 7f5ac1322640 1 --2- 172.21.15.33:0/139668422 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5abc15e520 0x7f5abc142c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:03.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.396+0000 7f5ac1322640 1 --2- 172.21.15.33:0/139668422 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5abc0cc290 0x7f5abc1423f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:03.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.396+0000 7f5ac1322640 1 --2- 172.21.15.33:0/139668422 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5abc06d7d0 0x7f5abc0b1e20 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:03.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.396+0000 7f5ac1322640 1 -- 172.21.15.33:0/139668422 >> 172.21.15.33:0/139668422 conn(0x7f5abc06aba0 msgr2=0x7f5abc071100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:03.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.396+0000 7f5ac1322640 1 -- 172.21.15.33:0/139668422 shutdown_connections 2024-05-08T10:55:03.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.396+0000 7f5ac1322640 1 -- 172.21.15.33:0/139668422 wait complete. 2024-05-08T10:55:03.404 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-05-08T10:55:02.947497+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218984,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755736,"statfs":{"total":773094113280,"available":772869873664,"internally_reserved":0,"allocated":2891776,"data_stored":1753028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.410179"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.624024+0000","last_change":"2024-05-08T10:54:50.544238+0000","last_active":"2024-05-08T10:54:51.624024+0000","last_peered":"2024-05-08T10:54:51.624024+0000","last_clean":"2024-05-08T10:54:51.624024+0000","last_became_active":"2024-05-08T10:54:50.543590+0000","last_became_peered":"2024-05-08T10:54:50.543590+0000","last_unstale":"2024-05-08T10:54:51.624024+0000","last_undegraded":"2024-05-08T10:54:51.624024+0000","last_fullsized":"2024-05-08T10:54:51.624024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:17:53.754154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.537034+0000","last_change":"2024-05-08T10:54:50.544605+0000","last_active":"2024-05-08T10:54:51.537034+0000","last_peered":"2024-05-08T10:54:51.537034+0000","last_clean":"2024-05-08T10:54:51.537034+0000","last_became_active":"2024-05-08T10:54:50.543971+0000","last_became_peered":"2024-05-08T10:54:50.543971+0000","last_unstale":"2024-05-08T10:54:51.537034+0000","last_undegraded":"2024-05-08T10:54:51.537034+0000","last_fullsized":"2024-05-08T10:54:51.537034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:17:39.617660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272018+0000","last_change":"2024-05-08T10:54:50.541546+0000","last_active":"2024-05-08T10:54:53.272018+0000","last_peered":"2024-05-08T10:54:53.272018+0000","last_clean":"2024-05-08T10:54:53.272018+0000","last_became_active":"2024-05-08T10:54:50.540512+0000","last_became_peered":"2024-05-08T10:54:50.540512+0000","last_unstale":"2024-05-08T10:54:53.272018+0000","last_undegraded":"2024-05-08T10:54:53.272018+0000","last_fullsized":"2024-05-08T10:54:53.272018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:06:27.967756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272230+0000","last_change":"2024-05-08T10:54:50.550769+0000","last_active":"2024-05-08T10:54:53.272230+0000","last_peered":"2024-05-08T10:54:53.272230+0000","last_clean":"2024-05-08T10:54:53.272230+0000","last_became_active":"2024-05-08T10:54:50.550414+0000","last_became_peered":"2024-05-08T10:54:50.550414+0000","last_unstale":"2024-05-08T10:54:53.272230+0000","last_undegraded":"2024-05-08T10:54:53.272230+0000","last_fullsized":"2024-05-08T10:54:53.272230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:34:17.184122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.623876+0000","last_change":"2024-05-08T10:54:50.540125+0000","last_active":"2024-05-08T10:54:51.623876+0000","last_peered":"2024-05-08T10:54:51.623876+0000","last_clean":"2024-05-08T10:54:51.623876+0000","last_became_active":"2024-05-08T10:54:50.539796+0000","last_became_peered":"2024-05-08T10:54:50.539796+0000","last_unstale":"2024-05-08T10:54:51.623876+0000","last_undegraded":"2024-05-08T10:54:51.623876+0000","last_fullsized":"2024-05-08T10:54:51.623876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:28:49.416807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272082+0000","last_change":"2024-05-08T10:54:50.550911+0000","last_active":"2024-05-08T10:54:53.272082+0000","last_peered":"2024-05-08T10:54:53.272082+0000","last_clean":"2024-05-08T10:54:53.272082+0000","last_became_active":"2024-05-08T10:54:50.550594+0000","last_became_peered":"2024-05-08T10:54:50.550594+0000","last_unstale":"2024-05-08T10:54:53.272082+0000","last_undegraded":"2024-05-08T10:54:53.272082+0000","last_fullsized":"2024-05-08T10:54:53.272082+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:27:46.730550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.623675+0000","last_change":"2024-05-08T10:54:50.547034+0000","last_active":"2024-05-08T10:54:51.623675+0000","last_peered":"2024-05-08T10:54:51.623675+0000","last_clean":"2024-05-08T10:54:51.623675+0000","last_became_active":"2024-05-08T10:54:50.546680+0000","last_became_peered":"2024-05-08T10:54:50.546680+0000","last_unstale":"2024-05-08T10:54:51.623675+0000","last_undegraded":"2024-05-08T10:54:51.623675+0000","last_fullsized":"2024-05-08T10:54:51.623675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:14:08.876280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.271747+0000","last_change":"2024-05-08T10:54:50.553200+0000","last_active":"2024-05-08T10:54:53.271747+0000","last_peered":"2024-05-08T10:54:53.271747+0000","last_clean":"2024-05-08T10:54:53.271747+0000","last_became_active":"2024-05-08T10:54:50.552845+0000","last_became_peered":"2024-05-08T10:54:50.552845+0000","last_unstale":"2024-05-08T10:54:53.271747+0000","last_undegraded":"2024-05-08T10:54:53.271747+0000","last_fullsized":"2024-05-08T10:54:53.271747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:46:10.084159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.624104+0000","last_change":"2024-05-08T10:54:50.542398+0000","last_active":"2024-05-08T10:54:51.624104+0000","last_peered":"2024-05-08T10:54:51.624104+0000","last_clean":"2024-05-08T10:54:51.624104+0000","last_became_active":"2024-05-08T10:54:50.542014+0000","last_became_peered":"2024-05-08T10:54:50.542014+0000","last_unstale":"2024-05-08T10:54:51.624104+0000","last_undegraded":"2024-05-08T10:54:51.624104+0000","last_fullsized":"2024-05-08T10:54:51.624104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:36:31.739083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.539523+0000","last_change":"2024-05-08T10:54:50.542033+0000","last_active":"2024-05-08T10:54:51.539523+0000","last_peered":"2024-05-08T10:54:51.539523+0000","last_clean":"2024-05-08T10:54:51.539523+0000","last_became_active":"2024-05-08T10:54:50.541776+0000","last_became_peered":"2024-05-08T10:54:50.541776+0000","last_unstale":"2024-05-08T10:54:51.539523+0000","last_undegraded":"2024-05-08T10:54:51.539523+0000","last_fullsized":"2024-05-08T10:54:51.539523+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:17:39.617660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.538877+0000","last_change":"2024-05-08T10:54:50.541380+0000","last_active":"2024-05-08T10:54:51.538877+0000","last_peered":"2024-05-08T10:54:51.538877+0000","last_clean":"2024-05-08T10:54:51.538877+0000","last_became_active":"2024-05-08T10:54:50.540999+0000","last_became_peered":"2024-05-08T10:54:50.540999+0000","last_unstale":"2024-05-08T10:54:51.538877+0000","last_undegraded":"2024-05-08T10:54:51.538877+0000","last_fullsized":"2024-05-08T10:54:51.538877+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:12:04.365598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.539267+0000","last_change":"2024-05-08T10:54:50.536612+0000","last_active":"2024-05-08T10:54:51.539267+0000","last_peered":"2024-05-08T10:54:51.539267+0000","last_clean":"2024-05-08T10:54:51.539267+0000","last_became_active":"2024-05-08T10:54:50.536347+0000","last_became_peered":"2024-05-08T10:54:50.536347+0000","last_unstale":"2024-05-08T10:54:51.539267+0000","last_undegraded":"2024-05-08T10:54:51.539267+0000","last_fullsized":"2024-05-08T10:54:51.539267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:00:53.753820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272252+0000","last_change":"2024-05-08T10:54:50.542352+0000","last_active":"2024-05-08T10:54:53.272252+0000","last_peered":"2024-05-08T10:54:53.272252+0000","last_clean":"2024-05-08T10:54:53.272252+0000","last_became_active":"2024-05-08T10:54:50.542056+0000","last_became_peered":"2024-05-08T10:54:50.542056+0000","last_unstale":"2024-05-08T10:54:53.272252+0000","last_undegraded":"2024-05-08T10:54:53.272252+0000","last_fullsized":"2024-05-08T10:54:53.272252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:43:52.788984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.271763+0000","last_change":"2024-05-08T10:54:50.540420+0000","last_active":"2024-05-08T10:54:53.271763+0000","last_peered":"2024-05-08T10:54:53.271763+0000","last_clean":"2024-05-08T10:54:53.271763+0000","last_became_active":"2024-05-08T10:54:50.540073+0000","last_became_peered":"2024-05-08T10:54:50.540073+0000","last_unstale":"2024-05-08T10:54:53.271763+0000","last_undegraded":"2024-05-08T10:54:53.271763+0000","last_fullsized":"2024-05-08T10:54:53.271763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:44:24.261973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.536636+0000","last_change":"2024-05-08T10:54:50.531957+0000","last_active":"2024-05-08T10:54:51.536636+0000","last_peered":"2024-05-08T10:54:51.536636+0000","last_clean":"2024-05-08T10:54:51.536636+0000","last_became_active":"2024-05-08T10:54:50.531646+0000","last_became_peered":"2024-05-08T10:54:50.531646+0000","last_unstale":"2024-05-08T10:54:51.536636+0000","last_undegraded":"2024-05-08T10:54:51.536636+0000","last_fullsized":"2024-05-08T10:54:51.536636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:06:27.967756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272153+0000","last_change":"2024-05-08T10:54:50.545714+0000","last_active":"2024-05-08T10:54:53.272153+0000","last_peered":"2024-05-08T10:54:53.272153+0000","last_clean":"2024-05-08T10:54:53.272153+0000","last_became_active":"2024-05-08T10:54:50.545415+0000","last_became_peered":"2024-05-08T10:54:50.545415+0000","last_unstale":"2024-05-08T10:54:53.272153+0000","last_undegraded":"2024-05-08T10:54:53.272153+0000","last_fullsized":"2024-05-08T10:54:53.272153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:40:14.037116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272642+0000","last_change":"2024-05-08T10:54:50.543717+0000","last_active":"2024-05-08T10:54:53.272642+0000","last_peered":"2024-05-08T10:54:53.272642+0000","last_clean":"2024-05-08T10:54:53.272642+0000","last_became_active":"2024-05-08T10:54:50.543465+0000","last_became_peered":"2024-05-08T10:54:50.543465+0000","last_unstale":"2024-05-08T10:54:53.272642+0000","last_undegraded":"2024-05-08T10:54:53.272642+0000","last_fullsized":"2024-05-08T10:54:53.272642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:17:53.754154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:52.206333+0000","last_change":"2024-05-08T10:54:50.535283+0000","last_active":"2024-05-08T10:54:52.206333+0000","last_peered":"2024-05-08T10:54:52.206333+0000","last_clean":"2024-05-08T10:54:52.206333+0000","last_became_active":"2024-05-08T10:54:50.534933+0000","last_became_peered":"2024-05-08T10:54:50.534933+0000","last_unstale":"2024-05-08T10:54:52.206333+0000","last_undegraded":"2024-05-08T10:54:52.206333+0000","last_fullsized":"2024-05-08T10:54:52.206333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:06.987968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.624055+0000","last_change":"2024-05-08T10:54:50.545460+0000","last_active":"2024-05-08T10:54:51.624055+0000","last_peered":"2024-05-08T10:54:51.624055+0000","last_clean":"2024-05-08T10:54:51.624055+0000","last_became_active":"2024-05-08T10:54:50.545182+0000","last_became_peered":"2024-05-08T10:54:50.545182+0000","last_unstale":"2024-05-08T10:54:51.624055+0000","last_undegraded":"2024-05-08T10:54:51.624055+0000","last_fullsized":"2024-05-08T10:54:51.624055+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:35:53.604235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.539432+0000","last_change":"2024-05-08T10:54:50.534702+0000","last_active":"2024-05-08T10:54:51.539432+0000","last_peered":"2024-05-08T10:54:51.539432+0000","last_clean":"2024-05-08T10:54:51.539432+0000","last_became_active":"2024-05-08T10:54:50.534424+0000","last_became_peered":"2024-05-08T10:54:50.534424+0000","last_unstale":"2024-05-08T10:54:51.539432+0000","last_undegraded":"2024-05-08T10:54:51.539432+0000","last_fullsized":"2024-05-08T10:54:51.539432+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:27:46.730550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.271871+0000","last_change":"2024-05-08T10:54:50.542206+0000","last_active":"2024-05-08T10:54:53.271871+0000","last_peered":"2024-05-08T10:54:53.271871+0000","last_clean":"2024-05-08T10:54:53.271871+0000","last_became_active":"2024-05-08T10:54:50.540272+0000","last_became_peered":"2024-05-08T10:54:50.540272+0000","last_unstale":"2024-05-08T10:54:53.271871+0000","last_undegraded":"2024-05-08T10:54:53.271871+0000","last_fullsized":"2024-05-08T10:54:53.271871+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:45:53.748139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272432+0000","last_change":"2024-05-08T10:54:50.546452+0000","last_active":"2024-05-08T10:54:53.272432+0000","last_peered":"2024-05-08T10:54:53.272432+0000","last_clean":"2024-05-08T10:54:53.272432+0000","last_became_active":"2024-05-08T10:54:50.546143+0000","last_became_peered":"2024-05-08T10:54:50.546143+0000","last_unstale":"2024-05-08T10:54:53.272432+0000","last_undegraded":"2024-05-08T10:54:53.272432+0000","last_fullsized":"2024-05-08T10:54:53.272432+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:50:37.863580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.271957+0000","last_change":"2024-05-08T10:54:50.547750+0000","last_active":"2024-05-08T10:54:53.271957+0000","last_peered":"2024-05-08T10:54:53.271957+0000","last_clean":"2024-05-08T10:54:53.271957+0000","last_became_active":"2024-05-08T10:54:50.547492+0000","last_became_peered":"2024-05-08T10:54:50.547492+0000","last_unstale":"2024-05-08T10:54:53.271957+0000","last_undegraded":"2024-05-08T10:54:53.271957+0000","last_fullsized":"2024-05-08T10:54:53.271957+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:06:27.967756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272070+0000","last_change":"2024-05-08T10:54:50.547741+0000","last_active":"2024-05-08T10:54:53.272070+0000","last_peered":"2024-05-08T10:54:53.272070+0000","last_clean":"2024-05-08T10:54:53.272070+0000","last_became_active":"2024-05-08T10:54:50.547475+0000","last_became_peered":"2024-05-08T10:54:50.547475+0000","last_unstale":"2024-05-08T10:54:53.272070+0000","last_undegraded":"2024-05-08T10:54:53.272070+0000","last_fullsized":"2024-05-08T10:54:53.272070+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:17:39.617660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272323+0000","last_change":"2024-05-08T10:54:50.546236+0000","last_active":"2024-05-08T10:54:53.272323+0000","last_peered":"2024-05-08T10:54:53.272323+0000","last_clean":"2024-05-08T10:54:53.272323+0000","last_became_active":"2024-05-08T10:54:50.545968+0000","last_became_peered":"2024-05-08T10:54:50.545968+0000","last_unstale":"2024-05-08T10:54:53.272323+0000","last_undegraded":"2024-05-08T10:54:53.272323+0000","last_fullsized":"2024-05-08T10:54:53.272323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:17:39.617660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.539559+0000","last_change":"2024-05-08T10:54:50.532358+0000","last_active":"2024-05-08T10:54:51.539559+0000","last_peered":"2024-05-08T10:54:51.539559+0000","last_clean":"2024-05-08T10:54:51.539559+0000","last_became_active":"2024-05-08T10:54:50.532084+0000","last_became_peered":"2024-05-08T10:54:50.532084+0000","last_unstale":"2024-05-08T10:54:51.539559+0000","last_undegraded":"2024-05-08T10:54:51.539559+0000","last_fullsized":"2024-05-08T10:54:51.539559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:40:14.037116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.536825+0000","last_change":"2024-05-08T10:54:50.542677+0000","last_active":"2024-05-08T10:54:51.536825+0000","last_peered":"2024-05-08T10:54:51.536825+0000","last_clean":"2024-05-08T10:54:51.536825+0000","last_became_active":"2024-05-08T10:54:50.542364+0000","last_became_peered":"2024-05-08T10:54:50.542364+0000","last_unstale":"2024-05-08T10:54:51.536825+0000","last_undegraded":"2024-05-08T10:54:51.536825+0000","last_fullsized":"2024-05-08T10:54:51.536825+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:27:46.730550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272321+0000","last_change":"2024-05-08T10:54:50.546906+0000","last_active":"2024-05-08T10:54:53.272321+0000","last_peered":"2024-05-08T10:54:53.272321+0000","last_clean":"2024-05-08T10:54:53.272321+0000","last_became_active":"2024-05-08T10:54:50.546627+0000","last_became_peered":"2024-05-08T10:54:50.546627+0000","last_unstale":"2024-05-08T10:54:53.272321+0000","last_undegraded":"2024-05-08T10:54:53.272321+0000","last_fullsized":"2024-05-08T10:54:53.272321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:27:46.730550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.271948+0000","last_change":"2024-05-08T10:54:50.552062+0000","last_active":"2024-05-08T10:54:53.271948+0000","last_peered":"2024-05-08T10:54:53.271948+0000","last_clean":"2024-05-08T10:54:53.271948+0000","last_became_active":"2024-05-08T10:54:50.550966+0000","last_became_peered":"2024-05-08T10:54:50.550966+0000","last_unstale":"2024-05-08T10:54:53.271948+0000","last_undegraded":"2024-05-08T10:54:53.271948+0000","last_fullsized":"2024-05-08T10:54:53.271948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:07:03.513132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272358+0000","last_change":"2024-05-08T10:54:50.550884+0000","last_active":"2024-05-08T10:54:53.272358+0000","last_peered":"2024-05-08T10:54:53.272358+0000","last_clean":"2024-05-08T10:54:53.272358+0000","last_became_active":"2024-05-08T10:54:50.550437+0000","last_became_peered":"2024-05-08T10:54:50.550437+0000","last_unstale":"2024-05-08T10:54:53.272358+0000","last_undegraded":"2024-05-08T10:54:53.272358+0000","last_fullsized":"2024-05-08T10:54:53.272358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:14:08.876280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:52.206355+0000","last_change":"2024-05-08T10:54:50.537512+0000","last_active":"2024-05-08T10:54:52.206355+0000","last_peered":"2024-05-08T10:54:52.206355+0000","last_clean":"2024-05-08T10:54:52.206355+0000","last_became_active":"2024-05-08T10:54:50.537214+0000","last_became_peered":"2024-05-08T10:54:50.537214+0000","last_unstale":"2024-05-08T10:54:52.206355+0000","last_undegraded":"2024-05-08T10:54:52.206355+0000","last_fullsized":"2024-05-08T10:54:52.206355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:31:55.776210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.538582+0000","last_change":"2024-05-08T10:54:50.544340+0000","last_active":"2024-05-08T10:54:51.538582+0000","last_peered":"2024-05-08T10:54:51.538582+0000","last_clean":"2024-05-08T10:54:51.538582+0000","last_became_active":"2024-05-08T10:54:50.544072+0000","last_became_peered":"2024-05-08T10:54:50.544072+0000","last_unstale":"2024-05-08T10:54:51.538582+0000","last_undegraded":"2024-05-08T10:54:51.538582+0000","last_fullsized":"2024-05-08T10:54:51.538582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:07:03.513132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.539220+0000","last_change":"2024-05-08T10:54:50.532176+0000","last_active":"2024-05-08T10:54:51.539220+0000","last_peered":"2024-05-08T10:54:51.539220+0000","last_clean":"2024-05-08T10:54:51.539220+0000","last_became_active":"2024-05-08T10:54:50.531846+0000","last_became_peered":"2024-05-08T10:54:50.531846+0000","last_unstale":"2024-05-08T10:54:51.539220+0000","last_undegraded":"2024-05-08T10:54:51.539220+0000","last_fullsized":"2024-05-08T10:54:51.539220+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:07:13.589112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272439+0000","last_change":"2024-05-08T10:54:49.539056+0000","last_active":"2024-05-08T10:54:53.272439+0000","last_peered":"2024-05-08T10:54:53.272439+0000","last_clean":"2024-05-08T10:54:53.272439+0000","last_became_active":"2024-05-08T10:54:49.538788+0000","last_became_peered":"2024-05-08T10:54:49.538788+0000","last_unstale":"2024-05-08T10:54:53.272439+0000","last_undegraded":"2024-05-08T10:54:53.272439+0000","last_fullsized":"2024-05-08T10:54:53.272439+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:21:53.697233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272029+0000","last_change":"2024-05-08T10:54:50.536315+0000","last_active":"2024-05-08T10:54:53.272029+0000","last_peered":"2024-05-08T10:54:53.272029+0000","last_clean":"2024-05-08T10:54:53.272029+0000","last_became_active":"2024-05-08T10:54:50.536003+0000","last_became_peered":"2024-05-08T10:54:50.536003+0000","last_unstale":"2024-05-08T10:54:53.272029+0000","last_undegraded":"2024-05-08T10:54:53.272029+0000","last_fullsized":"2024-05-08T10:54:53.272029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:12:04.365598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.539075+0000","last_change":"2024-05-08T10:54:49.530966+0000","last_active":"2024-05-08T10:54:51.539075+0000","last_peered":"2024-05-08T10:54:51.539075+0000","last_clean":"2024-05-08T10:54:51.539075+0000","last_became_active":"2024-05-08T10:54:49.530656+0000","last_became_peered":"2024-05-08T10:54:49.530656+0000","last_unstale":"2024-05-08T10:54:51.539075+0000","last_undegraded":"2024-05-08T10:54:51.539075+0000","last_fullsized":"2024-05-08T10:54:51.539075+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:00:52.746134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272492+0000","last_change":"2024-05-08T10:54:49.536057+0000","last_active":"2024-05-08T10:54:53.272492+0000","last_peered":"2024-05-08T10:54:53.272492+0000","last_clean":"2024-05-08T10:54:53.272492+0000","last_became_active":"2024-05-08T10:54:49.535697+0000","last_became_peered":"2024-05-08T10:54:49.535697+0000","last_unstale":"2024-05-08T10:54:53.272492+0000","last_undegraded":"2024-05-08T10:54:53.272492+0000","last_fullsized":"2024-05-08T10:54:53.272492+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:50:17.425844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.271904+0000","last_change":"2024-05-08T10:54:50.551282+0000","last_active":"2024-05-08T10:54:53.271904+0000","last_peered":"2024-05-08T10:54:53.271904+0000","last_clean":"2024-05-08T10:54:53.271904+0000","last_became_active":"2024-05-08T10:54:50.550992+0000","last_became_peered":"2024-05-08T10:54:50.550992+0000","last_unstale":"2024-05-08T10:54:53.271904+0000","last_undegraded":"2024-05-08T10:54:53.271904+0000","last_fullsized":"2024-05-08T10:54:53.271904+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:07:03.513132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272265+0000","last_change":"2024-05-08T10:54:49.533211+0000","last_active":"2024-05-08T10:54:53.272265+0000","last_peered":"2024-05-08T10:54:53.272265+0000","last_clean":"2024-05-08T10:54:53.272265+0000","last_became_active":"2024-05-08T10:54:49.532870+0000","last_became_peered":"2024-05-08T10:54:49.532870+0000","last_unstale":"2024-05-08T10:54:53.272265+0000","last_undegraded":"2024-05-08T10:54:53.272265+0000","last_fullsized":"2024-05-08T10:54:53.272265+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:04:27.826613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.536597+0000","last_change":"2024-05-08T10:54:50.549669+0000","last_active":"2024-05-08T10:54:51.536597+0000","last_peered":"2024-05-08T10:54:51.536597+0000","last_clean":"2024-05-08T10:54:51.536597+0000","last_became_active":"2024-05-08T10:54:50.549148+0000","last_became_peered":"2024-05-08T10:54:50.549148+0000","last_unstale":"2024-05-08T10:54:51.536597+0000","last_undegraded":"2024-05-08T10:54:51.536597+0000","last_fullsized":"2024-05-08T10:54:51.536597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:07:03.513132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.538726+0000","last_change":"2024-05-08T10:54:49.534750+0000","last_active":"2024-05-08T10:54:51.538726+0000","last_peered":"2024-05-08T10:54:51.538726+0000","last_clean":"2024-05-08T10:54:51.538726+0000","last_became_active":"2024-05-08T10:54:49.534448+0000","last_became_peered":"2024-05-08T10:54:49.534448+0000","last_unstale":"2024-05-08T10:54:51.538726+0000","last_undegraded":"2024-05-08T10:54:51.538726+0000","last_fullsized":"2024-05-08T10:54:51.538726+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:35:21.510783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272387+0000","last_change":"2024-05-08T10:54:50.542813+0000","last_active":"2024-05-08T10:54:53.272387+0000","last_peered":"2024-05-08T10:54:53.272387+0000","last_clean":"2024-05-08T10:54:53.272387+0000","last_became_active":"2024-05-08T10:54:50.542521+0000","last_became_peered":"2024-05-08T10:54:50.542521+0000","last_unstale":"2024-05-08T10:54:53.272387+0000","last_undegraded":"2024-05-08T10:54:53.272387+0000","last_fullsized":"2024-05-08T10:54:53.272387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:20:08.620180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272450+0000","last_change":"2024-05-08T10:54:49.534807+0000","last_active":"2024-05-08T10:54:53.272450+0000","last_peered":"2024-05-08T10:54:53.272450+0000","last_clean":"2024-05-08T10:54:53.272450+0000","last_became_active":"2024-05-08T10:54:49.534525+0000","last_became_peered":"2024-05-08T10:54:49.534525+0000","last_unstale":"2024-05-08T10:54:53.272450+0000","last_undegraded":"2024-05-08T10:54:53.272450+0000","last_fullsized":"2024-05-08T10:54:53.272450+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:07:12.581426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272500+0000","last_change":"2024-05-08T10:54:50.549738+0000","last_active":"2024-05-08T10:54:53.272500+0000","last_peered":"2024-05-08T10:54:53.272500+0000","last_clean":"2024-05-08T10:54:53.272500+0000","last_became_active":"2024-05-08T10:54:50.548425+0000","last_became_peered":"2024-05-08T10:54:50.548425+0000","last_unstale":"2024-05-08T10:54:53.272500+0000","last_undegraded":"2024-05-08T10:54:53.272500+0000","last_fullsized":"2024-05-08T10:54:53.272500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:17:39.617660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.536748+0000","last_change":"2024-05-08T10:54:49.540157+0000","last_active":"2024-05-08T10:54:51.536748+0000","last_peered":"2024-05-08T10:54:51.536748+0000","last_clean":"2024-05-08T10:54:51.536748+0000","last_became_active":"2024-05-08T10:54:49.539852+0000","last_became_peered":"2024-05-08T10:54:49.539852+0000","last_unstale":"2024-05-08T10:54:51.536748+0000","last_undegraded":"2024-05-08T10:54:51.536748+0000","last_fullsized":"2024-05-08T10:54:51.536748+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:00:52.746134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.539495+0000","last_change":"2024-05-08T10:54:50.534438+0000","last_active":"2024-05-08T10:54:51.539495+0000","last_peered":"2024-05-08T10:54:51.539495+0000","last_clean":"2024-05-08T10:54:51.539495+0000","last_became_active":"2024-05-08T10:54:50.533971+0000","last_became_peered":"2024-05-08T10:54:50.533971+0000","last_unstale":"2024-05-08T10:54:51.539495+0000","last_undegraded":"2024-05-08T10:54:51.539495+0000","last_fullsized":"2024-05-08T10:54:51.539495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:06.987968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.539367+0000","last_change":"2024-05-08T10:54:49.531309+0000","last_active":"2024-05-08T10:54:51.539367+0000","last_peered":"2024-05-08T10:54:51.539367+0000","last_clean":"2024-05-08T10:54:51.539367+0000","last_became_active":"2024-05-08T10:54:49.530442+0000","last_became_peered":"2024-05-08T10:54:49.530442+0000","last_unstale":"2024-05-08T10:54:51.539367+0000","last_undegraded":"2024-05-08T10:54:51.539367+0000","last_fullsized":"2024-05-08T10:54:51.539367+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:07:12.581426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.623854+0000","last_change":"2024-05-08T10:54:50.549577+0000","last_active":"2024-05-08T10:54:51.623854+0000","last_peered":"2024-05-08T10:54:51.623854+0000","last_clean":"2024-05-08T10:54:51.623854+0000","last_became_active":"2024-05-08T10:54:50.549318+0000","last_became_peered":"2024-05-08T10:54:50.549318+0000","last_unstale":"2024-05-08T10:54:51.623854+0000","last_undegraded":"2024-05-08T10:54:51.623854+0000","last_fullsized":"2024-05-08T10:54:51.623854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:50:37.863580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272014+0000","last_change":"2024-05-08T10:54:49.534151+0000","last_active":"2024-05-08T10:54:53.272014+0000","last_peered":"2024-05-08T10:54:53.272014+0000","last_clean":"2024-05-08T10:54:53.272014+0000","last_became_active":"2024-05-08T10:54:49.533841+0000","last_became_peered":"2024-05-08T10:54:49.533841+0000","last_unstale":"2024-05-08T10:54:53.272014+0000","last_undegraded":"2024-05-08T10:54:53.272014+0000","last_fullsized":"2024-05-08T10:54:53.272014+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:43:52.839891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.271941+0000","last_change":"2024-05-08T10:54:50.539238+0000","last_active":"2024-05-08T10:54:53.271941+0000","last_peered":"2024-05-08T10:54:53.271941+0000","last_clean":"2024-05-08T10:54:53.271941+0000","last_became_active":"2024-05-08T10:54:50.538930+0000","last_became_peered":"2024-05-08T10:54:50.538930+0000","last_unstale":"2024-05-08T10:54:53.271941+0000","last_undegraded":"2024-05-08T10:54:53.271941+0000","last_fullsized":"2024-05-08T10:54:53.271941+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:46:10.084159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272450+0000","last_change":"2024-05-08T10:54:49.537048+0000","last_active":"2024-05-08T10:54:53.272450+0000","last_peered":"2024-05-08T10:54:53.272450+0000","last_clean":"2024-05-08T10:54:53.272450+0000","last_became_active":"2024-05-08T10:54:49.536620+0000","last_became_peered":"2024-05-08T10:54:49.536620+0000","last_unstale":"2024-05-08T10:54:53.272450+0000","last_undegraded":"2024-05-08T10:54:53.272450+0000","last_fullsized":"2024-05-08T10:54:53.272450+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:35:21.510783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.623897+0000","last_change":"2024-05-08T10:54:50.545019+0000","last_active":"2024-05-08T10:54:51.623897+0000","last_peered":"2024-05-08T10:54:51.623897+0000","last_clean":"2024-05-08T10:54:51.623897+0000","last_became_active":"2024-05-08T10:54:50.544710+0000","last_became_peered":"2024-05-08T10:54:50.544710+0000","last_unstale":"2024-05-08T10:54:51.623897+0000","last_undegraded":"2024-05-08T10:54:51.623897+0000","last_fullsized":"2024-05-08T10:54:51.623897+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:08:48.409546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.538557+0000","last_change":"2024-05-08T10:54:49.531681+0000","last_active":"2024-05-08T10:54:51.538557+0000","last_peered":"2024-05-08T10:54:51.538557+0000","last_clean":"2024-05-08T10:54:51.538557+0000","last_became_active":"2024-05-08T10:54:49.531120+0000","last_became_peered":"2024-05-08T10:54:49.531120+0000","last_unstale":"2024-05-08T10:54:51.538557+0000","last_undegraded":"2024-05-08T10:54:51.538557+0000","last_fullsized":"2024-05-08T10:54:51.538557+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:41:42.237766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.538783+0000","last_change":"2024-05-08T10:54:50.544975+0000","last_active":"2024-05-08T10:54:51.538783+0000","last_peered":"2024-05-08T10:54:51.538783+0000","last_clean":"2024-05-08T10:54:51.538783+0000","last_became_active":"2024-05-08T10:54:50.544731+0000","last_became_peered":"2024-05-08T10:54:50.544731+0000","last_unstale":"2024-05-08T10:54:51.538783+0000","last_undegraded":"2024-05-08T10:54:51.538783+0000","last_fullsized":"2024-05-08T10:54:51.538783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:06:27.967756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:52.206041+0000","last_change":"2024-05-08T10:54:49.531598+0000","last_active":"2024-05-08T10:54:52.206041+0000","last_peered":"2024-05-08T10:54:52.206041+0000","last_clean":"2024-05-08T10:54:52.206041+0000","last_became_active":"2024-05-08T10:54:49.531288+0000","last_became_peered":"2024-05-08T10:54:49.531288+0000","last_unstale":"2024-05-08T10:54:52.206041+0000","last_undegraded":"2024-05-08T10:54:52.206041+0000","last_fullsized":"2024-05-08T10:54:52.206041+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:04:27.826613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.623671+0000","last_change":"2024-05-08T10:54:50.543982+0000","last_active":"2024-05-08T10:54:51.623671+0000","last_peered":"2024-05-08T10:54:51.623671+0000","last_clean":"2024-05-08T10:54:51.623671+0000","last_became_active":"2024-05-08T10:54:50.543721+0000","last_became_peered":"2024-05-08T10:54:50.543721+0000","last_unstale":"2024-05-08T10:54:51.623671+0000","last_undegraded":"2024-05-08T10:54:51.623671+0000","last_fullsized":"2024-05-08T10:54:51.623671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:34:17.184122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.538712+0000","last_change":"2024-05-08T10:54:49.535555+0000","last_active":"2024-05-08T10:54:51.538712+0000","last_peered":"2024-05-08T10:54:51.538712+0000","last_clean":"2024-05-08T10:54:51.538712+0000","last_became_active":"2024-05-08T10:54:49.535171+0000","last_became_peered":"2024-05-08T10:54:49.535171+0000","last_unstale":"2024-05-08T10:54:51.538712+0000","last_undegraded":"2024-05-08T10:54:51.538712+0000","last_fullsized":"2024-05-08T10:54:51.538712+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:45:13.454727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.623934+0000","last_change":"2024-05-08T10:54:50.547853+0000","last_active":"2024-05-08T10:54:51.623934+0000","last_peered":"2024-05-08T10:54:51.623934+0000","last_clean":"2024-05-08T10:54:51.623934+0000","last_became_active":"2024-05-08T10:54:50.547647+0000","last_became_peered":"2024-05-08T10:54:50.547647+0000","last_unstale":"2024-05-08T10:54:51.623934+0000","last_undegraded":"2024-05-08T10:54:51.623934+0000","last_fullsized":"2024-05-08T10:54:51.623934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:41:02.815763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:52.206276+0000","last_change":"2024-05-08T10:54:49.528935+0000","last_active":"2024-05-08T10:54:52.206276+0000","last_peered":"2024-05-08T10:54:52.206276+0000","last_clean":"2024-05-08T10:54:52.206276+0000","last_became_active":"2024-05-08T10:54:49.528373+0000","last_became_peered":"2024-05-08T10:54:49.528373+0000","last_unstale":"2024-05-08T10:54:52.206276+0000","last_undegraded":"2024-05-08T10:54:52.206276+0000","last_fullsized":"2024-05-08T10:54:52.206276+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:41:42.237766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.624161+0000","last_change":"2024-05-08T10:54:50.548188+0000","last_active":"2024-05-08T10:54:51.624161+0000","last_peered":"2024-05-08T10:54:51.624161+0000","last_clean":"2024-05-08T10:54:51.624161+0000","last_became_active":"2024-05-08T10:54:50.547738+0000","last_became_peered":"2024-05-08T10:54:50.547738+0000","last_unstale":"2024-05-08T10:54:51.624161+0000","last_undegraded":"2024-05-08T10:54:51.624161+0000","last_fullsized":"2024-05-08T10:54:51.624161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:27:33.078243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.536866+0000","last_change":"2024-05-08T10:54:49.539756+0000","last_active":"2024-05-08T10:54:51.536866+0000","last_peered":"2024-05-08T10:54:51.536866+0000","last_clean":"2024-05-08T10:54:51.536866+0000","last_became_active":"2024-05-08T10:54:49.539459+0000","last_became_peered":"2024-05-08T10:54:49.539459+0000","last_unstale":"2024-05-08T10:54:51.536866+0000","last_undegraded":"2024-05-08T10:54:51.536866+0000","last_fullsized":"2024-05-08T10:54:51.536866+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:40:16.322062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272509+0000","last_change":"2024-05-08T10:54:50.550681+0000","last_active":"2024-05-08T10:54:53.272509+0000","last_peered":"2024-05-08T10:54:53.272509+0000","last_clean":"2024-05-08T10:54:53.272509+0000","last_became_active":"2024-05-08T10:54:50.550395+0000","last_became_peered":"2024-05-08T10:54:50.550395+0000","last_unstale":"2024-05-08T10:54:53.272509+0000","last_undegraded":"2024-05-08T10:54:53.272509+0000","last_fullsized":"2024-05-08T10:54:53.272509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:08:48.409546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:52.206093+0000","last_change":"2024-05-08T10:54:49.534684+0000","last_active":"2024-05-08T10:54:52.206093+0000","last_peered":"2024-05-08T10:54:52.206093+0000","last_clean":"2024-05-08T10:54:52.206093+0000","last_became_active":"2024-05-08T10:54:49.534333+0000","last_became_peered":"2024-05-08T10:54:49.534333+0000","last_unstale":"2024-05-08T10:54:52.206093+0000","last_undegraded":"2024-05-08T10:54:52.206093+0000","last_fullsized":"2024-05-08T10:54:52.206093+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:07:12.581426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.623842+0000","last_change":"2024-05-08T10:54:50.541378+0000","last_active":"2024-05-08T10:54:51.623842+0000","last_peered":"2024-05-08T10:54:51.623842+0000","last_clean":"2024-05-08T10:54:51.623842+0000","last_became_active":"2024-05-08T10:54:50.540987+0000","last_became_peered":"2024-05-08T10:54:50.540987+0000","last_unstale":"2024-05-08T10:54:51.623842+0000","last_undegraded":"2024-05-08T10:54:51.623842+0000","last_fullsized":"2024-05-08T10:54:51.623842+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:20:08.620180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.623580+0000","last_change":"2024-05-08T10:54:40.015226+0000","last_active":"2024-05-08T10:54:51.623580+0000","last_peered":"2024-05-08T10:54:51.623580+0000","last_clean":"2024-05-08T10:54:51.623580+0000","last_became_active":"2024-05-08T10:54:40.014219+0000","last_became_peered":"2024-05-08T10:54:40.014219+0000","last_unstale":"2024-05-08T10:54:51.623580+0000","last_undegraded":"2024-05-08T10:54:51.623580+0000","last_fullsized":"2024-05-08T10:54:51.623580+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:38.989328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:38.989328+0000","last_clean_scrub_stamp":"2024-05-08T10:54:38.989328+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:10:59.668786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.271967+0000","last_change":"2024-05-08T10:54:49.534493+0000","last_active":"2024-05-08T10:54:53.271967+0000","last_peered":"2024-05-08T10:54:53.271967+0000","last_clean":"2024-05-08T10:54:53.271967+0000","last_became_active":"2024-05-08T10:54:49.533772+0000","last_became_peered":"2024-05-08T10:54:49.533772+0000","last_unstale":"2024-05-08T10:54:53.271967+0000","last_undegraded":"2024-05-08T10:54:53.271967+0000","last_fullsized":"2024-05-08T10:54:53.271967+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:41:42.237766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272465+0000","last_change":"2024-05-08T10:54:50.553323+0000","last_active":"2024-05-08T10:54:53.272465+0000","last_peered":"2024-05-08T10:54:53.272465+0000","last_clean":"2024-05-08T10:54:53.272465+0000","last_became_active":"2024-05-08T10:54:50.553046+0000","last_became_peered":"2024-05-08T10:54:50.553046+0000","last_unstale":"2024-05-08T10:54:53.272465+0000","last_undegraded":"2024-05-08T10:54:53.272465+0000","last_fullsized":"2024-05-08T10:54:53.272465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:26:24.924440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.623468+0000","last_change":"2024-05-08T10:54:49.537291+0000","last_active":"2024-05-08T10:54:51.623468+0000","last_peered":"2024-05-08T10:54:51.623468+0000","last_clean":"2024-05-08T10:54:51.623468+0000","last_became_active":"2024-05-08T10:54:49.537026+0000","last_became_peered":"2024-05-08T10:54:49.537026+0000","last_unstale":"2024-05-08T10:54:51.623468+0000","last_undegraded":"2024-05-08T10:54:51.623468+0000","last_fullsized":"2024-05-08T10:54:51.623468+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:35:21.510783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.271682+0000","last_change":"2024-05-08T10:54:50.536808+0000","last_active":"2024-05-08T10:54:53.271682+0000","last_peered":"2024-05-08T10:54:53.271682+0000","last_clean":"2024-05-08T10:54:53.271682+0000","last_became_active":"2024-05-08T10:54:50.536502+0000","last_became_peered":"2024-05-08T10:54:50.536502+0000","last_unstale":"2024-05-08T10:54:53.271682+0000","last_undegraded":"2024-05-08T10:54:53.271682+0000","last_fullsized":"2024-05-08T10:54:53.271682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:08:05.567837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:52.206181+0000","last_change":"2024-05-08T10:54:49.536613+0000","last_active":"2024-05-08T10:54:52.206181+0000","last_peered":"2024-05-08T10:54:52.206181+0000","last_clean":"2024-05-08T10:54:52.206181+0000","last_became_active":"2024-05-08T10:54:49.536290+0000","last_became_peered":"2024-05-08T10:54:49.536290+0000","last_unstale":"2024-05-08T10:54:52.206181+0000","last_undegraded":"2024-05-08T10:54:52.206181+0000","last_fullsized":"2024-05-08T10:54:52.206181+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:50:17.425844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.536784+0000","last_change":"2024-05-08T10:54:50.539387+0000","last_active":"2024-05-08T10:54:51.536784+0000","last_peered":"2024-05-08T10:54:51.536784+0000","last_clean":"2024-05-08T10:54:51.536784+0000","last_became_active":"2024-05-08T10:54:50.539070+0000","last_became_peered":"2024-05-08T10:54:50.539070+0000","last_unstale":"2024-05-08T10:54:51.536784+0000","last_undegraded":"2024-05-08T10:54:51.536784+0000","last_fullsized":"2024-05-08T10:54:51.536784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:12:04.365598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272501+0000","last_change":"2024-05-08T10:54:49.537472+0000","last_active":"2024-05-08T10:54:53.272501+0000","last_peered":"2024-05-08T10:54:53.272501+0000","last_clean":"2024-05-08T10:54:53.272501+0000","last_became_active":"2024-05-08T10:54:49.537140+0000","last_became_peered":"2024-05-08T10:54:49.537140+0000","last_unstale":"2024-05-08T10:54:53.272501+0000","last_undegraded":"2024-05-08T10:54:53.272501+0000","last_fullsized":"2024-05-08T10:54:53.272501+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:00:52.746134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.539458+0000","last_change":"2024-05-08T10:54:50.540453+0000","last_active":"2024-05-08T10:54:51.539458+0000","last_peered":"2024-05-08T10:54:51.539458+0000","last_clean":"2024-05-08T10:54:51.539458+0000","last_became_active":"2024-05-08T10:54:50.540200+0000","last_became_peered":"2024-05-08T10:54:50.540200+0000","last_unstale":"2024-05-08T10:54:51.539458+0000","last_undegraded":"2024-05-08T10:54:51.539458+0000","last_fullsized":"2024-05-08T10:54:51.539458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:40:17.329748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.536732+0000","last_change":"2024-05-08T10:54:49.536666+0000","last_active":"2024-05-08T10:54:51.536732+0000","last_peered":"2024-05-08T10:54:51.536732+0000","last_clean":"2024-05-08T10:54:51.536732+0000","last_became_active":"2024-05-08T10:54:49.536210+0000","last_became_peered":"2024-05-08T10:54:49.536210+0000","last_unstale":"2024-05-08T10:54:51.536732+0000","last_undegraded":"2024-05-08T10:54:51.536732+0000","last_fullsized":"2024-05-08T10:54:51.536732+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:07:12.581426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272494+0000","last_change":"2024-05-08T10:54:50.549051+0000","last_active":"2024-05-08T10:54:53.272494+0000","last_peered":"2024-05-08T10:54:53.272494+0000","last_clean":"2024-05-08T10:54:53.272494+0000","last_became_active":"2024-05-08T10:54:50.548723+0000","last_became_peered":"2024-05-08T10:54:50.548723+0000","last_unstale":"2024-05-08T10:54:53.272494+0000","last_undegraded":"2024-05-08T10:54:53.272494+0000","last_fullsized":"2024-05-08T10:54:53.272494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:41:02.815763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.624047+0000","last_change":"2024-05-08T10:54:49.538497+0000","last_active":"2024-05-08T10:54:51.624047+0000","last_peered":"2024-05-08T10:54:51.624047+0000","last_clean":"2024-05-08T10:54:51.624047+0000","last_became_active":"2024-05-08T10:54:49.537819+0000","last_became_peered":"2024-05-08T10:54:49.537819+0000","last_unstale":"2024-05-08T10:54:51.624047+0000","last_undegraded":"2024-05-08T10:54:51.624047+0000","last_fullsized":"2024-05-08T10:54:51.624047+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:31:54.768524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.536801+0000","last_change":"2024-05-08T10:54:50.533885+0000","last_active":"2024-05-08T10:54:51.536801+0000","last_peered":"2024-05-08T10:54:51.536801+0000","last_clean":"2024-05-08T10:54:51.536801+0000","last_became_active":"2024-05-08T10:54:50.533569+0000","last_became_peered":"2024-05-08T10:54:50.533569+0000","last_unstale":"2024-05-08T10:54:51.536801+0000","last_undegraded":"2024-05-08T10:54:51.536801+0000","last_fullsized":"2024-05-08T10:54:51.536801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:43:52.788984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.536965+0000","last_change":"2024-05-08T10:54:49.533336+0000","last_active":"2024-05-08T10:54:51.536965+0000","last_peered":"2024-05-08T10:54:51.536965+0000","last_clean":"2024-05-08T10:54:51.536965+0000","last_became_active":"2024-05-08T10:54:49.533024+0000","last_became_peered":"2024-05-08T10:54:49.533024+0000","last_unstale":"2024-05-08T10:54:51.536965+0000","last_undegraded":"2024-05-08T10:54:51.536965+0000","last_fullsized":"2024-05-08T10:54:51.536965+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:04:27.826613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272492+0000","last_change":"2024-05-08T10:54:50.544364+0000","last_active":"2024-05-08T10:54:53.272492+0000","last_peered":"2024-05-08T10:54:53.272492+0000","last_clean":"2024-05-08T10:54:53.272492+0000","last_became_active":"2024-05-08T10:54:50.544015+0000","last_became_peered":"2024-05-08T10:54:50.544015+0000","last_unstale":"2024-05-08T10:54:53.272492+0000","last_undegraded":"2024-05-08T10:54:53.272492+0000","last_fullsized":"2024-05-08T10:54:53.272492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:34:17.184122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.538820+0000","last_change":"2024-05-08T10:54:49.538628+0000","last_active":"2024-05-08T10:54:51.538820+0000","last_peered":"2024-05-08T10:54:51.538820+0000","last_clean":"2024-05-08T10:54:51.538820+0000","last_became_active":"2024-05-08T10:54:49.538328+0000","last_became_peered":"2024-05-08T10:54:49.538328+0000","last_unstale":"2024-05-08T10:54:51.538820+0000","last_undegraded":"2024-05-08T10:54:51.538820+0000","last_fullsized":"2024-05-08T10:54:51.538820+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:04:27.826613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272243+0000","last_change":"2024-05-08T10:54:50.542376+0000","last_active":"2024-05-08T10:54:53.272243+0000","last_peered":"2024-05-08T10:54:53.272243+0000","last_clean":"2024-05-08T10:54:53.272243+0000","last_became_active":"2024-05-08T10:54:50.541231+0000","last_became_peered":"2024-05-08T10:54:50.541231+0000","last_unstale":"2024-05-08T10:54:53.272243+0000","last_undegraded":"2024-05-08T10:54:53.272243+0000","last_fullsized":"2024-05-08T10:54:53.272243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:43:52.788984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.623466+0000","last_change":"2024-05-08T10:54:49.538203+0000","last_active":"2024-05-08T10:54:51.623466+0000","last_peered":"2024-05-08T10:54:51.623466+0000","last_clean":"2024-05-08T10:54:51.623466+0000","last_became_active":"2024-05-08T10:54:49.537722+0000","last_became_peered":"2024-05-08T10:54:49.537722+0000","last_unstale":"2024-05-08T10:54:51.623466+0000","last_undegraded":"2024-05-08T10:54:51.623466+0000","last_fullsized":"2024-05-08T10:54:51.623466+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:07:12.581426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.539252+0000","last_change":"2024-05-08T10:54:50.535043+0000","last_active":"2024-05-08T10:54:51.539252+0000","last_peered":"2024-05-08T10:54:51.539252+0000","last_clean":"2024-05-08T10:54:51.539252+0000","last_became_active":"2024-05-08T10:54:50.534704+0000","last_became_peered":"2024-05-08T10:54:50.534704+0000","last_unstale":"2024-05-08T10:54:51.539252+0000","last_undegraded":"2024-05-08T10:54:51.539252+0000","last_fullsized":"2024-05-08T10:54:51.539252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:35:22.518469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.536641+0000","last_change":"2024-05-08T10:54:49.537497+0000","last_active":"2024-05-08T10:54:51.536641+0000","last_peered":"2024-05-08T10:54:51.536641+0000","last_clean":"2024-05-08T10:54:51.536641+0000","last_became_active":"2024-05-08T10:54:49.537216+0000","last_became_peered":"2024-05-08T10:54:49.537216+0000","last_unstale":"2024-05-08T10:54:51.536641+0000","last_undegraded":"2024-05-08T10:54:51.536641+0000","last_fullsized":"2024-05-08T10:54:51.536641+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:41:42.237766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272547+0000","last_change":"2024-05-08T10:54:50.544550+0000","last_active":"2024-05-08T10:54:53.272547+0000","last_peered":"2024-05-08T10:54:53.272547+0000","last_clean":"2024-05-08T10:54:53.272547+0000","last_became_active":"2024-05-08T10:54:50.544247+0000","last_became_peered":"2024-05-08T10:54:50.544247+0000","last_unstale":"2024-05-08T10:54:53.272547+0000","last_undegraded":"2024-05-08T10:54:53.272547+0000","last_fullsized":"2024-05-08T10:54:53.272547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:14:08.876280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.536662+0000","last_change":"2024-05-08T10:54:49.537032+0000","last_active":"2024-05-08T10:54:51.536662+0000","last_peered":"2024-05-08T10:54:51.536662+0000","last_clean":"2024-05-08T10:54:51.536662+0000","last_became_active":"2024-05-08T10:54:49.536742+0000","last_became_peered":"2024-05-08T10:54:49.536742+0000","last_unstale":"2024-05-08T10:54:51.536662+0000","last_undegraded":"2024-05-08T10:54:51.536662+0000","last_fullsized":"2024-05-08T10:54:51.536662+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:35:21.510783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272404+0000","last_change":"2024-05-08T10:54:50.551614+0000","last_active":"2024-05-08T10:54:53.272404+0000","last_peered":"2024-05-08T10:54:53.272404+0000","last_clean":"2024-05-08T10:54:53.272404+0000","last_became_active":"2024-05-08T10:54:50.551296+0000","last_became_peered":"2024-05-08T10:54:50.551296+0000","last_unstale":"2024-05-08T10:54:53.272404+0000","last_undegraded":"2024-05-08T10:54:53.272404+0000","last_fullsized":"2024-05-08T10:54:53.272404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:40:14.037116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.623924+0000","last_change":"2024-05-08T10:54:49.538259+0000","last_active":"2024-05-08T10:54:51.623924+0000","last_peered":"2024-05-08T10:54:51.623924+0000","last_clean":"2024-05-08T10:54:51.623924+0000","last_became_active":"2024-05-08T10:54:49.537732+0000","last_became_peered":"2024-05-08T10:54:49.537732+0000","last_unstale":"2024-05-08T10:54:51.623924+0000","last_undegraded":"2024-05-08T10:54:51.623924+0000","last_fullsized":"2024-05-08T10:54:51.623924+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:40:16.322062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.539024+0000","last_change":"2024-05-08T10:54:50.533790+0000","last_active":"2024-05-08T10:54:51.539024+0000","last_peered":"2024-05-08T10:54:51.539024+0000","last_clean":"2024-05-08T10:54:51.539024+0000","last_became_active":"2024-05-08T10:54:50.533500+0000","last_became_peered":"2024-05-08T10:54:50.533500+0000","last_unstale":"2024-05-08T10:54:51.539024+0000","last_undegraded":"2024-05-08T10:54:51.539024+0000","last_fullsized":"2024-05-08T10:54:51.539024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:43:52.788984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272457+0000","last_change":"2024-05-08T10:54:50.538173+0000","last_active":"2024-05-08T10:54:53.272457+0000","last_peered":"2024-05-08T10:54:53.272457+0000","last_clean":"2024-05-08T10:54:53.272457+0000","last_became_active":"2024-05-08T10:54:50.537276+0000","last_became_peered":"2024-05-08T10:54:50.537276+0000","last_unstale":"2024-05-08T10:54:53.272457+0000","last_undegraded":"2024-05-08T10:54:53.272457+0000","last_fullsized":"2024-05-08T10:54:53.272457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:28:49.416807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.623659+0000","last_change":"2024-05-08T10:54:49.537236+0000","last_active":"2024-05-08T10:54:51.623659+0000","last_peered":"2024-05-08T10:54:51.623659+0000","last_clean":"2024-05-08T10:54:51.623659+0000","last_became_active":"2024-05-08T10:54:49.536918+0000","last_became_peered":"2024-05-08T10:54:49.536918+0000","last_unstale":"2024-05-08T10:54:51.623659+0000","last_undegraded":"2024-05-08T10:54:51.623659+0000","last_fullsized":"2024-05-08T10:54:51.623659+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:00:52.746134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272163+0000","last_change":"2024-05-08T10:54:50.544921+0000","last_active":"2024-05-08T10:54:53.272163+0000","last_peered":"2024-05-08T10:54:53.272163+0000","last_clean":"2024-05-08T10:54:53.272163+0000","last_became_active":"2024-05-08T10:54:50.544572+0000","last_became_peered":"2024-05-08T10:54:50.544572+0000","last_unstale":"2024-05-08T10:54:53.272163+0000","last_undegraded":"2024-05-08T10:54:53.272163+0000","last_fullsized":"2024-05-08T10:54:53.272163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:26:24.924440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.623924+0000","last_change":"2024-05-08T10:54:49.538621+0000","last_active":"2024-05-08T10:54:51.623924+0000","last_peered":"2024-05-08T10:54:51.623924+0000","last_clean":"2024-05-08T10:54:51.623924+0000","last_became_active":"2024-05-08T10:54:49.537823+0000","last_became_peered":"2024-05-08T10:54:49.537823+0000","last_unstale":"2024-05-08T10:54:51.623924+0000","last_undegraded":"2024-05-08T10:54:51.623924+0000","last_fullsized":"2024-05-08T10:54:51.623924+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:05.980282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272301+0000","last_change":"2024-05-08T10:54:50.548758+0000","last_active":"2024-05-08T10:54:53.272301+0000","last_peered":"2024-05-08T10:54:53.272301+0000","last_clean":"2024-05-08T10:54:53.272301+0000","last_became_active":"2024-05-08T10:54:50.548012+0000","last_became_peered":"2024-05-08T10:54:50.548012+0000","last_unstale":"2024-05-08T10:54:53.272301+0000","last_undegraded":"2024-05-08T10:54:53.272301+0000","last_fullsized":"2024-05-08T10:54:53.272301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:27:46.730550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272385+0000","last_change":"2024-05-08T10:54:49.537987+0000","last_active":"2024-05-08T10:54:53.272385+0000","last_peered":"2024-05-08T10:54:53.272385+0000","last_clean":"2024-05-08T10:54:53.272385+0000","last_became_active":"2024-05-08T10:54:49.537700+0000","last_became_peered":"2024-05-08T10:54:49.537700+0000","last_unstale":"2024-05-08T10:54:53.272385+0000","last_undegraded":"2024-05-08T10:54:53.272385+0000","last_fullsized":"2024-05-08T10:54:53.272385+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:04:27.826613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272245+0000","last_change":"2024-05-08T10:54:50.545275+0000","last_active":"2024-05-08T10:54:53.272245+0000","last_peered":"2024-05-08T10:54:53.272245+0000","last_clean":"2024-05-08T10:54:53.272245+0000","last_became_active":"2024-05-08T10:54:50.544915+0000","last_became_peered":"2024-05-08T10:54:50.544915+0000","last_unstale":"2024-05-08T10:54:53.272245+0000","last_undegraded":"2024-05-08T10:54:53.272245+0000","last_fullsized":"2024-05-08T10:54:53.272245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:12:04.365598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272568+0000","last_change":"2024-05-08T10:54:49.540467+0000","last_active":"2024-05-08T10:54:53.272568+0000","last_peered":"2024-05-08T10:54:53.272568+0000","last_clean":"2024-05-08T10:54:53.272568+0000","last_became_active":"2024-05-08T10:54:49.540032+0000","last_became_peered":"2024-05-08T10:54:49.540032+0000","last_unstale":"2024-05-08T10:54:53.272568+0000","last_undegraded":"2024-05-08T10:54:53.272568+0000","last_fullsized":"2024-05-08T10:54:53.272568+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:21:53.697233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":661884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":71060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":661940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T10:55:03.408 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T10:55:03.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.550+0000 7f75d188c640 1 Processor -- start 2024-05-08T10:55:03.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.550+0000 7f75d188c640 1 -- start start 2024-05-08T10:55:03.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.551+0000 7f75d188c640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f75cc0d0920 0x7f75cc15e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:03.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.551+0000 7f75d188c640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f75cc0b4c60 0x7f75cc0ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:03.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.551+0000 7f75d188c640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75cc0d4910 con 0x7f75cc0d0540 2024-05-08T10:55:03.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.551+0000 7f75d188c640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75cc0d46c0 con 0x7f75cc0b4c60 2024-05-08T10:55:03.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.551+0000 7f75d188c640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75cc0d2390 con 0x7f75cc0d0920 2024-05-08T10:55:03.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.551+0000 7f75cb7fe640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f75cc0b4c60 0x7f75cc0ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:03.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.551+0000 7f75cb7fe640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f75cc0b4c60 0x7f75cc0ce7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37930/0 (socket says 172.21.15.33:37930) 2024-05-08T10:55:03.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.551+0000 7f75cb7fe640 1 -- 172.21.15.33:0/2301067050 learned_addr learned my addr 172.21.15.33:0/2301067050 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:03.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.551+0000 7f75ca7fc640 1 --2- 172.21.15.33:0/2301067050 >> v2:172.21.15.174:3300/0 conn(0x7f75cc0d0920 0x7f75cc15e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:03.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.551+0000 7f75cb7fe640 1 -- 172.21.15.33:0/2301067050 >> v2:172.21.15.174:3300/0 conn(0x7f75cc0d0920 msgr2=0x7f75cc15e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:03.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.551+0000 7f75cb7fe640 1 --2- 172.21.15.33:0/2301067050 >> v2:172.21.15.174:3300/0 conn(0x7f75cc0d0920 0x7f75cc15e2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:03.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.551+0000 7f75cb7fe640 1 -- 172.21.15.33:0/2301067050 >> v1:172.21.15.174:6789/0 conn(0x7f75cc0d0540 legacy=0x7f75cc15dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:03.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.551+0000 7f75cb7fe640 1 -- 172.21.15.33:0/2301067050 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75cc0d25e0 con 0x7f75cc0b4c60 2024-05-08T10:55:03.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.551+0000 7f75ca7fc640 1 --2- 172.21.15.33:0/2301067050 >> v2:172.21.15.174:3300/0 conn(0x7f75cc0d0920 0x7f75cc15e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:55:03.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.552+0000 7f75cb7fe640 1 --2- 172.21.15.33:0/2301067050 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75cc0b4c60 0x7f75cc0ce7b0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f75cc073240 tx=0x7f75c402a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e564142e8548723 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:03.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.552+0000 7f75c9ffb640 1 -- 172.21.15.33:0/2301067050 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c4036070 con 0x7f75cc0b4c60 2024-05-08T10:55:03.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.552+0000 7f75c9ffb640 1 -- 172.21.15.33:0/2301067050 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75c4031600 con 0x7f75cc0b4c60 2024-05-08T10:55:03.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.552+0000 7f75c9ffb640 1 -- 172.21.15.33:0/2301067050 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c40319d0 con 0x7f75cc0b4c60 2024-05-08T10:55:03.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.553+0000 7f75d188c640 1 -- 172.21.15.33:0/2301067050 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75cc0b4c60 msgr2=0x7f75cc0ce7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:03.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.553+0000 7f75d188c640 1 --2- 172.21.15.33:0/2301067050 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75cc0b4c60 0x7f75cc0ce7b0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f75cc073240 tx=0x7f75c402a5d0 comp rx=0 tx=0).stop 2024-05-08T10:55:03.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.553+0000 7f75d188c640 1 -- 172.21.15.33:0/2301067050 shutdown_connections 2024-05-08T10:55:03.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.553+0000 7f75d188c640 1 --2- 172.21.15.33:0/2301067050 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75cc0b4c60 0x7f75cc0ce7b0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:03.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.553+0000 7f75d188c640 1 --2- 172.21.15.33:0/2301067050 >> v2:172.21.15.174:3300/0 conn(0x7f75cc0d0920 0x7f75cc15e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:03.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.553+0000 7f75d188c640 1 -- 172.21.15.33:0/2301067050 >> 172.21.15.33:0/2301067050 conn(0x7f75cc0d3ba0 msgr2=0x7f75cc0d3fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:03.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.553+0000 7f75d188c640 1 -- 172.21.15.33:0/2301067050 shutdown_connections 2024-05-08T10:55:03.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.553+0000 7f75d188c640 1 -- 172.21.15.33:0/2301067050 wait complete. 2024-05-08T10:55:03.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.554+0000 7f75d188c640 1 Processor -- start 2024-05-08T10:55:03.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.554+0000 7f75d188c640 1 -- start start 2024-05-08T10:55:03.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.555+0000 7f75d188c640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f75cc0b4c60 0x7f75cc15f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:03.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.555+0000 7f75d188c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75cc0d0540 0x7f75cc0b6740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:03.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.555+0000 7f75d188c640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f75cc0d0920 0x7f75cc0b6c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:03.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.555+0000 7f75d188c640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75cc0d2950 con 0x7f75cc0d0540 2024-05-08T10:55:03.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.555+0000 7f75d188c640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75cc0b4980 con 0x7f75cc0d0920 2024-05-08T10:55:03.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.555+0000 7f75d188c640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75cc0b51d0 con 0x7f75cc0b4c60 2024-05-08T10:55:03.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.555+0000 7f75ca7fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75cc0d0540 0x7f75cc0b6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:03.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.555+0000 7f75ca7fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75cc0d0540 0x7f75cc0b6740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37936/0 (socket says 172.21.15.33:37936) 2024-05-08T10:55:03.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.555+0000 7f75ca7fc640 1 -- 172.21.15.33:0/2997814350 learned_addr learned my addr 172.21.15.33:0/2997814350 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:03.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.555+0000 7f75cb7fe640 1 --2- 172.21.15.33:0/2997814350 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f75cc0d0920 0x7f75cc0b6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:03.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.555+0000 7f75caffd640 1 --2- 172.21.15.33:0/2997814350 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f75cc0b4c60 0x7f75cc15f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:03.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.556+0000 7f75ca7fc640 1 -- 172.21.15.33:0/2997814350 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f75cc0b4c60 msgr2=0x7f75cc15f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:03.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.556+0000 7f75ca7fc640 1 --2- 172.21.15.33:0/2997814350 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f75cc0b4c60 0x7f75cc15f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:03.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.556+0000 7f75ca7fc640 1 -- 172.21.15.33:0/2997814350 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f75cc0d0920 msgr2=0x7f75cc0b6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:03.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.556+0000 7f75ca7fc640 1 --2- 172.21.15.33:0/2997814350 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f75cc0d0920 0x7f75cc0b6c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:03.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.556+0000 7f75ca7fc640 1 -- 172.21.15.33:0/2997814350 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75cc15ff90 con 0x7f75cc0d0540 2024-05-08T10:55:03.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.556+0000 7f75ca7fc640 1 --2- 172.21.15.33:0/2997814350 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75cc0d0540 0x7f75cc0b6740 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f75c000c820 tx=0x7f75c000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:03.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.556+0000 7f75b3fff640 1 -- 172.21.15.33:0/2997814350 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c0015070 con 0x7f75cc0d0540 2024-05-08T10:55:03.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.556+0000 7f75b3fff640 1 -- 172.21.15.33:0/2997814350 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75c0007a30 con 0x7f75cc0d0540 2024-05-08T10:55:03.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.556+0000 7f75d188c640 1 -- 172.21.15.33:0/2997814350 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75cc160270 con 0x7f75cc0d0540 2024-05-08T10:55:03.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.556+0000 7f75b3fff640 1 -- 172.21.15.33:0/2997814350 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c0007e20 con 0x7f75cc0d0540 2024-05-08T10:55:03.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.556+0000 7f75d188c640 1 -- 172.21.15.33:0/2997814350 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75cc160830 con 0x7f75cc0d0540 2024-05-08T10:55:03.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.557+0000 7f75d188c640 1 -- 172.21.15.33:0/2997814350 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75cc069d20 con 0x7f75cc0d0540 2024-05-08T10:55:03.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.557+0000 7f75b3fff640 1 -- 172.21.15.33:0/2997814350 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f75c0018070 con 0x7f75cc0d0540 2024-05-08T10:55:03.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.558+0000 7f75b3fff640 1 --2- 172.21.15.33:0/2997814350 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f75b806b4d0 0x7f75b806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:03.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.558+0000 7f75b3fff640 1 -- 172.21.15.33:0/2997814350 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f75c008a100 con 0x7f75cc0d0540 2024-05-08T10:55:03.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.558+0000 7f75caffd640 1 --2- 172.21.15.33:0/2997814350 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f75b806b4d0 0x7f75b806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:03.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.559+0000 7f75caffd640 1 --2- 172.21.15.33:0/2997814350 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f75b806b4d0 0x7f75b806d990 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f75bc004f60 tx=0x7f75bc007e30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:03.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.562+0000 7f75b3fff640 1 -- 172.21.15.33:0/2997814350 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f75c00588a0 con 0x7f75cc0d0540 2024-05-08T10:55:03.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.745+0000 7f75d188c640 1 -- 172.21.15.33:0/2997814350 --> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f75cc072f70 con 0x7f75b806b4d0 2024-05-08T10:55:04.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.752+0000 7f75b3fff640 1 -- 172.21.15.33:0/2997814350 <== mgr.4103 v2:172.21.15.174:6832/261355069 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251837 (secure 0 0 0) 0x7f75cc072f70 con 0x7f75b806b4d0 2024-05-08T10:55:04.057 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:55:04.059 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-05-08T10:55:04.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.755+0000 7f75d188c640 1 -- 172.21.15.33:0/2997814350 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f75b806b4d0 msgr2=0x7f75b806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:04.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.755+0000 7f75d188c640 1 --2- 172.21.15.33:0/2997814350 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f75b806b4d0 0x7f75b806d990 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f75bc004f60 tx=0x7f75bc007e30 comp rx=0 tx=0).stop 2024-05-08T10:55:04.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.755+0000 7f75d188c640 1 -- 172.21.15.33:0/2997814350 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75cc0d0540 msgr2=0x7f75cc0b6740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:04.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.755+0000 7f75d188c640 1 --2- 172.21.15.33:0/2997814350 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75cc0d0540 0x7f75cc0b6740 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f75c000c820 tx=0x7f75c000cce0 comp rx=0 tx=0).stop 2024-05-08T10:55:04.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.755+0000 7f75d188c640 1 -- 172.21.15.33:0/2997814350 shutdown_connections 2024-05-08T10:55:04.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.755+0000 7f75d188c640 1 --2- 172.21.15.33:0/2997814350 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f75b806b4d0 0x7f75b806d990 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:04.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.755+0000 7f75d188c640 1 --2- 172.21.15.33:0/2997814350 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f75cc0d0920 0x7f75cc0b6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:04.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.755+0000 7f75d188c640 1 --2- 172.21.15.33:0/2997814350 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75cc0d0540 0x7f75cc0b6740 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:04.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.755+0000 7f75d188c640 1 --2- 172.21.15.33:0/2997814350 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f75cc0b4c60 0x7f75cc15f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:04.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.755+0000 7f75d188c640 1 -- 172.21.15.33:0/2997814350 >> 172.21.15.33:0/2997814350 conn(0x7f75cc0d3ba0 msgr2=0x7f75cc06c640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:04.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.755+0000 7f75d188c640 1 -- 172.21.15.33:0/2997814350 shutdown_connections 2024-05-08T10:55:04.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:03.755+0000 7f75d188c640 1 -- 172.21.15.33:0/2997814350 wait complete. 2024-05-08T10:55:04.062 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-05-08T10:55:02.947497+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218984,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755736,"statfs":{"total":773094113280,"available":772869873664,"internally_reserved":0,"allocated":2891776,"data_stored":1753028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.410179"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.624024+0000","last_change":"2024-05-08T10:54:50.544238+0000","last_active":"2024-05-08T10:54:51.624024+0000","last_peered":"2024-05-08T10:54:51.624024+0000","last_clean":"2024-05-08T10:54:51.624024+0000","last_became_active":"2024-05-08T10:54:50.543590+0000","last_became_peered":"2024-05-08T10:54:50.543590+0000","last_unstale":"2024-05-08T10:54:51.624024+0000","last_undegraded":"2024-05-08T10:54:51.624024+0000","last_fullsized":"2024-05-08T10:54:51.624024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:17:53.754154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.537034+0000","last_change":"2024-05-08T10:54:50.544605+0000","last_active":"2024-05-08T10:54:51.537034+0000","last_peered":"2024-05-08T10:54:51.537034+0000","last_clean":"2024-05-08T10:54:51.537034+0000","last_became_active":"2024-05-08T10:54:50.543971+0000","last_became_peered":"2024-05-08T10:54:50.543971+0000","last_unstale":"2024-05-08T10:54:51.537034+0000","last_undegraded":"2024-05-08T10:54:51.537034+0000","last_fullsized":"2024-05-08T10:54:51.537034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:17:39.617660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272018+0000","last_change":"2024-05-08T10:54:50.541546+0000","last_active":"2024-05-08T10:54:53.272018+0000","last_peered":"2024-05-08T10:54:53.272018+0000","last_clean":"2024-05-08T10:54:53.272018+0000","last_became_active":"2024-05-08T10:54:50.540512+0000","last_became_peered":"2024-05-08T10:54:50.540512+0000","last_unstale":"2024-05-08T10:54:53.272018+0000","last_undegraded":"2024-05-08T10:54:53.272018+0000","last_fullsized":"2024-05-08T10:54:53.272018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:06:27.967756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272230+0000","last_change":"2024-05-08T10:54:50.550769+0000","last_active":"2024-05-08T10:54:53.272230+0000","last_peered":"2024-05-08T10:54:53.272230+0000","last_clean":"2024-05-08T10:54:53.272230+0000","last_became_active":"2024-05-08T10:54:50.550414+0000","last_became_peered":"2024-05-08T10:54:50.550414+0000","last_unstale":"2024-05-08T10:54:53.272230+0000","last_undegraded":"2024-05-08T10:54:53.272230+0000","last_fullsized":"2024-05-08T10:54:53.272230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:34:17.184122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.623876+0000","last_change":"2024-05-08T10:54:50.540125+0000","last_active":"2024-05-08T10:54:51.623876+0000","last_peered":"2024-05-08T10:54:51.623876+0000","last_clean":"2024-05-08T10:54:51.623876+0000","last_became_active":"2024-05-08T10:54:50.539796+0000","last_became_peered":"2024-05-08T10:54:50.539796+0000","last_unstale":"2024-05-08T10:54:51.623876+0000","last_undegraded":"2024-05-08T10:54:51.623876+0000","last_fullsized":"2024-05-08T10:54:51.623876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:28:49.416807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272082+0000","last_change":"2024-05-08T10:54:50.550911+0000","last_active":"2024-05-08T10:54:53.272082+0000","last_peered":"2024-05-08T10:54:53.272082+0000","last_clean":"2024-05-08T10:54:53.272082+0000","last_became_active":"2024-05-08T10:54:50.550594+0000","last_became_peered":"2024-05-08T10:54:50.550594+0000","last_unstale":"2024-05-08T10:54:53.272082+0000","last_undegraded":"2024-05-08T10:54:53.272082+0000","last_fullsized":"2024-05-08T10:54:53.272082+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:27:46.730550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.623675+0000","last_change":"2024-05-08T10:54:50.547034+0000","last_active":"2024-05-08T10:54:51.623675+0000","last_peered":"2024-05-08T10:54:51.623675+0000","last_clean":"2024-05-08T10:54:51.623675+0000","last_became_active":"2024-05-08T10:54:50.546680+0000","last_became_peered":"2024-05-08T10:54:50.546680+0000","last_unstale":"2024-05-08T10:54:51.623675+0000","last_undegraded":"2024-05-08T10:54:51.623675+0000","last_fullsized":"2024-05-08T10:54:51.623675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:14:08.876280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.271747+0000","last_change":"2024-05-08T10:54:50.553200+0000","last_active":"2024-05-08T10:54:53.271747+0000","last_peered":"2024-05-08T10:54:53.271747+0000","last_clean":"2024-05-08T10:54:53.271747+0000","last_became_active":"2024-05-08T10:54:50.552845+0000","last_became_peered":"2024-05-08T10:54:50.552845+0000","last_unstale":"2024-05-08T10:54:53.271747+0000","last_undegraded":"2024-05-08T10:54:53.271747+0000","last_fullsized":"2024-05-08T10:54:53.271747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:46:10.084159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.624104+0000","last_change":"2024-05-08T10:54:50.542398+0000","last_active":"2024-05-08T10:54:51.624104+0000","last_peered":"2024-05-08T10:54:51.624104+0000","last_clean":"2024-05-08T10:54:51.624104+0000","last_became_active":"2024-05-08T10:54:50.542014+0000","last_became_peered":"2024-05-08T10:54:50.542014+0000","last_unstale":"2024-05-08T10:54:51.624104+0000","last_undegraded":"2024-05-08T10:54:51.624104+0000","last_fullsized":"2024-05-08T10:54:51.624104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:36:31.739083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.539523+0000","last_change":"2024-05-08T10:54:50.542033+0000","last_active":"2024-05-08T10:54:51.539523+0000","last_peered":"2024-05-08T10:54:51.539523+0000","last_clean":"2024-05-08T10:54:51.539523+0000","last_became_active":"2024-05-08T10:54:50.541776+0000","last_became_peered":"2024-05-08T10:54:50.541776+0000","last_unstale":"2024-05-08T10:54:51.539523+0000","last_undegraded":"2024-05-08T10:54:51.539523+0000","last_fullsized":"2024-05-08T10:54:51.539523+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:17:39.617660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.538877+0000","last_change":"2024-05-08T10:54:50.541380+0000","last_active":"2024-05-08T10:54:51.538877+0000","last_peered":"2024-05-08T10:54:51.538877+0000","last_clean":"2024-05-08T10:54:51.538877+0000","last_became_active":"2024-05-08T10:54:50.540999+0000","last_became_peered":"2024-05-08T10:54:50.540999+0000","last_unstale":"2024-05-08T10:54:51.538877+0000","last_undegraded":"2024-05-08T10:54:51.538877+0000","last_fullsized":"2024-05-08T10:54:51.538877+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:12:04.365598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.539267+0000","last_change":"2024-05-08T10:54:50.536612+0000","last_active":"2024-05-08T10:54:51.539267+0000","last_peered":"2024-05-08T10:54:51.539267+0000","last_clean":"2024-05-08T10:54:51.539267+0000","last_became_active":"2024-05-08T10:54:50.536347+0000","last_became_peered":"2024-05-08T10:54:50.536347+0000","last_unstale":"2024-05-08T10:54:51.539267+0000","last_undegraded":"2024-05-08T10:54:51.539267+0000","last_fullsized":"2024-05-08T10:54:51.539267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:00:53.753820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272252+0000","last_change":"2024-05-08T10:54:50.542352+0000","last_active":"2024-05-08T10:54:53.272252+0000","last_peered":"2024-05-08T10:54:53.272252+0000","last_clean":"2024-05-08T10:54:53.272252+0000","last_became_active":"2024-05-08T10:54:50.542056+0000","last_became_peered":"2024-05-08T10:54:50.542056+0000","last_unstale":"2024-05-08T10:54:53.272252+0000","last_undegraded":"2024-05-08T10:54:53.272252+0000","last_fullsized":"2024-05-08T10:54:53.272252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:43:52.788984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.271763+0000","last_change":"2024-05-08T10:54:50.540420+0000","last_active":"2024-05-08T10:54:53.271763+0000","last_peered":"2024-05-08T10:54:53.271763+0000","last_clean":"2024-05-08T10:54:53.271763+0000","last_became_active":"2024-05-08T10:54:50.540073+0000","last_became_peered":"2024-05-08T10:54:50.540073+0000","last_unstale":"2024-05-08T10:54:53.271763+0000","last_undegraded":"2024-05-08T10:54:53.271763+0000","last_fullsized":"2024-05-08T10:54:53.271763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:44:24.261973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.536636+0000","last_change":"2024-05-08T10:54:50.531957+0000","last_active":"2024-05-08T10:54:51.536636+0000","last_peered":"2024-05-08T10:54:51.536636+0000","last_clean":"2024-05-08T10:54:51.536636+0000","last_became_active":"2024-05-08T10:54:50.531646+0000","last_became_peered":"2024-05-08T10:54:50.531646+0000","last_unstale":"2024-05-08T10:54:51.536636+0000","last_undegraded":"2024-05-08T10:54:51.536636+0000","last_fullsized":"2024-05-08T10:54:51.536636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:06:27.967756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272153+0000","last_change":"2024-05-08T10:54:50.545714+0000","last_active":"2024-05-08T10:54:53.272153+0000","last_peered":"2024-05-08T10:54:53.272153+0000","last_clean":"2024-05-08T10:54:53.272153+0000","last_became_active":"2024-05-08T10:54:50.545415+0000","last_became_peered":"2024-05-08T10:54:50.545415+0000","last_unstale":"2024-05-08T10:54:53.272153+0000","last_undegraded":"2024-05-08T10:54:53.272153+0000","last_fullsized":"2024-05-08T10:54:53.272153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:40:14.037116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272642+0000","last_change":"2024-05-08T10:54:50.543717+0000","last_active":"2024-05-08T10:54:53.272642+0000","last_peered":"2024-05-08T10:54:53.272642+0000","last_clean":"2024-05-08T10:54:53.272642+0000","last_became_active":"2024-05-08T10:54:50.543465+0000","last_became_peered":"2024-05-08T10:54:50.543465+0000","last_unstale":"2024-05-08T10:54:53.272642+0000","last_undegraded":"2024-05-08T10:54:53.272642+0000","last_fullsized":"2024-05-08T10:54:53.272642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:17:53.754154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:52.206333+0000","last_change":"2024-05-08T10:54:50.535283+0000","last_active":"2024-05-08T10:54:52.206333+0000","last_peered":"2024-05-08T10:54:52.206333+0000","last_clean":"2024-05-08T10:54:52.206333+0000","last_became_active":"2024-05-08T10:54:50.534933+0000","last_became_peered":"2024-05-08T10:54:50.534933+0000","last_unstale":"2024-05-08T10:54:52.206333+0000","last_undegraded":"2024-05-08T10:54:52.206333+0000","last_fullsized":"2024-05-08T10:54:52.206333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:06.987968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.624055+0000","last_change":"2024-05-08T10:54:50.545460+0000","last_active":"2024-05-08T10:54:51.624055+0000","last_peered":"2024-05-08T10:54:51.624055+0000","last_clean":"2024-05-08T10:54:51.624055+0000","last_became_active":"2024-05-08T10:54:50.545182+0000","last_became_peered":"2024-05-08T10:54:50.545182+0000","last_unstale":"2024-05-08T10:54:51.624055+0000","last_undegraded":"2024-05-08T10:54:51.624055+0000","last_fullsized":"2024-05-08T10:54:51.624055+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:35:53.604235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.539432+0000","last_change":"2024-05-08T10:54:50.534702+0000","last_active":"2024-05-08T10:54:51.539432+0000","last_peered":"2024-05-08T10:54:51.539432+0000","last_clean":"2024-05-08T10:54:51.539432+0000","last_became_active":"2024-05-08T10:54:50.534424+0000","last_became_peered":"2024-05-08T10:54:50.534424+0000","last_unstale":"2024-05-08T10:54:51.539432+0000","last_undegraded":"2024-05-08T10:54:51.539432+0000","last_fullsized":"2024-05-08T10:54:51.539432+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:27:46.730550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.271871+0000","last_change":"2024-05-08T10:54:50.542206+0000","last_active":"2024-05-08T10:54:53.271871+0000","last_peered":"2024-05-08T10:54:53.271871+0000","last_clean":"2024-05-08T10:54:53.271871+0000","last_became_active":"2024-05-08T10:54:50.540272+0000","last_became_peered":"2024-05-08T10:54:50.540272+0000","last_unstale":"2024-05-08T10:54:53.271871+0000","last_undegraded":"2024-05-08T10:54:53.271871+0000","last_fullsized":"2024-05-08T10:54:53.271871+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:45:53.748139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272432+0000","last_change":"2024-05-08T10:54:50.546452+0000","last_active":"2024-05-08T10:54:53.272432+0000","last_peered":"2024-05-08T10:54:53.272432+0000","last_clean":"2024-05-08T10:54:53.272432+0000","last_became_active":"2024-05-08T10:54:50.546143+0000","last_became_peered":"2024-05-08T10:54:50.546143+0000","last_unstale":"2024-05-08T10:54:53.272432+0000","last_undegraded":"2024-05-08T10:54:53.272432+0000","last_fullsized":"2024-05-08T10:54:53.272432+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:50:37.863580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.271957+0000","last_change":"2024-05-08T10:54:50.547750+0000","last_active":"2024-05-08T10:54:53.271957+0000","last_peered":"2024-05-08T10:54:53.271957+0000","last_clean":"2024-05-08T10:54:53.271957+0000","last_became_active":"2024-05-08T10:54:50.547492+0000","last_became_peered":"2024-05-08T10:54:50.547492+0000","last_unstale":"2024-05-08T10:54:53.271957+0000","last_undegraded":"2024-05-08T10:54:53.271957+0000","last_fullsized":"2024-05-08T10:54:53.271957+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:06:27.967756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272070+0000","last_change":"2024-05-08T10:54:50.547741+0000","last_active":"2024-05-08T10:54:53.272070+0000","last_peered":"2024-05-08T10:54:53.272070+0000","last_clean":"2024-05-08T10:54:53.272070+0000","last_became_active":"2024-05-08T10:54:50.547475+0000","last_became_peered":"2024-05-08T10:54:50.547475+0000","last_unstale":"2024-05-08T10:54:53.272070+0000","last_undegraded":"2024-05-08T10:54:53.272070+0000","last_fullsized":"2024-05-08T10:54:53.272070+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:17:39.617660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272323+0000","last_change":"2024-05-08T10:54:50.546236+0000","last_active":"2024-05-08T10:54:53.272323+0000","last_peered":"2024-05-08T10:54:53.272323+0000","last_clean":"2024-05-08T10:54:53.272323+0000","last_became_active":"2024-05-08T10:54:50.545968+0000","last_became_peered":"2024-05-08T10:54:50.545968+0000","last_unstale":"2024-05-08T10:54:53.272323+0000","last_undegraded":"2024-05-08T10:54:53.272323+0000","last_fullsized":"2024-05-08T10:54:53.272323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:17:39.617660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.539559+0000","last_change":"2024-05-08T10:54:50.532358+0000","last_active":"2024-05-08T10:54:51.539559+0000","last_peered":"2024-05-08T10:54:51.539559+0000","last_clean":"2024-05-08T10:54:51.539559+0000","last_became_active":"2024-05-08T10:54:50.532084+0000","last_became_peered":"2024-05-08T10:54:50.532084+0000","last_unstale":"2024-05-08T10:54:51.539559+0000","last_undegraded":"2024-05-08T10:54:51.539559+0000","last_fullsized":"2024-05-08T10:54:51.539559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:40:14.037116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.536825+0000","last_change":"2024-05-08T10:54:50.542677+0000","last_active":"2024-05-08T10:54:51.536825+0000","last_peered":"2024-05-08T10:54:51.536825+0000","last_clean":"2024-05-08T10:54:51.536825+0000","last_became_active":"2024-05-08T10:54:50.542364+0000","last_became_peered":"2024-05-08T10:54:50.542364+0000","last_unstale":"2024-05-08T10:54:51.536825+0000","last_undegraded":"2024-05-08T10:54:51.536825+0000","last_fullsized":"2024-05-08T10:54:51.536825+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:27:46.730550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272321+0000","last_change":"2024-05-08T10:54:50.546906+0000","last_active":"2024-05-08T10:54:53.272321+0000","last_peered":"2024-05-08T10:54:53.272321+0000","last_clean":"2024-05-08T10:54:53.272321+0000","last_became_active":"2024-05-08T10:54:50.546627+0000","last_became_peered":"2024-05-08T10:54:50.546627+0000","last_unstale":"2024-05-08T10:54:53.272321+0000","last_undegraded":"2024-05-08T10:54:53.272321+0000","last_fullsized":"2024-05-08T10:54:53.272321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:27:46.730550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.271948+0000","last_change":"2024-05-08T10:54:50.552062+0000","last_active":"2024-05-08T10:54:53.271948+0000","last_peered":"2024-05-08T10:54:53.271948+0000","last_clean":"2024-05-08T10:54:53.271948+0000","last_became_active":"2024-05-08T10:54:50.550966+0000","last_became_peered":"2024-05-08T10:54:50.550966+0000","last_unstale":"2024-05-08T10:54:53.271948+0000","last_undegraded":"2024-05-08T10:54:53.271948+0000","last_fullsized":"2024-05-08T10:54:53.271948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:07:03.513132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272358+0000","last_change":"2024-05-08T10:54:50.550884+0000","last_active":"2024-05-08T10:54:53.272358+0000","last_peered":"2024-05-08T10:54:53.272358+0000","last_clean":"2024-05-08T10:54:53.272358+0000","last_became_active":"2024-05-08T10:54:50.550437+0000","last_became_peered":"2024-05-08T10:54:50.550437+0000","last_unstale":"2024-05-08T10:54:53.272358+0000","last_undegraded":"2024-05-08T10:54:53.272358+0000","last_fullsized":"2024-05-08T10:54:53.272358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:14:08.876280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:52.206355+0000","last_change":"2024-05-08T10:54:50.537512+0000","last_active":"2024-05-08T10:54:52.206355+0000","last_peered":"2024-05-08T10:54:52.206355+0000","last_clean":"2024-05-08T10:54:52.206355+0000","last_became_active":"2024-05-08T10:54:50.537214+0000","last_became_peered":"2024-05-08T10:54:50.537214+0000","last_unstale":"2024-05-08T10:54:52.206355+0000","last_undegraded":"2024-05-08T10:54:52.206355+0000","last_fullsized":"2024-05-08T10:54:52.206355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:31:55.776210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.538582+0000","last_change":"2024-05-08T10:54:50.544340+0000","last_active":"2024-05-08T10:54:51.538582+0000","last_peered":"2024-05-08T10:54:51.538582+0000","last_clean":"2024-05-08T10:54:51.538582+0000","last_became_active":"2024-05-08T10:54:50.544072+0000","last_became_peered":"2024-05-08T10:54:50.544072+0000","last_unstale":"2024-05-08T10:54:51.538582+0000","last_undegraded":"2024-05-08T10:54:51.538582+0000","last_fullsized":"2024-05-08T10:54:51.538582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:07:03.513132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.539220+0000","last_change":"2024-05-08T10:54:50.532176+0000","last_active":"2024-05-08T10:54:51.539220+0000","last_peered":"2024-05-08T10:54:51.539220+0000","last_clean":"2024-05-08T10:54:51.539220+0000","last_became_active":"2024-05-08T10:54:50.531846+0000","last_became_peered":"2024-05-08T10:54:50.531846+0000","last_unstale":"2024-05-08T10:54:51.539220+0000","last_undegraded":"2024-05-08T10:54:51.539220+0000","last_fullsized":"2024-05-08T10:54:51.539220+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:07:13.589112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272439+0000","last_change":"2024-05-08T10:54:49.539056+0000","last_active":"2024-05-08T10:54:53.272439+0000","last_peered":"2024-05-08T10:54:53.272439+0000","last_clean":"2024-05-08T10:54:53.272439+0000","last_became_active":"2024-05-08T10:54:49.538788+0000","last_became_peered":"2024-05-08T10:54:49.538788+0000","last_unstale":"2024-05-08T10:54:53.272439+0000","last_undegraded":"2024-05-08T10:54:53.272439+0000","last_fullsized":"2024-05-08T10:54:53.272439+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:21:53.697233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272029+0000","last_change":"2024-05-08T10:54:50.536315+0000","last_active":"2024-05-08T10:54:53.272029+0000","last_peered":"2024-05-08T10:54:53.272029+0000","last_clean":"2024-05-08T10:54:53.272029+0000","last_became_active":"2024-05-08T10:54:50.536003+0000","last_became_peered":"2024-05-08T10:54:50.536003+0000","last_unstale":"2024-05-08T10:54:53.272029+0000","last_undegraded":"2024-05-08T10:54:53.272029+0000","last_fullsized":"2024-05-08T10:54:53.272029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:12:04.365598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.539075+0000","last_change":"2024-05-08T10:54:49.530966+0000","last_active":"2024-05-08T10:54:51.539075+0000","last_peered":"2024-05-08T10:54:51.539075+0000","last_clean":"2024-05-08T10:54:51.539075+0000","last_became_active":"2024-05-08T10:54:49.530656+0000","last_became_peered":"2024-05-08T10:54:49.530656+0000","last_unstale":"2024-05-08T10:54:51.539075+0000","last_undegraded":"2024-05-08T10:54:51.539075+0000","last_fullsized":"2024-05-08T10:54:51.539075+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:00:52.746134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272492+0000","last_change":"2024-05-08T10:54:49.536057+0000","last_active":"2024-05-08T10:54:53.272492+0000","last_peered":"2024-05-08T10:54:53.272492+0000","last_clean":"2024-05-08T10:54:53.272492+0000","last_became_active":"2024-05-08T10:54:49.535697+0000","last_became_peered":"2024-05-08T10:54:49.535697+0000","last_unstale":"2024-05-08T10:54:53.272492+0000","last_undegraded":"2024-05-08T10:54:53.272492+0000","last_fullsized":"2024-05-08T10:54:53.272492+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:50:17.425844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.271904+0000","last_change":"2024-05-08T10:54:50.551282+0000","last_active":"2024-05-08T10:54:53.271904+0000","last_peered":"2024-05-08T10:54:53.271904+0000","last_clean":"2024-05-08T10:54:53.271904+0000","last_became_active":"2024-05-08T10:54:50.550992+0000","last_became_peered":"2024-05-08T10:54:50.550992+0000","last_unstale":"2024-05-08T10:54:53.271904+0000","last_undegraded":"2024-05-08T10:54:53.271904+0000","last_fullsized":"2024-05-08T10:54:53.271904+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:07:03.513132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272265+0000","last_change":"2024-05-08T10:54:49.533211+0000","last_active":"2024-05-08T10:54:53.272265+0000","last_peered":"2024-05-08T10:54:53.272265+0000","last_clean":"2024-05-08T10:54:53.272265+0000","last_became_active":"2024-05-08T10:54:49.532870+0000","last_became_peered":"2024-05-08T10:54:49.532870+0000","last_unstale":"2024-05-08T10:54:53.272265+0000","last_undegraded":"2024-05-08T10:54:53.272265+0000","last_fullsized":"2024-05-08T10:54:53.272265+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:04:27.826613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.536597+0000","last_change":"2024-05-08T10:54:50.549669+0000","last_active":"2024-05-08T10:54:51.536597+0000","last_peered":"2024-05-08T10:54:51.536597+0000","last_clean":"2024-05-08T10:54:51.536597+0000","last_became_active":"2024-05-08T10:54:50.549148+0000","last_became_peered":"2024-05-08T10:54:50.549148+0000","last_unstale":"2024-05-08T10:54:51.536597+0000","last_undegraded":"2024-05-08T10:54:51.536597+0000","last_fullsized":"2024-05-08T10:54:51.536597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:07:03.513132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.538726+0000","last_change":"2024-05-08T10:54:49.534750+0000","last_active":"2024-05-08T10:54:51.538726+0000","last_peered":"2024-05-08T10:54:51.538726+0000","last_clean":"2024-05-08T10:54:51.538726+0000","last_became_active":"2024-05-08T10:54:49.534448+0000","last_became_peered":"2024-05-08T10:54:49.534448+0000","last_unstale":"2024-05-08T10:54:51.538726+0000","last_undegraded":"2024-05-08T10:54:51.538726+0000","last_fullsized":"2024-05-08T10:54:51.538726+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:35:21.510783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272387+0000","last_change":"2024-05-08T10:54:50.542813+0000","last_active":"2024-05-08T10:54:53.272387+0000","last_peered":"2024-05-08T10:54:53.272387+0000","last_clean":"2024-05-08T10:54:53.272387+0000","last_became_active":"2024-05-08T10:54:50.542521+0000","last_became_peered":"2024-05-08T10:54:50.542521+0000","last_unstale":"2024-05-08T10:54:53.272387+0000","last_undegraded":"2024-05-08T10:54:53.272387+0000","last_fullsized":"2024-05-08T10:54:53.272387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:20:08.620180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272450+0000","last_change":"2024-05-08T10:54:49.534807+0000","last_active":"2024-05-08T10:54:53.272450+0000","last_peered":"2024-05-08T10:54:53.272450+0000","last_clean":"2024-05-08T10:54:53.272450+0000","last_became_active":"2024-05-08T10:54:49.534525+0000","last_became_peered":"2024-05-08T10:54:49.534525+0000","last_unstale":"2024-05-08T10:54:53.272450+0000","last_undegraded":"2024-05-08T10:54:53.272450+0000","last_fullsized":"2024-05-08T10:54:53.272450+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:07:12.581426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272500+0000","last_change":"2024-05-08T10:54:50.549738+0000","last_active":"2024-05-08T10:54:53.272500+0000","last_peered":"2024-05-08T10:54:53.272500+0000","last_clean":"2024-05-08T10:54:53.272500+0000","last_became_active":"2024-05-08T10:54:50.548425+0000","last_became_peered":"2024-05-08T10:54:50.548425+0000","last_unstale":"2024-05-08T10:54:53.272500+0000","last_undegraded":"2024-05-08T10:54:53.272500+0000","last_fullsized":"2024-05-08T10:54:53.272500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:17:39.617660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.536748+0000","last_change":"2024-05-08T10:54:49.540157+0000","last_active":"2024-05-08T10:54:51.536748+0000","last_peered":"2024-05-08T10:54:51.536748+0000","last_clean":"2024-05-08T10:54:51.536748+0000","last_became_active":"2024-05-08T10:54:49.539852+0000","last_became_peered":"2024-05-08T10:54:49.539852+0000","last_unstale":"2024-05-08T10:54:51.536748+0000","last_undegraded":"2024-05-08T10:54:51.536748+0000","last_fullsized":"2024-05-08T10:54:51.536748+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:00:52.746134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.539495+0000","last_change":"2024-05-08T10:54:50.534438+0000","last_active":"2024-05-08T10:54:51.539495+0000","last_peered":"2024-05-08T10:54:51.539495+0000","last_clean":"2024-05-08T10:54:51.539495+0000","last_became_active":"2024-05-08T10:54:50.533971+0000","last_became_peered":"2024-05-08T10:54:50.533971+0000","last_unstale":"2024-05-08T10:54:51.539495+0000","last_undegraded":"2024-05-08T10:54:51.539495+0000","last_fullsized":"2024-05-08T10:54:51.539495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:06.987968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.539367+0000","last_change":"2024-05-08T10:54:49.531309+0000","last_active":"2024-05-08T10:54:51.539367+0000","last_peered":"2024-05-08T10:54:51.539367+0000","last_clean":"2024-05-08T10:54:51.539367+0000","last_became_active":"2024-05-08T10:54:49.530442+0000","last_became_peered":"2024-05-08T10:54:49.530442+0000","last_unstale":"2024-05-08T10:54:51.539367+0000","last_undegraded":"2024-05-08T10:54:51.539367+0000","last_fullsized":"2024-05-08T10:54:51.539367+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:07:12.581426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.623854+0000","last_change":"2024-05-08T10:54:50.549577+0000","last_active":"2024-05-08T10:54:51.623854+0000","last_peered":"2024-05-08T10:54:51.623854+0000","last_clean":"2024-05-08T10:54:51.623854+0000","last_became_active":"2024-05-08T10:54:50.549318+0000","last_became_peered":"2024-05-08T10:54:50.549318+0000","last_unstale":"2024-05-08T10:54:51.623854+0000","last_undegraded":"2024-05-08T10:54:51.623854+0000","last_fullsized":"2024-05-08T10:54:51.623854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:50:37.863580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272014+0000","last_change":"2024-05-08T10:54:49.534151+0000","last_active":"2024-05-08T10:54:53.272014+0000","last_peered":"2024-05-08T10:54:53.272014+0000","last_clean":"2024-05-08T10:54:53.272014+0000","last_became_active":"2024-05-08T10:54:49.533841+0000","last_became_peered":"2024-05-08T10:54:49.533841+0000","last_unstale":"2024-05-08T10:54:53.272014+0000","last_undegraded":"2024-05-08T10:54:53.272014+0000","last_fullsized":"2024-05-08T10:54:53.272014+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:43:52.839891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.271941+0000","last_change":"2024-05-08T10:54:50.539238+0000","last_active":"2024-05-08T10:54:53.271941+0000","last_peered":"2024-05-08T10:54:53.271941+0000","last_clean":"2024-05-08T10:54:53.271941+0000","last_became_active":"2024-05-08T10:54:50.538930+0000","last_became_peered":"2024-05-08T10:54:50.538930+0000","last_unstale":"2024-05-08T10:54:53.271941+0000","last_undegraded":"2024-05-08T10:54:53.271941+0000","last_fullsized":"2024-05-08T10:54:53.271941+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:46:10.084159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272450+0000","last_change":"2024-05-08T10:54:49.537048+0000","last_active":"2024-05-08T10:54:53.272450+0000","last_peered":"2024-05-08T10:54:53.272450+0000","last_clean":"2024-05-08T10:54:53.272450+0000","last_became_active":"2024-05-08T10:54:49.536620+0000","last_became_peered":"2024-05-08T10:54:49.536620+0000","last_unstale":"2024-05-08T10:54:53.272450+0000","last_undegraded":"2024-05-08T10:54:53.272450+0000","last_fullsized":"2024-05-08T10:54:53.272450+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:35:21.510783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.623897+0000","last_change":"2024-05-08T10:54:50.545019+0000","last_active":"2024-05-08T10:54:51.623897+0000","last_peered":"2024-05-08T10:54:51.623897+0000","last_clean":"2024-05-08T10:54:51.623897+0000","last_became_active":"2024-05-08T10:54:50.544710+0000","last_became_peered":"2024-05-08T10:54:50.544710+0000","last_unstale":"2024-05-08T10:54:51.623897+0000","last_undegraded":"2024-05-08T10:54:51.623897+0000","last_fullsized":"2024-05-08T10:54:51.623897+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:08:48.409546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.538557+0000","last_change":"2024-05-08T10:54:49.531681+0000","last_active":"2024-05-08T10:54:51.538557+0000","last_peered":"2024-05-08T10:54:51.538557+0000","last_clean":"2024-05-08T10:54:51.538557+0000","last_became_active":"2024-05-08T10:54:49.531120+0000","last_became_peered":"2024-05-08T10:54:49.531120+0000","last_unstale":"2024-05-08T10:54:51.538557+0000","last_undegraded":"2024-05-08T10:54:51.538557+0000","last_fullsized":"2024-05-08T10:54:51.538557+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:41:42.237766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.538783+0000","last_change":"2024-05-08T10:54:50.544975+0000","last_active":"2024-05-08T10:54:51.538783+0000","last_peered":"2024-05-08T10:54:51.538783+0000","last_clean":"2024-05-08T10:54:51.538783+0000","last_became_active":"2024-05-08T10:54:50.544731+0000","last_became_peered":"2024-05-08T10:54:50.544731+0000","last_unstale":"2024-05-08T10:54:51.538783+0000","last_undegraded":"2024-05-08T10:54:51.538783+0000","last_fullsized":"2024-05-08T10:54:51.538783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:06:27.967756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:52.206041+0000","last_change":"2024-05-08T10:54:49.531598+0000","last_active":"2024-05-08T10:54:52.206041+0000","last_peered":"2024-05-08T10:54:52.206041+0000","last_clean":"2024-05-08T10:54:52.206041+0000","last_became_active":"2024-05-08T10:54:49.531288+0000","last_became_peered":"2024-05-08T10:54:49.531288+0000","last_unstale":"2024-05-08T10:54:52.206041+0000","last_undegraded":"2024-05-08T10:54:52.206041+0000","last_fullsized":"2024-05-08T10:54:52.206041+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:04:27.826613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.623671+0000","last_change":"2024-05-08T10:54:50.543982+0000","last_active":"2024-05-08T10:54:51.623671+0000","last_peered":"2024-05-08T10:54:51.623671+0000","last_clean":"2024-05-08T10:54:51.623671+0000","last_became_active":"2024-05-08T10:54:50.543721+0000","last_became_peered":"2024-05-08T10:54:50.543721+0000","last_unstale":"2024-05-08T10:54:51.623671+0000","last_undegraded":"2024-05-08T10:54:51.623671+0000","last_fullsized":"2024-05-08T10:54:51.623671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:34:17.184122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.538712+0000","last_change":"2024-05-08T10:54:49.535555+0000","last_active":"2024-05-08T10:54:51.538712+0000","last_peered":"2024-05-08T10:54:51.538712+0000","last_clean":"2024-05-08T10:54:51.538712+0000","last_became_active":"2024-05-08T10:54:49.535171+0000","last_became_peered":"2024-05-08T10:54:49.535171+0000","last_unstale":"2024-05-08T10:54:51.538712+0000","last_undegraded":"2024-05-08T10:54:51.538712+0000","last_fullsized":"2024-05-08T10:54:51.538712+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:45:13.454727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.623934+0000","last_change":"2024-05-08T10:54:50.547853+0000","last_active":"2024-05-08T10:54:51.623934+0000","last_peered":"2024-05-08T10:54:51.623934+0000","last_clean":"2024-05-08T10:54:51.623934+0000","last_became_active":"2024-05-08T10:54:50.547647+0000","last_became_peered":"2024-05-08T10:54:50.547647+0000","last_unstale":"2024-05-08T10:54:51.623934+0000","last_undegraded":"2024-05-08T10:54:51.623934+0000","last_fullsized":"2024-05-08T10:54:51.623934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:41:02.815763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:52.206276+0000","last_change":"2024-05-08T10:54:49.528935+0000","last_active":"2024-05-08T10:54:52.206276+0000","last_peered":"2024-05-08T10:54:52.206276+0000","last_clean":"2024-05-08T10:54:52.206276+0000","last_became_active":"2024-05-08T10:54:49.528373+0000","last_became_peered":"2024-05-08T10:54:49.528373+0000","last_unstale":"2024-05-08T10:54:52.206276+0000","last_undegraded":"2024-05-08T10:54:52.206276+0000","last_fullsized":"2024-05-08T10:54:52.206276+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:41:42.237766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.624161+0000","last_change":"2024-05-08T10:54:50.548188+0000","last_active":"2024-05-08T10:54:51.624161+0000","last_peered":"2024-05-08T10:54:51.624161+0000","last_clean":"2024-05-08T10:54:51.624161+0000","last_became_active":"2024-05-08T10:54:50.547738+0000","last_became_peered":"2024-05-08T10:54:50.547738+0000","last_unstale":"2024-05-08T10:54:51.624161+0000","last_undegraded":"2024-05-08T10:54:51.624161+0000","last_fullsized":"2024-05-08T10:54:51.624161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:27:33.078243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.536866+0000","last_change":"2024-05-08T10:54:49.539756+0000","last_active":"2024-05-08T10:54:51.536866+0000","last_peered":"2024-05-08T10:54:51.536866+0000","last_clean":"2024-05-08T10:54:51.536866+0000","last_became_active":"2024-05-08T10:54:49.539459+0000","last_became_peered":"2024-05-08T10:54:49.539459+0000","last_unstale":"2024-05-08T10:54:51.536866+0000","last_undegraded":"2024-05-08T10:54:51.536866+0000","last_fullsized":"2024-05-08T10:54:51.536866+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:40:16.322062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272509+0000","last_change":"2024-05-08T10:54:50.550681+0000","last_active":"2024-05-08T10:54:53.272509+0000","last_peered":"2024-05-08T10:54:53.272509+0000","last_clean":"2024-05-08T10:54:53.272509+0000","last_became_active":"2024-05-08T10:54:50.550395+0000","last_became_peered":"2024-05-08T10:54:50.550395+0000","last_unstale":"2024-05-08T10:54:53.272509+0000","last_undegraded":"2024-05-08T10:54:53.272509+0000","last_fullsized":"2024-05-08T10:54:53.272509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:08:48.409546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:52.206093+0000","last_change":"2024-05-08T10:54:49.534684+0000","last_active":"2024-05-08T10:54:52.206093+0000","last_peered":"2024-05-08T10:54:52.206093+0000","last_clean":"2024-05-08T10:54:52.206093+0000","last_became_active":"2024-05-08T10:54:49.534333+0000","last_became_peered":"2024-05-08T10:54:49.534333+0000","last_unstale":"2024-05-08T10:54:52.206093+0000","last_undegraded":"2024-05-08T10:54:52.206093+0000","last_fullsized":"2024-05-08T10:54:52.206093+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:07:12.581426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.623842+0000","last_change":"2024-05-08T10:54:50.541378+0000","last_active":"2024-05-08T10:54:51.623842+0000","last_peered":"2024-05-08T10:54:51.623842+0000","last_clean":"2024-05-08T10:54:51.623842+0000","last_became_active":"2024-05-08T10:54:50.540987+0000","last_became_peered":"2024-05-08T10:54:50.540987+0000","last_unstale":"2024-05-08T10:54:51.623842+0000","last_undegraded":"2024-05-08T10:54:51.623842+0000","last_fullsized":"2024-05-08T10:54:51.623842+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:20:08.620180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.623580+0000","last_change":"2024-05-08T10:54:40.015226+0000","last_active":"2024-05-08T10:54:51.623580+0000","last_peered":"2024-05-08T10:54:51.623580+0000","last_clean":"2024-05-08T10:54:51.623580+0000","last_became_active":"2024-05-08T10:54:40.014219+0000","last_became_peered":"2024-05-08T10:54:40.014219+0000","last_unstale":"2024-05-08T10:54:51.623580+0000","last_undegraded":"2024-05-08T10:54:51.623580+0000","last_fullsized":"2024-05-08T10:54:51.623580+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:38.989328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:38.989328+0000","last_clean_scrub_stamp":"2024-05-08T10:54:38.989328+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:10:59.668786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.271967+0000","last_change":"2024-05-08T10:54:49.534493+0000","last_active":"2024-05-08T10:54:53.271967+0000","last_peered":"2024-05-08T10:54:53.271967+0000","last_clean":"2024-05-08T10:54:53.271967+0000","last_became_active":"2024-05-08T10:54:49.533772+0000","last_became_peered":"2024-05-08T10:54:49.533772+0000","last_unstale":"2024-05-08T10:54:53.271967+0000","last_undegraded":"2024-05-08T10:54:53.271967+0000","last_fullsized":"2024-05-08T10:54:53.271967+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:41:42.237766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272465+0000","last_change":"2024-05-08T10:54:50.553323+0000","last_active":"2024-05-08T10:54:53.272465+0000","last_peered":"2024-05-08T10:54:53.272465+0000","last_clean":"2024-05-08T10:54:53.272465+0000","last_became_active":"2024-05-08T10:54:50.553046+0000","last_became_peered":"2024-05-08T10:54:50.553046+0000","last_unstale":"2024-05-08T10:54:53.272465+0000","last_undegraded":"2024-05-08T10:54:53.272465+0000","last_fullsized":"2024-05-08T10:54:53.272465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:26:24.924440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.623468+0000","last_change":"2024-05-08T10:54:49.537291+0000","last_active":"2024-05-08T10:54:51.623468+0000","last_peered":"2024-05-08T10:54:51.623468+0000","last_clean":"2024-05-08T10:54:51.623468+0000","last_became_active":"2024-05-08T10:54:49.537026+0000","last_became_peered":"2024-05-08T10:54:49.537026+0000","last_unstale":"2024-05-08T10:54:51.623468+0000","last_undegraded":"2024-05-08T10:54:51.623468+0000","last_fullsized":"2024-05-08T10:54:51.623468+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:35:21.510783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.271682+0000","last_change":"2024-05-08T10:54:50.536808+0000","last_active":"2024-05-08T10:54:53.271682+0000","last_peered":"2024-05-08T10:54:53.271682+0000","last_clean":"2024-05-08T10:54:53.271682+0000","last_became_active":"2024-05-08T10:54:50.536502+0000","last_became_peered":"2024-05-08T10:54:50.536502+0000","last_unstale":"2024-05-08T10:54:53.271682+0000","last_undegraded":"2024-05-08T10:54:53.271682+0000","last_fullsized":"2024-05-08T10:54:53.271682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:08:05.567837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:52.206181+0000","last_change":"2024-05-08T10:54:49.536613+0000","last_active":"2024-05-08T10:54:52.206181+0000","last_peered":"2024-05-08T10:54:52.206181+0000","last_clean":"2024-05-08T10:54:52.206181+0000","last_became_active":"2024-05-08T10:54:49.536290+0000","last_became_peered":"2024-05-08T10:54:49.536290+0000","last_unstale":"2024-05-08T10:54:52.206181+0000","last_undegraded":"2024-05-08T10:54:52.206181+0000","last_fullsized":"2024-05-08T10:54:52.206181+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:50:17.425844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.536784+0000","last_change":"2024-05-08T10:54:50.539387+0000","last_active":"2024-05-08T10:54:51.536784+0000","last_peered":"2024-05-08T10:54:51.536784+0000","last_clean":"2024-05-08T10:54:51.536784+0000","last_became_active":"2024-05-08T10:54:50.539070+0000","last_became_peered":"2024-05-08T10:54:50.539070+0000","last_unstale":"2024-05-08T10:54:51.536784+0000","last_undegraded":"2024-05-08T10:54:51.536784+0000","last_fullsized":"2024-05-08T10:54:51.536784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:12:04.365598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272501+0000","last_change":"2024-05-08T10:54:49.537472+0000","last_active":"2024-05-08T10:54:53.272501+0000","last_peered":"2024-05-08T10:54:53.272501+0000","last_clean":"2024-05-08T10:54:53.272501+0000","last_became_active":"2024-05-08T10:54:49.537140+0000","last_became_peered":"2024-05-08T10:54:49.537140+0000","last_unstale":"2024-05-08T10:54:53.272501+0000","last_undegraded":"2024-05-08T10:54:53.272501+0000","last_fullsized":"2024-05-08T10:54:53.272501+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:00:52.746134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.539458+0000","last_change":"2024-05-08T10:54:50.540453+0000","last_active":"2024-05-08T10:54:51.539458+0000","last_peered":"2024-05-08T10:54:51.539458+0000","last_clean":"2024-05-08T10:54:51.539458+0000","last_became_active":"2024-05-08T10:54:50.540200+0000","last_became_peered":"2024-05-08T10:54:50.540200+0000","last_unstale":"2024-05-08T10:54:51.539458+0000","last_undegraded":"2024-05-08T10:54:51.539458+0000","last_fullsized":"2024-05-08T10:54:51.539458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:40:17.329748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.536732+0000","last_change":"2024-05-08T10:54:49.536666+0000","last_active":"2024-05-08T10:54:51.536732+0000","last_peered":"2024-05-08T10:54:51.536732+0000","last_clean":"2024-05-08T10:54:51.536732+0000","last_became_active":"2024-05-08T10:54:49.536210+0000","last_became_peered":"2024-05-08T10:54:49.536210+0000","last_unstale":"2024-05-08T10:54:51.536732+0000","last_undegraded":"2024-05-08T10:54:51.536732+0000","last_fullsized":"2024-05-08T10:54:51.536732+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:07:12.581426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272494+0000","last_change":"2024-05-08T10:54:50.549051+0000","last_active":"2024-05-08T10:54:53.272494+0000","last_peered":"2024-05-08T10:54:53.272494+0000","last_clean":"2024-05-08T10:54:53.272494+0000","last_became_active":"2024-05-08T10:54:50.548723+0000","last_became_peered":"2024-05-08T10:54:50.548723+0000","last_unstale":"2024-05-08T10:54:53.272494+0000","last_undegraded":"2024-05-08T10:54:53.272494+0000","last_fullsized":"2024-05-08T10:54:53.272494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:41:02.815763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.624047+0000","last_change":"2024-05-08T10:54:49.538497+0000","last_active":"2024-05-08T10:54:51.624047+0000","last_peered":"2024-05-08T10:54:51.624047+0000","last_clean":"2024-05-08T10:54:51.624047+0000","last_became_active":"2024-05-08T10:54:49.537819+0000","last_became_peered":"2024-05-08T10:54:49.537819+0000","last_unstale":"2024-05-08T10:54:51.624047+0000","last_undegraded":"2024-05-08T10:54:51.624047+0000","last_fullsized":"2024-05-08T10:54:51.624047+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:31:54.768524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.536801+0000","last_change":"2024-05-08T10:54:50.533885+0000","last_active":"2024-05-08T10:54:51.536801+0000","last_peered":"2024-05-08T10:54:51.536801+0000","last_clean":"2024-05-08T10:54:51.536801+0000","last_became_active":"2024-05-08T10:54:50.533569+0000","last_became_peered":"2024-05-08T10:54:50.533569+0000","last_unstale":"2024-05-08T10:54:51.536801+0000","last_undegraded":"2024-05-08T10:54:51.536801+0000","last_fullsized":"2024-05-08T10:54:51.536801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:43:52.788984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.536965+0000","last_change":"2024-05-08T10:54:49.533336+0000","last_active":"2024-05-08T10:54:51.536965+0000","last_peered":"2024-05-08T10:54:51.536965+0000","last_clean":"2024-05-08T10:54:51.536965+0000","last_became_active":"2024-05-08T10:54:49.533024+0000","last_became_peered":"2024-05-08T10:54:49.533024+0000","last_unstale":"2024-05-08T10:54:51.536965+0000","last_undegraded":"2024-05-08T10:54:51.536965+0000","last_fullsized":"2024-05-08T10:54:51.536965+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:04:27.826613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272492+0000","last_change":"2024-05-08T10:54:50.544364+0000","last_active":"2024-05-08T10:54:53.272492+0000","last_peered":"2024-05-08T10:54:53.272492+0000","last_clean":"2024-05-08T10:54:53.272492+0000","last_became_active":"2024-05-08T10:54:50.544015+0000","last_became_peered":"2024-05-08T10:54:50.544015+0000","last_unstale":"2024-05-08T10:54:53.272492+0000","last_undegraded":"2024-05-08T10:54:53.272492+0000","last_fullsized":"2024-05-08T10:54:53.272492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:34:17.184122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.538820+0000","last_change":"2024-05-08T10:54:49.538628+0000","last_active":"2024-05-08T10:54:51.538820+0000","last_peered":"2024-05-08T10:54:51.538820+0000","last_clean":"2024-05-08T10:54:51.538820+0000","last_became_active":"2024-05-08T10:54:49.538328+0000","last_became_peered":"2024-05-08T10:54:49.538328+0000","last_unstale":"2024-05-08T10:54:51.538820+0000","last_undegraded":"2024-05-08T10:54:51.538820+0000","last_fullsized":"2024-05-08T10:54:51.538820+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:04:27.826613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272243+0000","last_change":"2024-05-08T10:54:50.542376+0000","last_active":"2024-05-08T10:54:53.272243+0000","last_peered":"2024-05-08T10:54:53.272243+0000","last_clean":"2024-05-08T10:54:53.272243+0000","last_became_active":"2024-05-08T10:54:50.541231+0000","last_became_peered":"2024-05-08T10:54:50.541231+0000","last_unstale":"2024-05-08T10:54:53.272243+0000","last_undegraded":"2024-05-08T10:54:53.272243+0000","last_fullsized":"2024-05-08T10:54:53.272243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:43:52.788984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.623466+0000","last_change":"2024-05-08T10:54:49.538203+0000","last_active":"2024-05-08T10:54:51.623466+0000","last_peered":"2024-05-08T10:54:51.623466+0000","last_clean":"2024-05-08T10:54:51.623466+0000","last_became_active":"2024-05-08T10:54:49.537722+0000","last_became_peered":"2024-05-08T10:54:49.537722+0000","last_unstale":"2024-05-08T10:54:51.623466+0000","last_undegraded":"2024-05-08T10:54:51.623466+0000","last_fullsized":"2024-05-08T10:54:51.623466+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:07:12.581426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.539252+0000","last_change":"2024-05-08T10:54:50.535043+0000","last_active":"2024-05-08T10:54:51.539252+0000","last_peered":"2024-05-08T10:54:51.539252+0000","last_clean":"2024-05-08T10:54:51.539252+0000","last_became_active":"2024-05-08T10:54:50.534704+0000","last_became_peered":"2024-05-08T10:54:50.534704+0000","last_unstale":"2024-05-08T10:54:51.539252+0000","last_undegraded":"2024-05-08T10:54:51.539252+0000","last_fullsized":"2024-05-08T10:54:51.539252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:35:22.518469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.536641+0000","last_change":"2024-05-08T10:54:49.537497+0000","last_active":"2024-05-08T10:54:51.536641+0000","last_peered":"2024-05-08T10:54:51.536641+0000","last_clean":"2024-05-08T10:54:51.536641+0000","last_became_active":"2024-05-08T10:54:49.537216+0000","last_became_peered":"2024-05-08T10:54:49.537216+0000","last_unstale":"2024-05-08T10:54:51.536641+0000","last_undegraded":"2024-05-08T10:54:51.536641+0000","last_fullsized":"2024-05-08T10:54:51.536641+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:41:42.237766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272547+0000","last_change":"2024-05-08T10:54:50.544550+0000","last_active":"2024-05-08T10:54:53.272547+0000","last_peered":"2024-05-08T10:54:53.272547+0000","last_clean":"2024-05-08T10:54:53.272547+0000","last_became_active":"2024-05-08T10:54:50.544247+0000","last_became_peered":"2024-05-08T10:54:50.544247+0000","last_unstale":"2024-05-08T10:54:53.272547+0000","last_undegraded":"2024-05-08T10:54:53.272547+0000","last_fullsized":"2024-05-08T10:54:53.272547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:14:08.876280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.536662+0000","last_change":"2024-05-08T10:54:49.537032+0000","last_active":"2024-05-08T10:54:51.536662+0000","last_peered":"2024-05-08T10:54:51.536662+0000","last_clean":"2024-05-08T10:54:51.536662+0000","last_became_active":"2024-05-08T10:54:49.536742+0000","last_became_peered":"2024-05-08T10:54:49.536742+0000","last_unstale":"2024-05-08T10:54:51.536662+0000","last_undegraded":"2024-05-08T10:54:51.536662+0000","last_fullsized":"2024-05-08T10:54:51.536662+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:35:21.510783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272404+0000","last_change":"2024-05-08T10:54:50.551614+0000","last_active":"2024-05-08T10:54:53.272404+0000","last_peered":"2024-05-08T10:54:53.272404+0000","last_clean":"2024-05-08T10:54:53.272404+0000","last_became_active":"2024-05-08T10:54:50.551296+0000","last_became_peered":"2024-05-08T10:54:50.551296+0000","last_unstale":"2024-05-08T10:54:53.272404+0000","last_undegraded":"2024-05-08T10:54:53.272404+0000","last_fullsized":"2024-05-08T10:54:53.272404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:40:14.037116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.623924+0000","last_change":"2024-05-08T10:54:49.538259+0000","last_active":"2024-05-08T10:54:51.623924+0000","last_peered":"2024-05-08T10:54:51.623924+0000","last_clean":"2024-05-08T10:54:51.623924+0000","last_became_active":"2024-05-08T10:54:49.537732+0000","last_became_peered":"2024-05-08T10:54:49.537732+0000","last_unstale":"2024-05-08T10:54:51.623924+0000","last_undegraded":"2024-05-08T10:54:51.623924+0000","last_fullsized":"2024-05-08T10:54:51.623924+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:40:16.322062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.539024+0000","last_change":"2024-05-08T10:54:50.533790+0000","last_active":"2024-05-08T10:54:51.539024+0000","last_peered":"2024-05-08T10:54:51.539024+0000","last_clean":"2024-05-08T10:54:51.539024+0000","last_became_active":"2024-05-08T10:54:50.533500+0000","last_became_peered":"2024-05-08T10:54:50.533500+0000","last_unstale":"2024-05-08T10:54:51.539024+0000","last_undegraded":"2024-05-08T10:54:51.539024+0000","last_fullsized":"2024-05-08T10:54:51.539024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:43:52.788984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272457+0000","last_change":"2024-05-08T10:54:50.538173+0000","last_active":"2024-05-08T10:54:53.272457+0000","last_peered":"2024-05-08T10:54:53.272457+0000","last_clean":"2024-05-08T10:54:53.272457+0000","last_became_active":"2024-05-08T10:54:50.537276+0000","last_became_peered":"2024-05-08T10:54:50.537276+0000","last_unstale":"2024-05-08T10:54:53.272457+0000","last_undegraded":"2024-05-08T10:54:53.272457+0000","last_fullsized":"2024-05-08T10:54:53.272457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:28:49.416807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.623659+0000","last_change":"2024-05-08T10:54:49.537236+0000","last_active":"2024-05-08T10:54:51.623659+0000","last_peered":"2024-05-08T10:54:51.623659+0000","last_clean":"2024-05-08T10:54:51.623659+0000","last_became_active":"2024-05-08T10:54:49.536918+0000","last_became_peered":"2024-05-08T10:54:49.536918+0000","last_unstale":"2024-05-08T10:54:51.623659+0000","last_undegraded":"2024-05-08T10:54:51.623659+0000","last_fullsized":"2024-05-08T10:54:51.623659+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:00:52.746134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272163+0000","last_change":"2024-05-08T10:54:50.544921+0000","last_active":"2024-05-08T10:54:53.272163+0000","last_peered":"2024-05-08T10:54:53.272163+0000","last_clean":"2024-05-08T10:54:53.272163+0000","last_became_active":"2024-05-08T10:54:50.544572+0000","last_became_peered":"2024-05-08T10:54:50.544572+0000","last_unstale":"2024-05-08T10:54:53.272163+0000","last_undegraded":"2024-05-08T10:54:53.272163+0000","last_fullsized":"2024-05-08T10:54:53.272163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:26:24.924440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:51.623924+0000","last_change":"2024-05-08T10:54:49.538621+0000","last_active":"2024-05-08T10:54:51.623924+0000","last_peered":"2024-05-08T10:54:51.623924+0000","last_clean":"2024-05-08T10:54:51.623924+0000","last_became_active":"2024-05-08T10:54:49.537823+0000","last_became_peered":"2024-05-08T10:54:49.537823+0000","last_unstale":"2024-05-08T10:54:51.623924+0000","last_undegraded":"2024-05-08T10:54:51.623924+0000","last_fullsized":"2024-05-08T10:54:51.623924+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:05.980282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272301+0000","last_change":"2024-05-08T10:54:50.548758+0000","last_active":"2024-05-08T10:54:53.272301+0000","last_peered":"2024-05-08T10:54:53.272301+0000","last_clean":"2024-05-08T10:54:53.272301+0000","last_became_active":"2024-05-08T10:54:50.548012+0000","last_became_peered":"2024-05-08T10:54:50.548012+0000","last_unstale":"2024-05-08T10:54:53.272301+0000","last_undegraded":"2024-05-08T10:54:53.272301+0000","last_fullsized":"2024-05-08T10:54:53.272301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:27:46.730550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272385+0000","last_change":"2024-05-08T10:54:49.537987+0000","last_active":"2024-05-08T10:54:53.272385+0000","last_peered":"2024-05-08T10:54:53.272385+0000","last_clean":"2024-05-08T10:54:53.272385+0000","last_became_active":"2024-05-08T10:54:49.537700+0000","last_became_peered":"2024-05-08T10:54:49.537700+0000","last_unstale":"2024-05-08T10:54:53.272385+0000","last_undegraded":"2024-05-08T10:54:53.272385+0000","last_fullsized":"2024-05-08T10:54:53.272385+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:04:27.826613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272245+0000","last_change":"2024-05-08T10:54:50.545275+0000","last_active":"2024-05-08T10:54:53.272245+0000","last_peered":"2024-05-08T10:54:53.272245+0000","last_clean":"2024-05-08T10:54:53.272245+0000","last_became_active":"2024-05-08T10:54:50.544915+0000","last_became_peered":"2024-05-08T10:54:50.544915+0000","last_unstale":"2024-05-08T10:54:53.272245+0000","last_undegraded":"2024-05-08T10:54:53.272245+0000","last_fullsized":"2024-05-08T10:54:53.272245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:49.510210+0000","last_clean_scrub_stamp":"2024-05-08T10:54:49.510210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:12:04.365598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T10:54:53.272568+0000","last_change":"2024-05-08T10:54:49.540467+0000","last_active":"2024-05-08T10:54:53.272568+0000","last_peered":"2024-05-08T10:54:53.272568+0000","last_clean":"2024-05-08T10:54:53.272568+0000","last_became_active":"2024-05-08T10:54:49.540032+0000","last_became_peered":"2024-05-08T10:54:49.540032+0000","last_unstale":"2024-05-08T10:54:53.272568+0000","last_undegraded":"2024-05-08T10:54:53.272568+0000","last_fullsized":"2024-05-08T10:54:53.272568+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:48.502524+0000","last_clean_scrub_stamp":"2024-05-08T10:54:48.502524+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:21:53.697233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":661884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":71060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":661940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T10:55:04.066 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-08T10:55:04.067 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-05-08T10:55:04.067 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-05-08T10:55:04.067 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-08T10:55:04.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.176+0000 7f3de4c4a640 1 Processor -- start 2024-05-08T10:55:04.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.176+0000 7f3de4c4a640 1 -- start start 2024-05-08T10:55:04.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.177+0000 7f3de4c4a640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3de00d03c0 0x7f3de00d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:04.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.177+0000 7f3de4c4a640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f3de00cf0f0 0x7f3de00cf560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:04.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.177+0000 7f3de4c4a640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3de00cfaa0 con 0x7f3de00d07a0 2024-05-08T10:55:04.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.177+0000 7f3de4c4a640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3de00ce650 con 0x7f3de00cf0f0 2024-05-08T10:55:04.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.177+0000 7f3de4c4a640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3de00d1e60 con 0x7f3de00d03c0 2024-05-08T10:55:04.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.177+0000 7f3dddd9b640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f3de00d07a0 0x7f3de00b6990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:43632/0 (socket says 172.21.15.33:43632) 2024-05-08T10:55:04.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.177+0000 7f3dddd9b640 1 -- 172.21.15.33:0/3643214406 learned_addr learned my addr 172.21.15.33:0/3643214406 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-05-08T10:55:04.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.177+0000 7f3dde59c640 1 --2- 172.21.15.33:0/3643214406 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3de00d03c0 0x7f3de00d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:04.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.177+0000 7f3dded9d640 1 --2- 172.21.15.33:0/3643214406 >> v2:172.21.15.174:3300/0 conn(0x7f3de00cf0f0 0x7f3de00cf560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:04.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.177+0000 7f3ddd59a640 1 -- 172.21.15.33:0/3643214406 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 319536545 0 0) 0x7f3de00cfaa0 con 0x7f3de00d07a0 2024-05-08T10:55:04.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.177+0000 7f3ddd59a640 1 -- 172.21.15.33:0/3643214406 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3dc8003520 con 0x7f3de00d07a0 2024-05-08T10:55:04.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.178+0000 7f3dde59c640 1 -- 172.21.15.33:0/3643214406 >> v2:172.21.15.174:3300/0 conn(0x7f3de00cf0f0 msgr2=0x7f3de00cf560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:04.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.178+0000 7f3dde59c640 1 --2- 172.21.15.33:0/3643214406 >> v2:172.21.15.174:3300/0 conn(0x7f3de00cf0f0 0x7f3de00cf560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:04.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.178+0000 7f3dde59c640 1 -- 172.21.15.33:0/3643214406 >> v1:172.21.15.33:6789/0 conn(0x7f3de00d07a0 legacy=0x7f3de00b6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:04.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.178+0000 7f3dde59c640 1 -- 172.21.15.33:0/3643214406 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3de00b70a0 con 0x7f3de00d03c0 2024-05-08T10:55:04.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.178+0000 7f3dded9d640 1 --2- 172.21.15.33:0/3643214406 >> v2:172.21.15.174:3300/0 conn(0x7f3de00cf0f0 0x7f3de00cf560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T10:55:04.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.178+0000 7f3dde59c640 1 --2- 172.21.15.33:0/3643214406 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3de00d03c0 0x7f3de00d1920 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3dd00097a0 tx=0x7f3dd002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=82e08134b7058877 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:04.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.179+0000 7f3ddd59a640 1 -- 172.21.15.33:0/3643214406 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dd0037070 con 0x7f3de00d03c0 2024-05-08T10:55:04.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.179+0000 7f3ddd59a640 1 -- 172.21.15.33:0/3643214406 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dd0032440 con 0x7f3de00d03c0 2024-05-08T10:55:04.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.179+0000 7f3ddd59a640 1 -- 172.21.15.33:0/3643214406 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dd0032810 con 0x7f3de00d03c0 2024-05-08T10:55:04.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.179+0000 7f3de4c4a640 1 -- 172.21.15.33:0/3643214406 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3de00d03c0 msgr2=0x7f3de00d1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:04.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.179+0000 7f3de4c4a640 1 --2- 172.21.15.33:0/3643214406 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3de00d03c0 0x7f3de00d1920 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3dd00097a0 tx=0x7f3dd002a180 comp rx=0 tx=0).stop 2024-05-08T10:55:04.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.179+0000 7f3de4c4a640 1 -- 172.21.15.33:0/3643214406 shutdown_connections 2024-05-08T10:55:04.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.179+0000 7f3de4c4a640 1 --2- 172.21.15.33:0/3643214406 >> v2:172.21.15.174:3300/0 conn(0x7f3de00cf0f0 0x7f3de00cf560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:04.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.179+0000 7f3de4c4a640 1 --2- 172.21.15.33:0/3643214406 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3de00d03c0 0x7f3de00d1920 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:04.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.179+0000 7f3de4c4a640 1 -- 172.21.15.33:0/3643214406 >> 172.21.15.33:0/3643214406 conn(0x7f3de009ce90 msgr2=0x7f3de00d3b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:04.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.179+0000 7f3de4c4a640 1 -- 172.21.15.33:0/3643214406 shutdown_connections 2024-05-08T10:55:04.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.179+0000 7f3de4c4a640 1 -- 172.21.15.33:0/3643214406 wait complete. 2024-05-08T10:55:04.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.181+0000 7f3de4c4a640 1 Processor -- start 2024-05-08T10:55:04.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.181+0000 7f3de4c4a640 1 -- start start 2024-05-08T10:55:04.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.181+0000 7f3de4c4a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3de00cf0f0 0x7f3de0155710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:04.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.181+0000 7f3de4c4a640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3de00d03c0 0x7f3de015dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:04.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.181+0000 7f3de4c4a640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3de00d07a0 0x7f3de015f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:04.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.181+0000 7f3de4c4a640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3de00d4810 con 0x7f3de00cf0f0 2024-05-08T10:55:04.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.181+0000 7f3de4c4a640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3de00d4530 con 0x7f3de00d03c0 2024-05-08T10:55:04.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.181+0000 7f3de4c4a640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3de00ce8f0 con 0x7f3de00d07a0 2024-05-08T10:55:04.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.181+0000 7f3dde59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3de00cf0f0 0x7f3de0155710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:04.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.181+0000 7f3dde59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3de00cf0f0 0x7f3de0155710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37948/0 (socket says 172.21.15.33:37948) 2024-05-08T10:55:04.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.181+0000 7f3dde59c640 1 -- 172.21.15.33:0/2107822727 learned_addr learned my addr 172.21.15.33:0/2107822727 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:04.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.182+0000 7f3dded9d640 1 --2- 172.21.15.33:0/2107822727 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3de00d07a0 0x7f3de015f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:04.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.182+0000 7f3dddd9b640 1 --2- 172.21.15.33:0/2107822727 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3de00d03c0 0x7f3de015dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:04.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.182+0000 7f3dde59c640 1 -- 172.21.15.33:0/2107822727 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3de00d07a0 msgr2=0x7f3de015f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:04.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.182+0000 7f3dde59c640 1 --2- 172.21.15.33:0/2107822727 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3de00d07a0 0x7f3de015f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:04.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.182+0000 7f3dde59c640 1 -- 172.21.15.33:0/2107822727 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3de00d03c0 msgr2=0x7f3de015dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:04.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.182+0000 7f3dde59c640 1 --2- 172.21.15.33:0/2107822727 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3de00d03c0 0x7f3de015dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:04.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.182+0000 7f3dde59c640 1 -- 172.21.15.33:0/2107822727 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3de0155c50 con 0x7f3de00cf0f0 2024-05-08T10:55:04.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.182+0000 7f3dddd9b640 1 --2- 172.21.15.33:0/2107822727 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3de00d03c0 0x7f3de015dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:55:04.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.182+0000 7f3dde59c640 1 --2- 172.21.15.33:0/2107822727 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3de00cf0f0 0x7f3de0155710 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3dd0035040 tx=0x7f3dd00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:04.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.182+0000 7f3dceffd640 1 -- 172.21.15.33:0/2107822727 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dd0041030 con 0x7f3de00cf0f0 2024-05-08T10:55:04.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.182+0000 7f3dceffd640 1 -- 172.21.15.33:0/2107822727 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dd003d420 con 0x7f3de00cf0f0 2024-05-08T10:55:04.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.182+0000 7f3dceffd640 1 -- 172.21.15.33:0/2107822727 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dd0037040 con 0x7f3de00cf0f0 2024-05-08T10:55:04.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.182+0000 7f3de4c4a640 1 -- 172.21.15.33:0/2107822727 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3de0156260 con 0x7f3de00cf0f0 2024-05-08T10:55:04.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.182+0000 7f3de4c4a640 1 -- 172.21.15.33:0/2107822727 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3de0156820 con 0x7f3de00cf0f0 2024-05-08T10:55:04.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.183+0000 7f3de4c4a640 1 -- 172.21.15.33:0/2107822727 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3de0069d20 con 0x7f3de00cf0f0 2024-05-08T10:55:04.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.184+0000 7f3dceffd640 1 -- 172.21.15.33:0/2107822727 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3dd0044070 con 0x7f3de00cf0f0 2024-05-08T10:55:04.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.184+0000 7f3dceffd640 1 --2- 172.21.15.33:0/2107822727 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f3dc006b4d0 0x7f3dc006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:04.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.184+0000 7f3dceffd640 1 -- 172.21.15.33:0/2107822727 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3dd00aa7d0 con 0x7f3de00cf0f0 2024-05-08T10:55:04.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.184+0000 7f3dddd9b640 1 --2- 172.21.15.33:0/2107822727 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f3dc006b4d0 0x7f3dc006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:04.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.185+0000 7f3dddd9b640 1 --2- 172.21.15.33:0/2107822727 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f3dc006b4d0 0x7f3dc006d990 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3dd4007fd0 tx=0x7f3dd4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:04.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.188+0000 7f3dceffd640 1 -- 172.21.15.33:0/2107822727 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3dd0044e40 con 0x7f3de00cf0f0 2024-05-08T10:55:04.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.413+0000 7f3de4c4a640 1 -- 172.21.15.33:0/2107822727 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f3de00b9830 con 0x7f3de00cf0f0 2024-05-08T10:55:04.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.413+0000 7f3dceffd640 1 -- 172.21.15.33:0/2107822727 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f3dd0079780 con 0x7f3de00cf0f0 2024-05-08T10:55:04.410 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:55:04.410 INFO:teuthology.orchestra.run.smithi033.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-05-08T10:55:04.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.415+0000 7f3de4c4a640 1 -- 172.21.15.33:0/2107822727 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f3dc006b4d0 msgr2=0x7f3dc006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:04.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.415+0000 7f3de4c4a640 1 --2- 172.21.15.33:0/2107822727 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f3dc006b4d0 0x7f3dc006d990 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3dd4007fd0 tx=0x7f3dd4009040 comp rx=0 tx=0).stop 2024-05-08T10:55:04.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.415+0000 7f3de4c4a640 1 -- 172.21.15.33:0/2107822727 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3de00cf0f0 msgr2=0x7f3de0155710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:04.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.415+0000 7f3de4c4a640 1 --2- 172.21.15.33:0/2107822727 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3de00cf0f0 0x7f3de0155710 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3dd0035040 tx=0x7f3dd00046c0 comp rx=0 tx=0).stop 2024-05-08T10:55:04.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.415+0000 7f3de4c4a640 1 -- 172.21.15.33:0/2107822727 shutdown_connections 2024-05-08T10:55:04.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.415+0000 7f3de4c4a640 1 --2- 172.21.15.33:0/2107822727 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f3dc006b4d0 0x7f3dc006d990 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:04.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.415+0000 7f3de4c4a640 1 --2- 172.21.15.33:0/2107822727 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3de00d07a0 0x7f3de015f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:04.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.415+0000 7f3de4c4a640 1 --2- 172.21.15.33:0/2107822727 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3de00d03c0 0x7f3de015dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:04.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.415+0000 7f3de4c4a640 1 --2- 172.21.15.33:0/2107822727 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3de00cf0f0 0x7f3de0155710 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:04.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.415+0000 7f3de4c4a640 1 -- 172.21.15.33:0/2107822727 >> 172.21.15.33:0/2107822727 conn(0x7f3de009ce90 msgr2=0x7f3de00b8910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:04.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.415+0000 7f3de4c4a640 1 -- 172.21.15.33:0/2107822727 shutdown_connections 2024-05-08T10:55:04.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.415+0000 7f3de4c4a640 1 -- 172.21.15.33:0/2107822727 wait complete. 2024-05-08T10:55:04.423 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-05-08T10:55:04.424 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T10:55:04.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.530+0000 7f1f6ef30640 1 Processor -- start 2024-05-08T10:55:04.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.530+0000 7f1f6ef30640 1 -- start start 2024-05-08T10:55:04.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.531+0000 7f1f6ef30640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1f6815b980 0x7f1f68071810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:04.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.531+0000 7f1f6ef30640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f680cfb60 con 0x7f1f680cc290 2024-05-08T10:55:04.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.531+0000 7f1f6ef30640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f680cfe40 con 0x7f1f6806dee0 2024-05-08T10:55:04.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.531+0000 7f1f6ef30640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f680d0770 con 0x7f1f6815b980 2024-05-08T10:55:04.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.531+0000 7f1f6cccc640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f1f680cc290 0x7f1f6806d7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:43636/0 (socket says 172.21.15.33:43636) 2024-05-08T10:55:04.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.531+0000 7f1f6cccc640 1 -- 172.21.15.33:0/2510457510 learned_addr learned my addr 172.21.15.33:0/2510457510 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-05-08T10:55:04.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.531+0000 7f1f6d4cd640 1 --2- 172.21.15.33:0/2510457510 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1f6815b980 0x7f1f68071810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:04.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.531+0000 7f1f677fe640 1 -- 172.21.15.33:0/2510457510 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 273896820 0 0) 0x7f1f680cfb60 con 0x7f1f680cc290 2024-05-08T10:55:04.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.531+0000 7f1f677fe640 1 -- 172.21.15.33:0/2510457510 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f54003520 con 0x7f1f680cc290 2024-05-08T10:55:04.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.531+0000 7f1f677fe640 1 -- 172.21.15.33:0/2510457510 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 569777863 0 0) 0x7f1f54003520 con 0x7f1f680cc290 2024-05-08T10:55:04.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.531+0000 7f1f677fe640 1 -- 172.21.15.33:0/2510457510 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1f6815b980 msgr2=0x7f1f68071810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:04.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.531+0000 7f1f677fe640 1 --2- 172.21.15.33:0/2510457510 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1f6815b980 0x7f1f68071810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:04.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.531+0000 7f1f677fe640 1 -- 172.21.15.33:0/2510457510 >> v1:172.21.15.174:6789/0 conn(0x7f1f6806dee0 legacy=0x7f1f68071100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:04.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.531+0000 7f1f677fe640 1 -- 172.21.15.33:0/2510457510 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f680d0120 con 0x7f1f680cc290 2024-05-08T10:55:04.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.531+0000 7f1f677fe640 1 -- 172.21.15.33:0/2510457510 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2948294915 0 0) 0x7f1f50001690 con 0x7f1f680cc290 2024-05-08T10:55:04.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.531+0000 7f1f677fe640 1 -- 172.21.15.33:0/2510457510 >> v1:172.21.15.33:6789/0 conn(0x7f1f680cc290 legacy=0x7f1f6806d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:04.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.531+0000 7f1f677fe640 1 --2- 172.21.15.33:0/2510457510 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f540039e0 0x7f1f54003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:04.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.532+0000 7f1f677fe640 1 --2- 172.21.15.33:0/2510457510 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1f6815b980 0x7f1f54004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:04.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.532+0000 7f1f677fe640 1 --2- 172.21.15.33:0/2510457510 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f54004d40 0x7f1f540051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:04.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.532+0000 7f1f677fe640 1 -- 172.21.15.33:0/2510457510 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f680d0770 con 0x7f1f540039e0 2024-05-08T10:55:04.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.532+0000 7f1f677fe640 1 -- 172.21.15.33:0/2510457510 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f5400baf0 con 0x7f1f54004d40 2024-05-08T10:55:04.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.532+0000 7f1f677fe640 1 -- 172.21.15.33:0/2510457510 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f5400bcf0 con 0x7f1f6815b980 2024-05-08T10:55:04.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.532+0000 7f1f6cccc640 1 --2- 172.21.15.33:0/2510457510 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f540039e0 0x7f1f54003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:04.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.532+0000 7f1f67fff640 1 --2- 172.21.15.33:0/2510457510 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1f6815b980 0x7f1f54004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:04.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.532+0000 7f1f6d4cd640 1 --2- 172.21.15.33:0/2510457510 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f54004d40 0x7f1f540051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:04.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.532+0000 7f1f6cccc640 1 -- 172.21.15.33:0/2510457510 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1f6815b980 msgr2=0x7f1f54004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:04.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.532+0000 7f1f6cccc640 1 --2- 172.21.15.33:0/2510457510 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1f6815b980 0x7f1f54004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:04.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.532+0000 7f1f6cccc640 1 -- 172.21.15.33:0/2510457510 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f54004d40 msgr2=0x7f1f540051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:04.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.532+0000 7f1f6cccc640 1 --2- 172.21.15.33:0/2510457510 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f54004d40 0x7f1f540051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:04.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.532+0000 7f1f6cccc640 1 -- 172.21.15.33:0/2510457510 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f54003520 con 0x7f1f540039e0 2024-05-08T10:55:04.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.532+0000 7f1f6d4cd640 1 --2- 172.21.15.33:0/2510457510 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f54004d40 0x7f1f540051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:55:04.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.533+0000 7f1f6cccc640 1 --2- 172.21.15.33:0/2510457510 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f540039e0 0x7f1f54003e00 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1f5000c210 tx=0x7f1f54005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4a964e7679c67ec server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:04.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.533+0000 7f1f677fe640 1 -- 172.21.15.33:0/2510457510 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f50007d10 con 0x7f1f540039e0 2024-05-08T10:55:04.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.533+0000 7f1f677fe640 1 -- 172.21.15.33:0/2510457510 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f50005ad0 con 0x7f1f540039e0 2024-05-08T10:55:04.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.533+0000 7f1f677fe640 1 -- 172.21.15.33:0/2510457510 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f50007070 con 0x7f1f540039e0 2024-05-08T10:55:04.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.533+0000 7f1f6ef30640 1 -- 172.21.15.33:0/2510457510 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f540039e0 msgr2=0x7f1f54003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:04.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.533+0000 7f1f6ef30640 1 --2- 172.21.15.33:0/2510457510 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f540039e0 0x7f1f54003e00 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1f5000c210 tx=0x7f1f54005830 comp rx=0 tx=0).stop 2024-05-08T10:55:04.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.533+0000 7f1f6d4cd640 1 -- 172.21.15.33:0/2510457510 reap_dead start 2024-05-08T10:55:04.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.533+0000 7f1f6ef30640 1 -- 172.21.15.33:0/2510457510 shutdown_connections 2024-05-08T10:55:04.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.533+0000 7f1f6ef30640 1 -- 172.21.15.33:0/2510457510 >> 172.21.15.33:0/2510457510 conn(0x7f1f6806aba0 msgr2=0x7f1f6806afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:04.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.533+0000 7f1f6ef30640 1 -- 172.21.15.33:0/2510457510 shutdown_connections 2024-05-08T10:55:04.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.533+0000 7f1f6ef30640 1 -- 172.21.15.33:0/2510457510 wait complete. 2024-05-08T10:55:04.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.535+0000 7f1f6ef30640 1 Processor -- start 2024-05-08T10:55:04.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.535+0000 7f1f6ef30640 1 -- start start 2024-05-08T10:55:04.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.535+0000 7f1f6ef30640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f540039e0 0x7f1f6814fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:04.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.535+0000 7f1f6ef30640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f6814a720 0x7f1f6814ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:04.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.535+0000 7f1f6ef30640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1f6814e3c0 0x7f1f6814e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:04.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.535+0000 7f1f6ef30640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f6815bdd0 con 0x7f1f540039e0 2024-05-08T10:55:04.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.535+0000 7f1f6ef30640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f680b36b0 con 0x7f1f6814a720 2024-05-08T10:55:04.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.535+0000 7f1f6ef30640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f680cf6f0 con 0x7f1f6814e3c0 2024-05-08T10:55:04.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.536+0000 7f1f6cccc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f540039e0 0x7f1f6814fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:04.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.536+0000 7f1f6cccc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f540039e0 0x7f1f6814fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37962/0 (socket says 172.21.15.33:37962) 2024-05-08T10:55:04.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.536+0000 7f1f6cccc640 1 -- 172.21.15.33:0/2982494668 learned_addr learned my addr 172.21.15.33:0/2982494668 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:04.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.536+0000 7f1f6d4cd640 1 --2- 172.21.15.33:0/2982494668 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1f6814e3c0 0x7f1f6814e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:04.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.536+0000 7f1f67fff640 1 --2- 172.21.15.33:0/2982494668 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f6814a720 0x7f1f6814ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:04.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.536+0000 7f1f6cccc640 1 -- 172.21.15.33:0/2982494668 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1f6814e3c0 msgr2=0x7f1f6814e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:04.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.536+0000 7f1f6cccc640 1 --2- 172.21.15.33:0/2982494668 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1f6814e3c0 0x7f1f6814e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:04.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.536+0000 7f1f6cccc640 1 -- 172.21.15.33:0/2982494668 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f6814a720 msgr2=0x7f1f6814ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:04.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.536+0000 7f1f6cccc640 1 --2- 172.21.15.33:0/2982494668 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f6814a720 0x7f1f6814ffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:04.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.536+0000 7f1f6cccc640 1 -- 172.21.15.33:0/2982494668 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f6814ed80 con 0x7f1f540039e0 2024-05-08T10:55:04.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.536+0000 7f1f6cccc640 1 --2- 172.21.15.33:0/2982494668 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f540039e0 0x7f1f6814fa90 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1f5002ad00 tx=0x7f1f680cfd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:04.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.536+0000 7f1f657fa640 1 -- 172.21.15.33:0/2982494668 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f50037040 con 0x7f1f540039e0 2024-05-08T10:55:04.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.536+0000 7f1f657fa640 1 -- 172.21.15.33:0/2982494668 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f50041070 con 0x7f1f540039e0 2024-05-08T10:55:04.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.536+0000 7f1f6ef30640 1 -- 172.21.15.33:0/2982494668 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f6814f040 con 0x7f1f540039e0 2024-05-08T10:55:04.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.536+0000 7f1f657fa640 1 -- 172.21.15.33:0/2982494668 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f50001650 con 0x7f1f540039e0 2024-05-08T10:55:04.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.536+0000 7f1f6ef30640 1 -- 172.21.15.33:0/2982494668 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f6814f600 con 0x7f1f540039e0 2024-05-08T10:55:04.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.537+0000 7f1f6ef30640 1 -- 172.21.15.33:0/2982494668 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f68069d20 con 0x7f1f540039e0 2024-05-08T10:55:04.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.538+0000 7f1f657fa640 1 -- 172.21.15.33:0/2982494668 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1f50007070 con 0x7f1f540039e0 2024-05-08T10:55:04.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.538+0000 7f1f657fa640 1 --2- 172.21.15.33:0/2982494668 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f1f4806b4d0 0x7f1f4806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:04.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.538+0000 7f1f657fa640 1 -- 172.21.15.33:0/2982494668 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1f500a9d10 con 0x7f1f540039e0 2024-05-08T10:55:04.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.538+0000 7f1f67fff640 1 --2- 172.21.15.33:0/2982494668 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f1f4806b4d0 0x7f1f4806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:04.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.539+0000 7f1f67fff640 1 --2- 172.21.15.33:0/2982494668 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f1f4806b4d0 0x7f1f4806d990 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1f681591e0 tx=0x7f1f58009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:04.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.542+0000 7f1f657fa640 1 -- 172.21.15.33:0/2982494668 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1f50078b10 con 0x7f1f540039e0 2024-05-08T10:55:04.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.764+0000 7f1f6ef30640 1 -- 172.21.15.33:0/2982494668 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1f6814ac00 con 0x7f1f540039e0 2024-05-08T10:55:04.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.765+0000 7f1f657fa640 1 -- 172.21.15.33:0/2982494668 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4935 (secure 0 0 0) 0x7f1f50078410 con 0x7f1f540039e0 2024-05-08T10:55:04.762 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:55:04.762 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4262,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6837/974626320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6835","nonce":974626320},{"type":"v1","addr":"172.21.15.174:6837","nonce":974626320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6834/3541391922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":3541391922},{"type":"v1","addr":"172.21.15.33:6834","nonce":3541391922}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/1492311153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6833","nonce":1492311153},{"type":"v1","addr":"172.21.15.33:6835","nonce":1492311153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T10:54:49.885783+0000","modified":"2024-05-08T10:54:52.897089+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.174:6836/2139245090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2139245090},{"type":"v1","addr":"172.21.15.174:6836","nonce":2139245090}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T10:55:04.763 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 7 2024-05-08T10:55:04.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.766+0000 7f1f6ef30640 1 -- 172.21.15.33:0/2982494668 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f1f4806b4d0 msgr2=0x7f1f4806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:04.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.766+0000 7f1f6ef30640 1 --2- 172.21.15.33:0/2982494668 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f1f4806b4d0 0x7f1f4806d990 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1f681591e0 tx=0x7f1f58009040 comp rx=0 tx=0).stop 2024-05-08T10:55:04.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.766+0000 7f1f6ef30640 1 -- 172.21.15.33:0/2982494668 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f540039e0 msgr2=0x7f1f6814fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:04.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.766+0000 7f1f6ef30640 1 --2- 172.21.15.33:0/2982494668 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f540039e0 0x7f1f6814fa90 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1f5002ad00 tx=0x7f1f680cfd30 comp rx=0 tx=0).stop 2024-05-08T10:55:04.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.767+0000 7f1f6ef30640 1 -- 172.21.15.33:0/2982494668 shutdown_connections 2024-05-08T10:55:04.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.767+0000 7f1f6ef30640 1 --2- 172.21.15.33:0/2982494668 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f1f4806b4d0 0x7f1f4806d990 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:04.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.767+0000 7f1f6ef30640 1 --2- 172.21.15.33:0/2982494668 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1f6814e3c0 0x7f1f6814e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:04.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.767+0000 7f1f6ef30640 1 --2- 172.21.15.33:0/2982494668 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f6814a720 0x7f1f6814ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:04.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.767+0000 7f1f6ef30640 1 --2- 172.21.15.33:0/2982494668 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f540039e0 0x7f1f6814fa90 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:04.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.767+0000 7f1f6ef30640 1 -- 172.21.15.33:0/2982494668 >> 172.21.15.33:0/2982494668 conn(0x7f1f6806aba0 msgr2=0x7f1f6806c5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:04.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.767+0000 7f1f6ef30640 1 -- 172.21.15.33:0/2982494668 shutdown_connections 2024-05-08T10:55:04.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.767+0000 7f1f6ef30640 1 -- 172.21.15.33:0/2982494668 wait complete. 2024-05-08T10:55:04.775 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T10:55:04.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.881+0000 7fb321295640 1 Processor -- start 2024-05-08T10:55:04.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.881+0000 7fb321295640 1 -- start start 2024-05-08T10:55:04.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.882+0000 7fb321295640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb31c0714d0 0x7fb31c0b4520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:04.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.882+0000 7fb321295640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb31c0718b0 0x7fb31c06e590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:04.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.882+0000 7fb321295640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb31c15bde0 con 0x7fb31c06ead0 2024-05-08T10:55:04.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.882+0000 7fb321295640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb31c0b37f0 con 0x7fb31c0714d0 2024-05-08T10:55:04.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.882+0000 7fb321295640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb31c06f100 con 0x7fb31c0718b0 2024-05-08T10:55:04.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.882+0000 7fb31b7fe640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fb31c06ead0 0x7fb31c15c040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:43638/0 (socket says 172.21.15.33:43638) 2024-05-08T10:55:04.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.882+0000 7fb31b7fe640 1 -- 172.21.15.33:0/2885771645 learned_addr learned my addr 172.21.15.33:0/2885771645 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-05-08T10:55:04.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.883+0000 7fb31affd640 1 --2- 172.21.15.33:0/2885771645 >> v2:172.21.15.174:3300/0 conn(0x7fb31c0714d0 0x7fb31c0b4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:04.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.883+0000 7fb31a7fc640 1 --2- 172.21.15.33:0/2885771645 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb31c0718b0 0x7fb31c06e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:04.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.883+0000 7fb319ffb640 1 -- 172.21.15.33:0/2885771645 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 877510308 0 0) 0x7fb31c15bde0 con 0x7fb31c06ead0 2024-05-08T10:55:04.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.883+0000 7fb319ffb640 1 -- 172.21.15.33:0/2885771645 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb308003520 con 0x7fb31c06ead0 2024-05-08T10:55:04.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.883+0000 7fb319ffb640 1 -- 172.21.15.33:0/2885771645 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1055142882 0 0) 0x7fb308003520 con 0x7fb31c06ead0 2024-05-08T10:55:04.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.883+0000 7fb31affd640 1 -- 172.21.15.33:0/2885771645 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb31c0718b0 msgr2=0x7fb31c06e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:04.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.883+0000 7fb31affd640 1 --2- 172.21.15.33:0/2885771645 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb31c0718b0 0x7fb31c06e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:04.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.883+0000 7fb31affd640 1 -- 172.21.15.33:0/2885771645 >> v1:172.21.15.33:6789/0 conn(0x7fb31c06ead0 legacy=0x7fb31c15c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:04.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.883+0000 7fb31affd640 1 -- 172.21.15.33:0/2885771645 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb31c0b3a40 con 0x7fb31c0714d0 2024-05-08T10:55:04.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.883+0000 7fb31a7fc640 1 --2- 172.21.15.33:0/2885771645 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb31c0718b0 0x7fb31c06e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T10:55:04.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.884+0000 7fb31affd640 1 --2- 172.21.15.33:0/2885771645 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb31c0714d0 0x7fb31c0b4520 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb314009d90 tx=0x7fb31402a560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74230bde0135c78b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:04.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.884+0000 7fb319ffb640 1 -- 172.21.15.33:0/2885771645 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb30c001670 con 0x7fb31c0714d0 2024-05-08T10:55:04.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.884+0000 7fb319ffb640 1 -- 172.21.15.33:0/2885771645 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb314007540 con 0x7fb31c0714d0 2024-05-08T10:55:04.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.884+0000 7fb319ffb640 1 -- 172.21.15.33:0/2885771645 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3140078f0 con 0x7fb31c0714d0 2024-05-08T10:55:04.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.884+0000 7fb321295640 1 -- 172.21.15.33:0/2885771645 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb31c0714d0 msgr2=0x7fb31c0b4520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:04.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.884+0000 7fb321295640 1 --2- 172.21.15.33:0/2885771645 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb31c0714d0 0x7fb31c0b4520 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb314009d90 tx=0x7fb31402a560 comp rx=0 tx=0).stop 2024-05-08T10:55:04.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.884+0000 7fb321295640 1 -- 172.21.15.33:0/2885771645 shutdown_connections 2024-05-08T10:55:04.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.884+0000 7fb321295640 1 --2- 172.21.15.33:0/2885771645 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb31c0718b0 0x7fb31c06e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:04.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.884+0000 7fb321295640 1 --2- 172.21.15.33:0/2885771645 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb31c0714d0 0x7fb31c0b4520 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:04.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.884+0000 7fb321295640 1 -- 172.21.15.33:0/2885771645 >> 172.21.15.33:0/2885771645 conn(0x7fb31c0b24f0 msgr2=0x7fb31c0b2900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:04.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.884+0000 7fb321295640 1 -- 172.21.15.33:0/2885771645 shutdown_connections 2024-05-08T10:55:04.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.884+0000 7fb321295640 1 -- 172.21.15.33:0/2885771645 wait complete. 2024-05-08T10:55:04.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.886+0000 7fb321295640 1 Processor -- start 2024-05-08T10:55:04.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.886+0000 7fb321295640 1 -- start start 2024-05-08T10:55:04.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.887+0000 7fb321295640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb31c06ead0 0x7fb31c1404f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:04.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.887+0000 7fb321295640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb31c0714d0 0x7fb31c142dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:04.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.887+0000 7fb321295640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb31c0718b0 0x7fb31c143310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:04.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.887+0000 7fb321295640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb31c071d10 con 0x7fb31c0714d0 2024-05-08T10:55:04.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.887+0000 7fb321295640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb31c0b4000 con 0x7fb31c06ead0 2024-05-08T10:55:04.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.887+0000 7fb321295640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb31c0b0110 con 0x7fb31c0718b0 2024-05-08T10:55:04.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.887+0000 7fb31a7fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb31c0714d0 0x7fb31c142dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:04.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.887+0000 7fb31a7fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb31c0714d0 0x7fb31c142dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37972/0 (socket says 172.21.15.33:37972) 2024-05-08T10:55:04.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.887+0000 7fb31a7fc640 1 -- 172.21.15.33:0/622464260 learned_addr learned my addr 172.21.15.33:0/622464260 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:04.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.887+0000 7fb31affd640 1 --2- 172.21.15.33:0/622464260 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb31c06ead0 0x7fb31c1404f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:04.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.887+0000 7fb31b7fe640 1 --2- 172.21.15.33:0/622464260 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb31c0718b0 0x7fb31c143310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:04.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.887+0000 7fb31a7fc640 1 -- 172.21.15.33:0/622464260 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb31c0718b0 msgr2=0x7fb31c143310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:04.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.887+0000 7fb31a7fc640 1 --2- 172.21.15.33:0/622464260 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb31c0718b0 0x7fb31c143310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:04.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.887+0000 7fb31a7fc640 1 -- 172.21.15.33:0/622464260 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb31c06ead0 msgr2=0x7fb31c1404f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:04.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.887+0000 7fb31a7fc640 1 --2- 172.21.15.33:0/622464260 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb31c06ead0 0x7fb31c1404f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:04.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.887+0000 7fb31a7fc640 1 -- 172.21.15.33:0/622464260 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb31c140de0 con 0x7fb31c0714d0 2024-05-08T10:55:04.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.887+0000 7fb31b7fe640 1 --2- 172.21.15.33:0/622464260 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb31c0718b0 0x7fb31c143310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:55:04.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.887+0000 7fb31a7fc640 1 --2- 172.21.15.33:0/622464260 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb31c0714d0 0x7fb31c142dd0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb30400ebe0 tx=0x7fb30400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:04.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.887+0000 7fb3137fe640 1 -- 172.21.15.33:0/622464260 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb304017070 con 0x7fb31c0714d0 2024-05-08T10:55:04.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.887+0000 7fb3137fe640 1 -- 172.21.15.33:0/622464260 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb30400cc30 con 0x7fb31c0714d0 2024-05-08T10:55:04.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.887+0000 7fb321295640 1 -- 172.21.15.33:0/622464260 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb31c140a30 con 0x7fb31c0714d0 2024-05-08T10:55:04.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.887+0000 7fb3137fe640 1 -- 172.21.15.33:0/622464260 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb304013470 con 0x7fb31c0714d0 2024-05-08T10:55:04.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.888+0000 7fb321295640 1 -- 172.21.15.33:0/622464260 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb31c141050 con 0x7fb31c0714d0 2024-05-08T10:55:04.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.889+0000 7fb321295640 1 -- 172.21.15.33:0/622464260 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb31c069d20 con 0x7fb31c0714d0 2024-05-08T10:55:04.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.889+0000 7fb3137fe640 1 -- 172.21.15.33:0/622464260 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb30401a070 con 0x7fb31c0714d0 2024-05-08T10:55:04.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.889+0000 7fb3137fe640 1 --2- 172.21.15.33:0/622464260 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fb2fc06b500 0x7fb2fc06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:04.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.889+0000 7fb3137fe640 1 -- 172.21.15.33:0/622464260 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb30408a010 con 0x7fb31c0714d0 2024-05-08T10:55:04.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.889+0000 7fb31affd640 1 --2- 172.21.15.33:0/622464260 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fb2fc06b500 0x7fb2fc06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:04.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.890+0000 7fb31affd640 1 --2- 172.21.15.33:0/622464260 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fb2fc06b500 0x7fb2fc06d9c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb314034000 tx=0x7fb31402f000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:04.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:04.893+0000 7fb3137fe640 1 -- 172.21.15.33:0/622464260 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb304058840 con 0x7fb31c0714d0 2024-05-08T10:55:05.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.111+0000 7fb321295640 1 -- 172.21.15.33:0/622464260 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb31c0d05b0 con 0x7fb31c0714d0 2024-05-08T10:55:05.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.111+0000 7fb3137fe640 1 -- 172.21.15.33:0/622464260 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4935 (secure 0 0 0) 0x7fb30405c8e0 con 0x7fb31c0714d0 2024-05-08T10:55:05.109 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:55:05.109 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4262,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6837/974626320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6835","nonce":974626320},{"type":"v1","addr":"172.21.15.174:6837","nonce":974626320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6834/3541391922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":3541391922},{"type":"v1","addr":"172.21.15.33:6834","nonce":3541391922}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/1492311153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6833","nonce":1492311153},{"type":"v1","addr":"172.21.15.33:6835","nonce":1492311153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T10:54:49.885783+0000","modified":"2024-05-08T10:54:52.897089+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.174:6836/2139245090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2139245090},{"type":"v1","addr":"172.21.15.174:6836","nonce":2139245090}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T10:55:05.109 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 7 2024-05-08T10:55:05.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.113+0000 7fb321295640 1 -- 172.21.15.33:0/622464260 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fb2fc06b500 msgr2=0x7fb2fc06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:05.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.113+0000 7fb321295640 1 --2- 172.21.15.33:0/622464260 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fb2fc06b500 0x7fb2fc06d9c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb314034000 tx=0x7fb31402f000 comp rx=0 tx=0).stop 2024-05-08T10:55:05.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.113+0000 7fb321295640 1 -- 172.21.15.33:0/622464260 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb31c0714d0 msgr2=0x7fb31c142dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:05.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.113+0000 7fb321295640 1 --2- 172.21.15.33:0/622464260 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb31c0714d0 0x7fb31c142dd0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb30400ebe0 tx=0x7fb30400c520 comp rx=0 tx=0).stop 2024-05-08T10:55:05.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.113+0000 7fb321295640 1 -- 172.21.15.33:0/622464260 shutdown_connections 2024-05-08T10:55:05.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.113+0000 7fb321295640 1 --2- 172.21.15.33:0/622464260 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fb2fc06b500 0x7fb2fc06d9c0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:05.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.113+0000 7fb321295640 1 --2- 172.21.15.33:0/622464260 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb31c0718b0 0x7fb31c143310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:05.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.113+0000 7fb321295640 1 --2- 172.21.15.33:0/622464260 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb31c0714d0 0x7fb31c142dd0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:05.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.113+0000 7fb321295640 1 --2- 172.21.15.33:0/622464260 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb31c06ead0 0x7fb31c1404f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:05.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.113+0000 7fb321295640 1 -- 172.21.15.33:0/622464260 >> 172.21.15.33:0/622464260 conn(0x7fb31c0b24f0 msgr2=0x7fb31c0b1b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:05.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.113+0000 7fb321295640 1 -- 172.21.15.33:0/622464260 shutdown_connections 2024-05-08T10:55:05.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.113+0000 7fb321295640 1 -- 172.21.15.33:0/622464260 wait complete. 2024-05-08T10:55:05.121 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T10:55:05.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.227+0000 7fa8fa658640 1 Processor -- start 2024-05-08T10:55:05.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.227+0000 7fa8fa658640 1 -- start start 2024-05-08T10:55:05.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.228+0000 7fa8fa658640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa8f40cc290 0x7fa8f415b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:05.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.228+0000 7fa8fa658640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa8f406d7d0 0x7fa8f406dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:05.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.228+0000 7fa8fa658640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fa8f415e520 0x7fa8f415e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:05.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.228+0000 7fa8fa658640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8f406e170 con 0x7fa8f415e520 2024-05-08T10:55:05.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.228+0000 7fa8fa658640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8f415bec0 con 0x7fa8f406d7d0 2024-05-08T10:55:05.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.228+0000 7fa8fa658640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f40d0770 con 0x7fa8f40cc290 2024-05-08T10:55:05.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.228+0000 7fa8f8bf5640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fa8f415e520 0x7fa8f415e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:05.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.228+0000 7fa8f8bf5640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fa8f415e520 0x7fa8f415e9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37974/0 (socket says 172.21.15.33:37974) 2024-05-08T10:55:05.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.228+0000 7fa8f8bf5640 1 -- 172.21.15.33:0/4193892333 learned_addr learned my addr 172.21.15.33:0/4193892333 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:05.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.228+0000 7fa8f37fe640 1 --2- 172.21.15.33:0/4193892333 >> v2:172.21.15.174:3300/0 conn(0x7fa8f406d7d0 0x7fa8f406dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:05.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.228+0000 7fa8f3fff640 1 --2- 172.21.15.33:0/4193892333 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa8f40cc290 0x7fa8f415b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:05.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.228+0000 7fa8f8bf5640 1 -- 172.21.15.33:0/4193892333 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa8f40cc290 msgr2=0x7fa8f415b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:05.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.228+0000 7fa8f8bf5640 1 --2- 172.21.15.33:0/4193892333 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa8f40cc290 0x7fa8f415b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:05.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.228+0000 7fa8f8bf5640 1 -- 172.21.15.33:0/4193892333 >> v2:172.21.15.174:3300/0 conn(0x7fa8f406d7d0 msgr2=0x7fa8f406dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:05.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.228+0000 7fa8f8bf5640 1 --2- 172.21.15.33:0/4193892333 >> v2:172.21.15.174:3300/0 conn(0x7fa8f406d7d0 0x7fa8f406dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:05.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.228+0000 7fa8f8bf5640 1 -- 172.21.15.33:0/4193892333 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8f40cfb60 con 0x7fa8f415e520 2024-05-08T10:55:05.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.228+0000 7fa8f3fff640 1 --2- 172.21.15.33:0/4193892333 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa8f40cc290 0x7fa8f415b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:55:05.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.229+0000 7fa8f8bf5640 1 --2- 172.21.15.33:0/4193892333 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa8f415e520 0x7fa8f415e9b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa8f40d0a60 tx=0x7fa8ec02a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1dfb965e68e93b9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:05.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.229+0000 7fa8f2ffd640 1 -- 172.21.15.33:0/4193892333 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8ec036070 con 0x7fa8f415e520 2024-05-08T10:55:05.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.229+0000 7fa8f2ffd640 1 -- 172.21.15.33:0/4193892333 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8ec031600 con 0x7fa8f415e520 2024-05-08T10:55:05.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.229+0000 7fa8f2ffd640 1 -- 172.21.15.33:0/4193892333 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8ec0319d0 con 0x7fa8f415e520 2024-05-08T10:55:05.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.230+0000 7fa8fa658640 1 -- 172.21.15.33:0/4193892333 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa8f415e520 msgr2=0x7fa8f415e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:05.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.230+0000 7fa8fa658640 1 --2- 172.21.15.33:0/4193892333 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa8f415e520 0x7fa8f415e9b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa8f40d0a60 tx=0x7fa8ec02a610 comp rx=0 tx=0).stop 2024-05-08T10:55:05.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.230+0000 7fa8fa658640 1 -- 172.21.15.33:0/4193892333 shutdown_connections 2024-05-08T10:55:05.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.230+0000 7fa8fa658640 1 --2- 172.21.15.33:0/4193892333 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa8f415e520 0x7fa8f415e9b0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:05.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.230+0000 7fa8fa658640 1 --2- 172.21.15.33:0/4193892333 >> v2:172.21.15.174:3300/0 conn(0x7fa8f406d7d0 0x7fa8f406dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:05.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.230+0000 7fa8fa658640 1 --2- 172.21.15.33:0/4193892333 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa8f40cc290 0x7fa8f415b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:05.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.230+0000 7fa8fa658640 1 -- 172.21.15.33:0/4193892333 >> 172.21.15.33:0/4193892333 conn(0x7fa8f406aba0 msgr2=0x7fa8f406afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:05.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.230+0000 7fa8fa658640 1 -- 172.21.15.33:0/4193892333 shutdown_connections 2024-05-08T10:55:05.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.230+0000 7fa8fa658640 1 -- 172.21.15.33:0/4193892333 wait complete. 2024-05-08T10:55:05.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.231+0000 7fa8fa658640 1 Processor -- start 2024-05-08T10:55:05.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.231+0000 7fa8fa658640 1 -- start start 2024-05-08T10:55:05.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.232+0000 7fa8fa658640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa8f406d7d0 0x7fa8f4146a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:05.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.232+0000 7fa8fa658640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa8f40cc290 0x7fa8f40ce510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:05.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.232+0000 7fa8fa658640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa8f415e520 0x7fa8f406c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:05.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.232+0000 7fa8fa658640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f40d0400 con 0x7fa8f406d7d0 2024-05-08T10:55:05.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.232+0000 7fa8fa658640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f40d0120 con 0x7fa8f415e520 2024-05-08T10:55:05.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.232+0000 7fa8fa658640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f40b36b0 con 0x7fa8f40cc290 2024-05-08T10:55:05.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.232+0000 7fa8f3fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa8f406d7d0 0x7fa8f4146a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:05.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.232+0000 7fa8f3fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa8f406d7d0 0x7fa8f4146a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37976/0 (socket says 172.21.15.33:37976) 2024-05-08T10:55:05.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.232+0000 7fa8f3fff640 1 -- 172.21.15.33:0/3088209118 learned_addr learned my addr 172.21.15.33:0/3088209118 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:05.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.232+0000 7fa8f37fe640 1 --2- 172.21.15.33:0/3088209118 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa8f40cc290 0x7fa8f40ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:05.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.232+0000 7fa8f8bf5640 1 --2- 172.21.15.33:0/3088209118 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa8f415e520 0x7fa8f406c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:05.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.232+0000 7fa8f3fff640 1 -- 172.21.15.33:0/3088209118 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa8f40cc290 msgr2=0x7fa8f40ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:05.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.232+0000 7fa8f3fff640 1 --2- 172.21.15.33:0/3088209118 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa8f40cc290 0x7fa8f40ce510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:05.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.232+0000 7fa8f3fff640 1 -- 172.21.15.33:0/3088209118 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa8f415e520 msgr2=0x7fa8f406c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:05.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.232+0000 7fa8f3fff640 1 --2- 172.21.15.33:0/3088209118 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa8f415e520 0x7fa8f406c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:05.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.232+0000 7fa8f3fff640 1 -- 172.21.15.33:0/3088209118 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8f40ae980 con 0x7fa8f406d7d0 2024-05-08T10:55:05.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.232+0000 7fa8f37fe640 1 --2- 172.21.15.33:0/3088209118 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa8f40cc290 0x7fa8f40ce510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:55:05.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.233+0000 7fa8f3fff640 1 --2- 172.21.15.33:0/3088209118 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa8f406d7d0 0x7fa8f4146a80 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa8e400e7e0 tx=0x7fa8e400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:05.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.233+0000 7fa8f0ff9640 1 -- 172.21.15.33:0/3088209118 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e400f040 con 0x7fa8f406d7d0 2024-05-08T10:55:05.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.233+0000 7fa8f0ff9640 1 -- 172.21.15.33:0/3088209118 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8e4004030 con 0x7fa8f406d7d0 2024-05-08T10:55:05.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.233+0000 7fa8fa658640 1 -- 172.21.15.33:0/3088209118 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8f40aec60 con 0x7fa8f406d7d0 2024-05-08T10:55:05.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.233+0000 7fa8f0ff9640 1 -- 172.21.15.33:0/3088209118 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e4004400 con 0x7fa8f406d7d0 2024-05-08T10:55:05.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.233+0000 7fa8fa658640 1 -- 172.21.15.33:0/3088209118 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8f40cea50 con 0x7fa8f406d7d0 2024-05-08T10:55:05.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.234+0000 7fa8fa658640 1 -- 172.21.15.33:0/3088209118 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8f4069d20 con 0x7fa8f406d7d0 2024-05-08T10:55:05.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.234+0000 7fa8f0ff9640 1 -- 172.21.15.33:0/3088209118 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa8e400c6d0 con 0x7fa8f406d7d0 2024-05-08T10:55:05.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.235+0000 7fa8f0ff9640 1 --2- 172.21.15.33:0/3088209118 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fa8e006b4d0 0x7fa8e006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:05.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.235+0000 7fa8f0ff9640 1 -- 172.21.15.33:0/3088209118 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa8e4089f10 con 0x7fa8f406d7d0 2024-05-08T10:55:05.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.235+0000 7fa8f37fe640 1 --2- 172.21.15.33:0/3088209118 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fa8e006b4d0 0x7fa8e006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:05.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.236+0000 7fa8f37fe640 1 --2- 172.21.15.33:0/3088209118 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fa8e006b4d0 0x7fa8e006d990 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa8e8006fd0 tx=0x7fa8e8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:05.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.239+0000 7fa8f0ff9640 1 -- 172.21.15.33:0/3088209118 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa8e4017020 con 0x7fa8f406d7d0 2024-05-08T10:55:05.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.421+0000 7fa8fa658640 1 -- 172.21.15.33:0/3088209118 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa8f40707a0 con 0x7fa8f406d7d0 2024-05-08T10:55:05.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.422+0000 7fa8f0ff9640 1 -- 172.21.15.33:0/3088209118 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16617 (secure 0 0 0) 0x7fa8e4058e20 con 0x7fa8f406d7d0 2024-05-08T10:55:05.420 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:55:05.420 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":20,"fsid":"963217b2-c375-4f5a-95cf-88e199dd38ff","created":"2024-05-08T10:54:26.711528+0000","modified":"2024-05-08T10:54:51.528856+0000","last_up_change":"2024-05-08T10:54:37.987478+0000","last_in_change":"2024-05-08T10:54:28.834106+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T10:54:38.989228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T10:54:47.774236+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T10:54:48.869679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c5da4fb5-d4f2-4982-a804-2aa92fe77731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3990629207},{"type":"v1","addr":"172.21.15.33:6817","nonce":3990629207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3990629207},{"type":"v1","addr":"172.21.15.33:6819","nonce":3990629207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3990629207},{"type":"v1","addr":"172.21.15.33:6823","nonce":3990629207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3990629207},{"type":"v1","addr":"172.21.15.33:6821","nonce":3990629207}]},"public_addr":"172.21.15.33:6817/3990629207","cluster_addr":"172.21.15.33:6819/3990629207","heartbeat_back_addr":"172.21.15.33:6823/3990629207","heartbeat_front_addr":"172.21.15.33:6821/3990629207","state":["exists","up"]},{"osd":1,"uuid":"f8fdd8db-c2a3-4d28-81f3-b30f44bea7c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":1758076090},{"type":"v1","addr":"172.21.15.33:6825","nonce":1758076090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":1758076090},{"type":"v1","addr":"172.21.15.33:6827","nonce":1758076090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":1758076090},{"type":"v1","addr":"172.21.15.33:6831","nonce":1758076090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":1758076090},{"type":"v1","addr":"172.21.15.33:6829","nonce":1758076090}]},"public_addr":"172.21.15.33:6825/1758076090","cluster_addr":"172.21.15.33:6827/1758076090","heartbeat_back_addr":"172.21.15.33:6831/1758076090","heartbeat_front_addr":"172.21.15.33:6829/1758076090","state":["exists","up"]},{"osd":2,"uuid":"87d465f3-b40f-48dd-bae2-4c67904d4828","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":2940853479},{"type":"v1","addr":"172.21.15.33:6801","nonce":2940853479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6803","nonce":2940853479},{"type":"v1","addr":"172.21.15.33:6805","nonce":2940853479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6811","nonce":2940853479},{"type":"v1","addr":"172.21.15.33:6813","nonce":2940853479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6807","nonce":2940853479},{"type":"v1","addr":"172.21.15.33:6809","nonce":2940853479}]},"public_addr":"172.21.15.33:6801/2940853479","cluster_addr":"172.21.15.33:6805/2940853479","heartbeat_back_addr":"172.21.15.33:6813/2940853479","heartbeat_front_addr":"172.21.15.33:6809/2940853479","state":["exists","up"]},{"osd":3,"uuid":"79450edf-9637-4181-9372-e1cd5e91e73e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":4029047077},{"type":"v1","addr":"172.21.15.33:6804","nonce":4029047077}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":4029047077},{"type":"v1","addr":"172.21.15.33:6808","nonce":4029047077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":4029047077},{"type":"v1","addr":"172.21.15.33:6815","nonce":4029047077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":4029047077},{"type":"v1","addr":"172.21.15.33:6812","nonce":4029047077}]},"public_addr":"172.21.15.33:6804/4029047077","cluster_addr":"172.21.15.33:6808/4029047077","heartbeat_back_addr":"172.21.15.33:6815/4029047077","heartbeat_front_addr":"172.21.15.33:6812/4029047077","state":["exists","up"]},{"osd":4,"uuid":"bd0debfa-e559-4b1e-920d-6b2639c7085e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":1697399220},{"type":"v1","addr":"172.21.15.174:6801","nonce":1697399220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":1697399220},{"type":"v1","addr":"172.21.15.174:6803","nonce":1697399220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":1697399220},{"type":"v1","addr":"172.21.15.174:6807","nonce":1697399220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":1697399220},{"type":"v1","addr":"172.21.15.174:6805","nonce":1697399220}]},"public_addr":"172.21.15.174:6801/1697399220","cluster_addr":"172.21.15.174:6803/1697399220","heartbeat_back_addr":"172.21.15.174:6807/1697399220","heartbeat_front_addr":"172.21.15.174:6805/1697399220","state":["exists","up"]},{"osd":5,"uuid":"ff0f51c0-672b-448f-9de1-b9305ce8c00d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":1511860729},{"type":"v1","addr":"172.21.15.174:6825","nonce":1511860729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":1511860729},{"type":"v1","addr":"172.21.15.174:6827","nonce":1511860729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":1511860729},{"type":"v1","addr":"172.21.15.174:6831","nonce":1511860729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":1511860729},{"type":"v1","addr":"172.21.15.174:6829","nonce":1511860729}]},"public_addr":"172.21.15.174:6825/1511860729","cluster_addr":"172.21.15.174:6827/1511860729","heartbeat_back_addr":"172.21.15.174:6831/1511860729","heartbeat_front_addr":"172.21.15.174:6829/1511860729","state":["exists","up"]},{"osd":6,"uuid":"93061f6c-c0ce-47e9-88a0-1151c5ccb4e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":2326407945},{"type":"v1","addr":"172.21.15.174:6817","nonce":2326407945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":2326407945},{"type":"v1","addr":"172.21.15.174:6819","nonce":2326407945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":2326407945},{"type":"v1","addr":"172.21.15.174:6823","nonce":2326407945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":2326407945},{"type":"v1","addr":"172.21.15.174:6821","nonce":2326407945}]},"public_addr":"172.21.15.174:6817/2326407945","cluster_addr":"172.21.15.174:6819/2326407945","heartbeat_back_addr":"172.21.15.174:6823/2326407945","heartbeat_front_addr":"172.21.15.174:6821/2326407945","state":["exists","up"]},{"osd":7,"uuid":"7be1dcf3-1957-4ec3-bacf-f5f9fff580a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":1637570253},{"type":"v1","addr":"172.21.15.174:6809","nonce":1637570253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":1637570253},{"type":"v1","addr":"172.21.15.174:6811","nonce":1637570253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":1637570253},{"type":"v1","addr":"172.21.15.174:6815","nonce":1637570253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":1637570253},{"type":"v1","addr":"172.21.15.174:6813","nonce":1637570253}]},"public_addr":"172.21.15.174:6809/1637570253","cluster_addr":"172.21.15.174:6811/1637570253","heartbeat_back_addr":"172.21.15.174:6815/1637570253","heartbeat_front_addr":"172.21.15.174:6813/1637570253","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:33.997709+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:34.016568+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:33.990484+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:33.980666+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:33.920609+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:34.005069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:34.018345+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:34.061646+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T10:55:05.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.424+0000 7fa8fa658640 1 -- 172.21.15.33:0/3088209118 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fa8e006b4d0 msgr2=0x7fa8e006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:05.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.424+0000 7fa8fa658640 1 --2- 172.21.15.33:0/3088209118 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fa8e006b4d0 0x7fa8e006d990 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa8e8006fd0 tx=0x7fa8e8008040 comp rx=0 tx=0).stop 2024-05-08T10:55:05.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.424+0000 7fa8fa658640 1 -- 172.21.15.33:0/3088209118 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa8f406d7d0 msgr2=0x7fa8f4146a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:05.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.424+0000 7fa8fa658640 1 --2- 172.21.15.33:0/3088209118 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa8f406d7d0 0x7fa8f4146a80 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa8e400e7e0 tx=0x7fa8e400eca0 comp rx=0 tx=0).stop 2024-05-08T10:55:05.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.424+0000 7fa8fa658640 1 -- 172.21.15.33:0/3088209118 shutdown_connections 2024-05-08T10:55:05.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.424+0000 7fa8fa658640 1 --2- 172.21.15.33:0/3088209118 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fa8e006b4d0 0x7fa8e006d990 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:05.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.424+0000 7fa8fa658640 1 --2- 172.21.15.33:0/3088209118 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa8f415e520 0x7fa8f406c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:05.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.424+0000 7fa8fa658640 1 --2- 172.21.15.33:0/3088209118 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa8f40cc290 0x7fa8f40ce510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:05.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.424+0000 7fa8fa658640 1 --2- 172.21.15.33:0/3088209118 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa8f406d7d0 0x7fa8f4146a80 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:05.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.424+0000 7fa8fa658640 1 -- 172.21.15.33:0/3088209118 >> 172.21.15.33:0/3088209118 conn(0x7fa8f406aba0 msgr2=0x7fa8f415d8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:05.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.424+0000 7fa8fa658640 1 -- 172.21.15.33:0/3088209118 shutdown_connections 2024-05-08T10:55:05.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.424+0000 7fa8fa658640 1 -- 172.21.15.33:0/3088209118 wait complete. 2024-05-08T10:55:05.433 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T10:55:05.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.539+0000 7fc460d29640 1 Processor -- start 2024-05-08T10:55:05.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.539+0000 7fc460d29640 1 -- start start 2024-05-08T10:55:05.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.540+0000 7fc460d29640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc45c15dc00 0x7fc45c0d0690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:05.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.540+0000 7fc460d29640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc45c06e960 0x7fc45c06f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:05.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.540+0000 7fc460d29640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc45c06bd30 con 0x7fc45c15dfe0 2024-05-08T10:55:05.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.540+0000 7fc460d29640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc45c0d0f90 con 0x7fc45c15dc00 2024-05-08T10:55:05.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.540+0000 7fc460d29640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc45c06c010 con 0x7fc45c06e960 2024-05-08T10:55:05.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.541+0000 7fc459d9b640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc45c06e960 0x7fc45c06f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:05.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.541+0000 7fc45a59c640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc45c15dc00 0x7fc45c0d0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:05.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.541+0000 7fc459d9b640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc45c06e960 0x7fc45c06f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.33:58986/0 (socket says 172.21.15.33:58986) 2024-05-08T10:55:05.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.541+0000 7fc459d9b640 1 -- 172.21.15.33:0/2279749674 learned_addr learned my addr 172.21.15.33:0/2279749674 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:05.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.541+0000 7fc45ad9d640 1 --1- 172.21.15.33:0/2279749674 >> v1:172.21.15.174:6789/0 conn(0x7fc45c15dfe0 0x7fc45c161a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.33:48014/0 (socket says 172.21.15.33:48014) 2024-05-08T10:55:05.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.541+0000 7fc459d9b640 1 -- 172.21.15.33:0/2279749674 >> v2:172.21.15.174:3300/0 conn(0x7fc45c15dc00 msgr2=0x7fc45c0d0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:05.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.541+0000 7fc459d9b640 1 --2- 172.21.15.33:0/2279749674 >> v2:172.21.15.174:3300/0 conn(0x7fc45c15dc00 0x7fc45c0d0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:05.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.541+0000 7fc459d9b640 1 -- 172.21.15.33:0/2279749674 >> v1:172.21.15.174:6789/0 conn(0x7fc45c15dfe0 legacy=0x7fc45c161a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:05.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.541+0000 7fc459d9b640 1 -- 172.21.15.33:0/2279749674 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc45c06c2f0 con 0x7fc45c06e960 2024-05-08T10:55:05.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.541+0000 7fc45a59c640 1 --2- 172.21.15.33:0/2279749674 >> v2:172.21.15.174:3300/0 conn(0x7fc45c15dc00 0x7fc45c0d0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T10:55:05.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.542+0000 7fc459d9b640 1 --2- 172.21.15.33:0/2279749674 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc45c06e960 0x7fc45c06f0f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc450009870 tx=0x7fc45002a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f27fc11ff8c4fe21 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:05.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.542+0000 7fc45959a640 1 -- 172.21.15.33:0/2279749674 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc450037070 con 0x7fc45c06e960 2024-05-08T10:55:05.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.542+0000 7fc45959a640 1 -- 172.21.15.33:0/2279749674 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc450032440 con 0x7fc45c06e960 2024-05-08T10:55:05.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.542+0000 7fc45959a640 1 -- 172.21.15.33:0/2279749674 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc450032810 con 0x7fc45c06e960 2024-05-08T10:55:05.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.542+0000 7fc460d29640 1 -- 172.21.15.33:0/2279749674 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc45c06e960 msgr2=0x7fc45c06f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:05.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.542+0000 7fc460d29640 1 --2- 172.21.15.33:0/2279749674 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc45c06e960 0x7fc45c06f0f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc450009870 tx=0x7fc45002a1c0 comp rx=0 tx=0).stop 2024-05-08T10:55:05.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.543+0000 7fc460d29640 1 -- 172.21.15.33:0/2279749674 shutdown_connections 2024-05-08T10:55:05.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.543+0000 7fc460d29640 1 --2- 172.21.15.33:0/2279749674 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc45c06e960 0x7fc45c06f0f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:05.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.543+0000 7fc460d29640 1 --2- 172.21.15.33:0/2279749674 >> v2:172.21.15.174:3300/0 conn(0x7fc45c15dc00 0x7fc45c0d0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:05.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.543+0000 7fc460d29640 1 -- 172.21.15.33:0/2279749674 >> 172.21.15.33:0/2279749674 conn(0x7fc45c0d1940 msgr2=0x7fc45c0d1d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:05.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.543+0000 7fc460d29640 1 -- 172.21.15.33:0/2279749674 shutdown_connections 2024-05-08T10:55:05.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.543+0000 7fc460d29640 1 -- 172.21.15.33:0/2279749674 wait complete. 2024-05-08T10:55:05.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.544+0000 7fc460d29640 1 Processor -- start 2024-05-08T10:55:05.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.544+0000 7fc460d29640 1 -- start start 2024-05-08T10:55:05.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.545+0000 7fc460d29640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc45c06e960 0x7fc45c0c5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:05.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.545+0000 7fc460d29640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc45c15dc00 0x7fc45c147d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:05.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.545+0000 7fc460d29640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc45c15dfe0 0x7fc45c0b0490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:05.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.545+0000 7fc460d29640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc45c0d0d50 con 0x7fc45c15dc00 2024-05-08T10:55:05.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.545+0000 7fc460d29640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc45c0d0bd0 con 0x7fc45c15dfe0 2024-05-08T10:55:05.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.545+0000 7fc460d29640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc45c06db00 con 0x7fc45c06e960 2024-05-08T10:55:05.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.545+0000 7fc459d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc45c15dc00 0x7fc45c147d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:05.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.545+0000 7fc459d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc45c15dc00 0x7fc45c147d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37984/0 (socket says 172.21.15.33:37984) 2024-05-08T10:55:05.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.545+0000 7fc459d9b640 1 -- 172.21.15.33:0/887254421 learned_addr learned my addr 172.21.15.33:0/887254421 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:05.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.545+0000 7fc45a59c640 1 --2- 172.21.15.33:0/887254421 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc45c06e960 0x7fc45c0c5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:05.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.545+0000 7fc45ad9d640 1 --2- 172.21.15.33:0/887254421 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc45c15dfe0 0x7fc45c0b0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:05.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.545+0000 7fc459d9b640 1 -- 172.21.15.33:0/887254421 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc45c06e960 msgr2=0x7fc45c0c5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:05.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.545+0000 7fc459d9b640 1 --2- 172.21.15.33:0/887254421 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc45c06e960 0x7fc45c0c5e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:05.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.545+0000 7fc459d9b640 1 -- 172.21.15.33:0/887254421 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc45c15dfe0 msgr2=0x7fc45c0b0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:05.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.545+0000 7fc459d9b640 1 --2- 172.21.15.33:0/887254421 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc45c15dfe0 0x7fc45c0b0490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:05.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.545+0000 7fc459d9b640 1 -- 172.21.15.33:0/887254421 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc45c0c75b0 con 0x7fc45c15dc00 2024-05-08T10:55:05.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.545+0000 7fc459d9b640 1 --2- 172.21.15.33:0/887254421 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc45c15dc00 0x7fc45c147d40 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc450009870 tx=0x7fc4500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:05.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.545+0000 7fc44affd640 1 -- 172.21.15.33:0/887254421 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc450041070 con 0x7fc45c15dc00 2024-05-08T10:55:05.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.546+0000 7fc44affd640 1 -- 172.21.15.33:0/887254421 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc45003c890 con 0x7fc45c15dc00 2024-05-08T10:55:05.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.546+0000 7fc460d29640 1 -- 172.21.15.33:0/887254421 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc45c0c6510 con 0x7fc45c15dc00 2024-05-08T10:55:05.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.546+0000 7fc44affd640 1 -- 172.21.15.33:0/887254421 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc450037040 con 0x7fc45c15dc00 2024-05-08T10:55:05.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.546+0000 7fc460d29640 1 -- 172.21.15.33:0/887254421 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc45c0c6ad0 con 0x7fc45c15dc00 2024-05-08T10:55:05.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.547+0000 7fc460d29640 1 -- 172.21.15.33:0/887254421 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc45c069d20 con 0x7fc45c15dc00 2024-05-08T10:55:05.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.547+0000 7fc44affd640 1 -- 172.21.15.33:0/887254421 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc450044070 con 0x7fc45c15dc00 2024-05-08T10:55:05.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.547+0000 7fc44affd640 1 --2- 172.21.15.33:0/887254421 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fc43c06b4d0 0x7fc43c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:05.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.548+0000 7fc44affd640 1 -- 172.21.15.33:0/887254421 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc4500aaaf0 con 0x7fc45c15dc00 2024-05-08T10:55:05.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.548+0000 7fc45a59c640 1 --2- 172.21.15.33:0/887254421 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fc43c06b4d0 0x7fc43c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:05.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.548+0000 7fc45a59c640 1 --2- 172.21.15.33:0/887254421 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fc43c06b4d0 0x7fc43c06d990 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc44c009560 tx=0x7fc44c009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:05.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.551+0000 7fc44affd640 1 -- 172.21.15.33:0/887254421 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc450079440 con 0x7fc45c15dc00 2024-05-08T10:55:05.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.770+0000 7fc460d29640 1 -- 172.21.15.33:0/887254421 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc45c0b78c0 con 0x7fc45c15dc00 2024-05-08T10:55:05.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.771+0000 7fc44affd640 1 -- 172.21.15.33:0/887254421 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4935 (secure 0 0 0) 0x7fc45007d4e0 con 0x7fc45c15dc00 2024-05-08T10:55:05.768 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:55:05.768 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4262,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6837/974626320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6835","nonce":974626320},{"type":"v1","addr":"172.21.15.174:6837","nonce":974626320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6834/3541391922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":3541391922},{"type":"v1","addr":"172.21.15.33:6834","nonce":3541391922}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/1492311153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6833","nonce":1492311153},{"type":"v1","addr":"172.21.15.33:6835","nonce":1492311153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T10:54:49.885783+0000","modified":"2024-05-08T10:54:52.897089+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.174:6836/2139245090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2139245090},{"type":"v1","addr":"172.21.15.174:6836","nonce":2139245090}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T10:55:05.769 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 7 2024-05-08T10:55:05.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.773+0000 7fc460d29640 1 -- 172.21.15.33:0/887254421 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fc43c06b4d0 msgr2=0x7fc43c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:05.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.773+0000 7fc460d29640 1 --2- 172.21.15.33:0/887254421 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fc43c06b4d0 0x7fc43c06d990 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc44c009560 tx=0x7fc44c009190 comp rx=0 tx=0).stop 2024-05-08T10:55:05.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.773+0000 7fc460d29640 1 -- 172.21.15.33:0/887254421 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc45c15dc00 msgr2=0x7fc45c147d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:05.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.773+0000 7fc460d29640 1 --2- 172.21.15.33:0/887254421 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc45c15dc00 0x7fc45c147d40 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc450009870 tx=0x7fc4500046c0 comp rx=0 tx=0).stop 2024-05-08T10:55:05.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.773+0000 7fc460d29640 1 -- 172.21.15.33:0/887254421 shutdown_connections 2024-05-08T10:55:05.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.773+0000 7fc460d29640 1 --2- 172.21.15.33:0/887254421 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fc43c06b4d0 0x7fc43c06d990 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:05.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.773+0000 7fc460d29640 1 --2- 172.21.15.33:0/887254421 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc45c15dfe0 0x7fc45c0b0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:05.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.773+0000 7fc460d29640 1 --2- 172.21.15.33:0/887254421 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc45c15dc00 0x7fc45c147d40 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:05.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.773+0000 7fc460d29640 1 --2- 172.21.15.33:0/887254421 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc45c06e960 0x7fc45c0c5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:05.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.773+0000 7fc460d29640 1 -- 172.21.15.33:0/887254421 >> 172.21.15.33:0/887254421 conn(0x7fc45c0d1940 msgr2=0x7fc45c0d11c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:05.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.773+0000 7fc460d29640 1 -- 172.21.15.33:0/887254421 shutdown_connections 2024-05-08T10:55:05.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:05.773+0000 7fc460d29640 1 -- 172.21.15.33:0/887254421 wait complete. 2024-05-08T10:55:06.184 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-08T10:54:49.885783+0000', 'modified': '2024-05-08T10:54:52.897089+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4279}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4279': {'gid': 4279, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.174:6836/2139245090', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.174:6834', 'nonce': 2139245090}, {'type': 'v1', 'addr': '172.21.15.174:6836', 'nonce': 2139245090}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-05-08T10:55:06.184 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-08T10:55:06.184 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-05-08T10:55:06.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.296+0000 7fcd38a12640 1 Processor -- start 2024-05-08T10:55:06.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.296+0000 7fcd38a12640 1 -- start start 2024-05-08T10:55:06.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.297+0000 7fcd38a12640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fcd340d1ae0 0x7fcd340d4770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:06.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.297+0000 7fcd38a12640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fcd340d1ec0 0x7fcd340d2350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:06.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.297+0000 7fcd38a12640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd340cf330 con 0x7fcd340d2890 2024-05-08T10:55:06.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.297+0000 7fcd38a12640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd340cf610 con 0x7fcd340d1ec0 2024-05-08T10:55:06.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.297+0000 7fcd38a12640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd340cf8f0 con 0x7fcd340d1ae0 2024-05-08T10:55:06.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.297+0000 7fcd2bfff640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fcd340d1ec0 0x7fcd340d2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:06.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.297+0000 7fcd2bfff640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fcd340d1ec0 0x7fcd340d2350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47700/0 (socket says 172.21.15.33:47700) 2024-05-08T10:55:06.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.297+0000 7fcd32d9d640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fcd340d2890 0x7fcd340d00f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:48148/0 (socket says 172.21.15.33:48148) 2024-05-08T10:55:06.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.297+0000 7fcd2bfff640 1 -- 172.21.15.33:0/3527839637 learned_addr learned my addr 172.21.15.33:0/3527839637 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:06.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.297+0000 7fcd3259c640 1 --2- 172.21.15.33:0/3527839637 >> v2:172.21.15.174:3300/0 conn(0x7fcd340d1ae0 0x7fcd340d4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:06.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.297+0000 7fcd2bfff640 1 -- 172.21.15.33:0/3527839637 >> v2:172.21.15.174:3300/0 conn(0x7fcd340d1ae0 msgr2=0x7fcd340d4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:06.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.297+0000 7fcd2bfff640 1 --2- 172.21.15.33:0/3527839637 >> v2:172.21.15.174:3300/0 conn(0x7fcd340d1ae0 0x7fcd340d4770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:06.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.297+0000 7fcd2bfff640 1 -- 172.21.15.33:0/3527839637 >> v1:172.21.15.33:6789/0 conn(0x7fcd340d2890 legacy=0x7fcd340d00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:06.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.297+0000 7fcd2bfff640 1 -- 172.21.15.33:0/3527839637 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd340cfbd0 con 0x7fcd340d1ec0 2024-05-08T10:55:06.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.297+0000 7fcd31d9b640 1 -- 172.21.15.33:0/3527839637 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2046691828 0 0) 0x7fcd340cf330 con 0x7fcd340d2890 2024-05-08T10:55:06.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.298+0000 7fcd2bfff640 1 --2- 172.21.15.33:0/3527839637 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd340d1ec0 0x7fcd340d2350 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c009870 tx=0x7fcd1c02a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=403cbccfa62e0af8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:06.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.298+0000 7fcd31d9b640 1 -- 172.21.15.33:0/3527839637 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd1c037070 con 0x7fcd340d1ec0 2024-05-08T10:55:06.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.298+0000 7fcd31d9b640 1 -- 172.21.15.33:0/3527839637 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd1c032440 con 0x7fcd340d1ec0 2024-05-08T10:55:06.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.298+0000 7fcd31d9b640 1 -- 172.21.15.33:0/3527839637 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd1c032810 con 0x7fcd340d1ec0 2024-05-08T10:55:06.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.299+0000 7fcd38a12640 1 -- 172.21.15.33:0/3527839637 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd340d1ec0 msgr2=0x7fcd340d2350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:06.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.299+0000 7fcd38a12640 1 --2- 172.21.15.33:0/3527839637 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd340d1ec0 0x7fcd340d2350 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c009870 tx=0x7fcd1c02a2a0 comp rx=0 tx=0).stop 2024-05-08T10:55:06.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.299+0000 7fcd38a12640 1 -- 172.21.15.33:0/3527839637 shutdown_connections 2024-05-08T10:55:06.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.299+0000 7fcd38a12640 1 --2- 172.21.15.33:0/3527839637 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd340d1ec0 0x7fcd340d2350 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:06.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.299+0000 7fcd38a12640 1 --2- 172.21.15.33:0/3527839637 >> v2:172.21.15.174:3300/0 conn(0x7fcd340d1ae0 0x7fcd340d4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:06.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.299+0000 7fcd38a12640 1 -- 172.21.15.33:0/3527839637 >> 172.21.15.33:0/3527839637 conn(0x7fcd340d3be0 msgr2=0x7fcd340d3ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:06.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.299+0000 7fcd38a12640 1 -- 172.21.15.33:0/3527839637 shutdown_connections 2024-05-08T10:55:06.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.299+0000 7fcd38a12640 1 -- 172.21.15.33:0/3527839637 wait complete. 2024-05-08T10:55:06.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.300+0000 7fcd38a12640 1 Processor -- start 2024-05-08T10:55:06.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.300+0000 7fcd38a12640 1 -- start start 2024-05-08T10:55:06.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.301+0000 7fcd38a12640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd340d1ae0 0x7fcd340b7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:06.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.301+0000 7fcd38a12640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcd340d1ec0 0x7fcd3406c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:06.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.301+0000 7fcd38a12640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcd340d2890 0x7fcd341f3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:06.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.301+0000 7fcd38a12640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd340b1f60 con 0x7fcd340d1ae0 2024-05-08T10:55:06.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.301+0000 7fcd38a12640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd340b1de0 con 0x7fcd340d1ec0 2024-05-08T10:55:06.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.301+0000 7fcd38a12640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd340b20e0 con 0x7fcd340d2890 2024-05-08T10:55:06.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.301+0000 7fcd3259c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd340d1ae0 0x7fcd340b7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:06.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.301+0000 7fcd3259c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd340d1ae0 0x7fcd340b7850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47714/0 (socket says 172.21.15.33:47714) 2024-05-08T10:55:06.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.301+0000 7fcd3259c640 1 -- 172.21.15.33:0/4272031223 learned_addr learned my addr 172.21.15.33:0/4272031223 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:06.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.301+0000 7fcd2bfff640 1 --2- 172.21.15.33:0/4272031223 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcd340d1ec0 0x7fcd3406c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:06.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.301+0000 7fcd32d9d640 1 --2- 172.21.15.33:0/4272031223 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcd340d2890 0x7fcd341f3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:06.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.301+0000 7fcd3259c640 1 -- 172.21.15.33:0/4272031223 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcd340d2890 msgr2=0x7fcd341f3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:06.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.301+0000 7fcd3259c640 1 --2- 172.21.15.33:0/4272031223 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcd340d2890 0x7fcd341f3f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:06.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.301+0000 7fcd3259c640 1 -- 172.21.15.33:0/4272031223 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcd340d1ec0 msgr2=0x7fcd3406c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:06.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.301+0000 7fcd3259c640 1 --2- 172.21.15.33:0/4272031223 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcd340d1ec0 0x7fcd3406c750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:06.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.301+0000 7fcd3259c640 1 -- 172.21.15.33:0/4272031223 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd340b8840 con 0x7fcd340d1ae0 2024-05-08T10:55:06.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.301+0000 7fcd3259c640 1 --2- 172.21.15.33:0/4272031223 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd340d1ae0 0x7fcd340b7850 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fcd2400d830 tx=0x7fcd2400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:06.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.301+0000 7fcd2affd640 1 -- 172.21.15.33:0/4272031223 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd2400b6c0 con 0x7fcd340d1ae0 2024-05-08T10:55:06.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.301+0000 7fcd2affd640 1 -- 172.21.15.33:0/4272031223 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd24019070 con 0x7fcd340d1ae0 2024-05-08T10:55:06.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.301+0000 7fcd38a12640 1 -- 172.21.15.33:0/4272031223 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd340b7fa0 con 0x7fcd340d1ae0 2024-05-08T10:55:06.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.301+0000 7fcd2affd640 1 -- 172.21.15.33:0/4272031223 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd2400ba80 con 0x7fcd340d1ae0 2024-05-08T10:55:06.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.302+0000 7fcd38a12640 1 -- 172.21.15.33:0/4272031223 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd340b8560 con 0x7fcd340d1ae0 2024-05-08T10:55:06.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.303+0000 7fcd2affd640 1 -- 172.21.15.33:0/4272031223 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fcd2401e460 con 0x7fcd340d1ae0 2024-05-08T10:55:06.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.304+0000 7fcd2affd640 1 --2- 172.21.15.33:0/4272031223 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fcd1406b4d0 0x7fcd1406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:06.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.304+0000 7fcd2affd640 1 -- 172.21.15.33:0/4272031223 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcd2408a950 con 0x7fcd340d1ae0 2024-05-08T10:55:06.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.304+0000 7fcd2bfff640 1 --2- 172.21.15.33:0/4272031223 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fcd1406b4d0 0x7fcd1406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:06.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.304+0000 7fcd2bfff640 1 --2- 172.21.15.33:0/4272031223 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fcd1406b4d0 0x7fcd1406d990 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c034000 tx=0x7fcd1c02e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:06.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.305+0000 7fcd3b7f2740 1 Processor -- start 2024-05-08T10:55:06.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.305+0000 7fcd3b7f2740 1 -- start start 2024-05-08T10:55:06.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.306+0000 7fcd3b7f2740 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x556dc4693030 0x556dc466a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:06.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.306+0000 7fcd3b7f2740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556dc4693410 0x556dc466f820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:06.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.306+0000 7fcd3b7f2740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556dc466fd60 0x556dc46701e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:06.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.306+0000 7fcd3b7f2740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x556dc45d3830 con 0x556dc4693410 2024-05-08T10:55:06.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.306+0000 7fcd3b7f2740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x556dc457cbe0 con 0x556dc466fd60 2024-05-08T10:55:06.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.306+0000 7fcd3b7f2740 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x556dc45cf8d0 con 0x556dc4693030 2024-05-08T10:55:06.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.306+0000 7fcd2bfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556dc4693410 0x556dc466f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:06.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.306+0000 7fcd2bfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556dc4693410 0x556dc466f820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47722/0 (socket says 172.21.15.33:47722) 2024-05-08T10:55:06.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.306+0000 7fcd2bfff640 1 -- 172.21.15.33:0/640918916 learned_addr learned my addr 172.21.15.33:0/640918916 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:06.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.306+0000 7fcd3259c640 1 --2- 172.21.15.33:0/640918916 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x556dc4693030 0x556dc466a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:06.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.306+0000 7fcd32d9d640 1 --2- 172.21.15.33:0/640918916 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556dc466fd60 0x556dc46701e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:06.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.306+0000 7fcd2bfff640 1 -- 172.21.15.33:0/640918916 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x556dc4693030 msgr2=0x556dc466a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:06.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.306+0000 7fcd2bfff640 1 --2- 172.21.15.33:0/640918916 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x556dc4693030 0x556dc466a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:06.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.306+0000 7fcd2bfff640 1 -- 172.21.15.33:0/640918916 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556dc466fd60 msgr2=0x556dc46701e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:06.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.306+0000 7fcd2bfff640 1 --2- 172.21.15.33:0/640918916 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556dc466fd60 0x556dc46701e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:06.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.306+0000 7fcd2bfff640 1 -- 172.21.15.33:0/640918916 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556dc459b0b0 con 0x556dc4693410 2024-05-08T10:55:06.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.306+0000 7fcd2bfff640 1 --2- 172.21.15.33:0/640918916 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556dc4693410 0x556dc466f820 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c02a2e0 tx=0x7fcd1c02c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa437604bce726a3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:06.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.306+0000 7fcd13fff640 1 -- 172.21.15.33:0/640918916 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd1c04d070 con 0x556dc4693410 2024-05-08T10:55:06.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.306+0000 7fcd13fff640 1 -- 172.21.15.33:0/640918916 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd1c032cb0 con 0x556dc4693410 2024-05-08T10:55:06.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.306+0000 7fcd13fff640 1 -- 172.21.15.33:0/640918916 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd1c037040 con 0x556dc4693410 2024-05-08T10:55:06.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.307+0000 7fcd3b7f2740 1 -- 172.21.15.33:0/640918916 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556dc4693410 msgr2=0x556dc466f820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:06.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.307+0000 7fcd3b7f2740 1 --2- 172.21.15.33:0/640918916 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556dc4693410 0x556dc466f820 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c02a2e0 tx=0x7fcd1c02c000 comp rx=0 tx=0).stop 2024-05-08T10:55:06.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.307+0000 7fcd3b7f2740 1 -- 172.21.15.33:0/640918916 shutdown_connections 2024-05-08T10:55:06.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.307+0000 7fcd3b7f2740 1 --2- 172.21.15.33:0/640918916 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556dc466fd60 0x556dc46701e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:06.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.307+0000 7fcd3b7f2740 1 --2- 172.21.15.33:0/640918916 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556dc4693410 0x556dc466f820 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:06.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.307+0000 7fcd3b7f2740 1 --2- 172.21.15.33:0/640918916 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x556dc4693030 0x556dc466a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:06.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.307+0000 7fcd3b7f2740 1 -- 172.21.15.33:0/640918916 >> 172.21.15.33:0/640918916 conn(0x556dc466cb10 msgr2=0x556dc46b5710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:06.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.307+0000 7fcd3b7f2740 1 -- 172.21.15.33:0/640918916 shutdown_connections 2024-05-08T10:55:06.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.307+0000 7fcd3b7f2740 1 -- 172.21.15.33:0/640918916 wait complete. 2024-05-08T10:55:06.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.308+0000 7fcd3b7f2740 1 -- start start 2024-05-08T10:55:06.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.308+0000 7fcd3b7f2740 1 Processor -- start 2024-05-08T10:55:06.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.309+0000 7fcd3b7f2740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556dc4693030 0x556dc46942f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:06.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.309+0000 7fcd3b7f2740 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x556dc4693410 0x556dc4691ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:06.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.309+0000 7fcd3b7f2740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556dc4692410 0x556dc46bce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:06.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.309+0000 7fcd3b7f2740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x556dc4590020 con 0x556dc4692410 2024-05-08T10:55:06.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.309+0000 7fcd3b7f2740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x556dc466e2e0 con 0x556dc4693030 2024-05-08T10:55:06.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.309+0000 7fcd3b7f2740 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x556dc4695c50 con 0x556dc4693410 2024-05-08T10:55:06.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.309+0000 7fcd3b7f2740 10 client.0 _ll_register_callbacks cb 0x556dc458f9f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T10:55:06.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.309+0000 7fcd32d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556dc4692410 0x556dc46bce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:06.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.309+0000 7fcd32d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556dc4692410 0x556dc46bce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47734/0 (socket says 172.21.15.33:47734) 2024-05-08T10:55:06.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.309+0000 7fcd32d9d640 1 -- 172.21.15.33:0/1055358303 learned_addr learned my addr 172.21.15.33:0/1055358303 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:06.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.309+0000 7fcd3259c640 1 --2- 172.21.15.33:0/1055358303 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556dc4693030 0x556dc46942f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:06.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.309+0000 7fcd2bfff640 1 --2- 172.21.15.33:0/1055358303 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x556dc4693410 0x556dc4691ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:06.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.309+0000 7fcd32d9d640 1 -- 172.21.15.33:0/1055358303 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x556dc4693410 msgr2=0x556dc4691ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:06.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.309+0000 7fcd32d9d640 1 --2- 172.21.15.33:0/1055358303 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x556dc4693410 0x556dc4691ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:06.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.309+0000 7fcd32d9d640 1 -- 172.21.15.33:0/1055358303 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556dc4693030 msgr2=0x556dc46942f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:06.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.309+0000 7fcd32d9d640 1 --2- 172.21.15.33:0/1055358303 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556dc4693030 0x556dc46942f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:06.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.309+0000 7fcd32d9d640 1 -- 172.21.15.33:0/1055358303 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556dc45903f0 con 0x556dc4692410 2024-05-08T10:55:06.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.309+0000 7fcd3259c640 1 --2- 172.21.15.33:0/1055358303 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556dc4693030 0x556dc46942f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:55:06.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.309+0000 7fcd32d9d640 1 --2- 172.21.15.33:0/1055358303 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556dc4692410 0x556dc46bce40 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fcd2c004e20 tx=0x7fcd2c007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87fed05334450808 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:06.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.309+0000 7fcd117fa640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-05-08T10:55:06.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.309+0000 7fcd117fa640 1 -- 172.21.15.33:0/1055358303 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd2c0137d0 con 0x556dc4692410 2024-05-08T10:55:06.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.310+0000 7fcd117fa640 1 -- 172.21.15.33:0/1055358303 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcd2c013970 con 0x556dc4692410 2024-05-08T10:55:06.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.310+0000 7fcd3b7f2740 1 -- 172.21.15.33:0/1055358303 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcd1c032cb0 con 0x556dc4692410 2024-05-08T10:55:06.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.310+0000 7fcd117fa640 1 -- 172.21.15.33:0/1055358303 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcd2c013b70 con 0x556dc4692410 2024-05-08T10:55:06.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.310+0000 7fcd3b7f2740 10 client.4623 fetch_fsmap learned FSMap version 7 2024-05-08T10:55:06.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.310+0000 7fcd3b7f2740 1 -- 172.21.15.33:0/1055358303 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x556dc42e82d0 con 0x556dc4692410 2024-05-08T10:55:06.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.310+0000 7fcd117fa640 1 -- 172.21.15.33:0/1055358303 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd1c032cb0 con 0x556dc4692410 2024-05-08T10:55:06.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.310+0000 7fcd117fa640 1 -- 172.21.15.33:0/1055358303 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 7) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fcd2c014460 con 0x556dc4692410 2024-05-08T10:55:06.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.310+0000 7fcd3b7f2740 10 client.4623 fetch_fsmap finished waiting for FSMap version 7 2024-05-08T10:55:06.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.310+0000 7fcd3b7f2740 10 client.4623 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-08T10:55:06.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.310+0000 7fcd3b7f2740 20 client.4623 populate_metadata read hostname 'smithi033' 2024-05-08T10:55:06.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.310+0000 7fcd3b7f2740 1 --2- 172.21.15.33:0/1055358303 >> [v2:172.21.15.174:6834/2139245090,v1:172.21.15.174:6836/2139245090] conn(0x556dc46d16a0 0x556dc46d3a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:06.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.310+0000 7fcd3b7f2740 4 client.4623 mds_command: new command op to 4279 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T10:55:06.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.310+0000 7fcd3b7f2740 1 -- 172.21.15.33:0/1055358303 --> [v2:172.21.15.174:6834/2139245090,v1:172.21.15.174:6836/2139245090] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556dc45e0d70 con 0x556dc46d16a0 2024-05-08T10:55:06.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.310+0000 7fcd3259c640 1 --2- 172.21.15.33:0/1055358303 >> [v2:172.21.15.174:6834/2139245090,v1:172.21.15.174:6836/2139245090] conn(0x556dc46d16a0 0x556dc46d3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:06.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.311+0000 7fcd3259c640 1 --2- 172.21.15.33:0/1055358303 >> [v2:172.21.15.174:6834/2139245090,v1:172.21.15.174:6836/2139245090] conn(0x556dc46d16a0 0x556dc46d3a90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8660a077ca0dde6c server_cookie=eb07af4c5ef094d5 in_seq=0 out_seq=0 2024-05-08T10:55:06.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.311+0000 7fcd117fa640 10 client.4623 ms_handle_connect on v2:172.21.15.174:6834/2139245090 2024-05-08T10:55:06.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.311+0000 7fcd117fa640 1 -- 172.21.15.33:0/1055358303 <== mds.0 v2:172.21.15.174:6834/2139245090 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x556dc45e0d70 con 0x556dc46d16a0 2024-05-08T10:55:06.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.311+0000 7fcd117fa640 10 client.4623 handle_command_reply: tid=0 2024-05-08T10:55:06.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.311+0000 7fcd3b7f2740 1 client.4623 shutdown 2024-05-08T10:55:06.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.312+0000 7fcd3b7f2740 1 -- 172.21.15.33:0/1055358303 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556dc4692410 msgr2=0x556dc46bce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:06.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.312+0000 7fcd3b7f2740 1 --2- 172.21.15.33:0/1055358303 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556dc4692410 0x556dc46bce40 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fcd2c004e20 tx=0x7fcd2c007430 comp rx=0 tx=0).stop 2024-05-08T10:55:06.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.312+0000 7fcd3b7f2740 1 -- 172.21.15.33:0/1055358303 shutdown_connections 2024-05-08T10:55:06.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.312+0000 7fcd3b7f2740 1 --2- 172.21.15.33:0/1055358303 >> [v2:172.21.15.174:6834/2139245090,v1:172.21.15.174:6836/2139245090] conn(0x556dc46d16a0 0x556dc46d3a90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:06.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.312+0000 7fcd3b7f2740 1 --2- 172.21.15.33:0/1055358303 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556dc4692410 0x556dc46bce40 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:06.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.312+0000 7fcd3b7f2740 1 --2- 172.21.15.33:0/1055358303 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x556dc4693410 0x556dc4691ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:06.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.312+0000 7fcd117fa640 0 client.4623 ms_handle_reset on v2:172.21.15.174:6834/2139245090 2024-05-08T10:55:06.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.312+0000 7fcd3b7f2740 1 --2- 172.21.15.33:0/1055358303 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556dc4693030 0x556dc46942f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:06.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.312+0000 7fcd3b7f2740 1 -- 172.21.15.33:0/1055358303 >> 172.21.15.33:0/1055358303 conn(0x556dc466fd60 msgr2=0x556dc466a4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:06.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.312+0000 7fcd3b7f2740 1 -- 172.21.15.33:0/1055358303 shutdown_connections 2024-05-08T10:55:06.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.312+0000 7fcd3b7f2740 1 -- 172.21.15.33:0/1055358303 wait complete. 2024-05-08T10:55:06.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.312+0000 7fcd3b7f2740 20 client.4623 trim_cache size 0 max 16384 2024-05-08T10:55:06.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.328+0000 7fcd3b7f2740 1 Processor -- start 2024-05-08T10:55:06.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.328+0000 7fcd3b7f2740 1 -- start start 2024-05-08T10:55:06.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.328+0000 7fcd3b7f2740 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x556dc4692410 0x556dc46d8220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:06.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.328+0000 7fcd3b7f2740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556dc4693030 0x556dc469dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:06.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.328+0000 7fcd3b7f2740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556dc4693410 0x556dc469e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:06.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.328+0000 7fcd3b7f2740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd341ff090 con 0x556dc4693030 2024-05-08T10:55:06.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.328+0000 7fcd3b7f2740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd340b5600 con 0x556dc4693410 2024-05-08T10:55:06.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.328+0000 7fcd3b7f2740 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd341f7760 con 0x556dc4692410 2024-05-08T10:55:06.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.328+0000 7fcd2bfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556dc4693030 0x556dc469dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:06.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.328+0000 7fcd2bfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556dc4693030 0x556dc469dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47740/0 (socket says 172.21.15.33:47740) 2024-05-08T10:55:06.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.328+0000 7fcd2bfff640 1 -- 172.21.15.33:0/77065830 learned_addr learned my addr 172.21.15.33:0/77065830 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:06.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.329+0000 7fcd3259c640 1 --2- 172.21.15.33:0/77065830 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x556dc4692410 0x556dc46d8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:06.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.329+0000 7fcd32d9d640 1 --2- 172.21.15.33:0/77065830 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556dc4693410 0x556dc469e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:06.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.329+0000 7fcd2bfff640 1 -- 172.21.15.33:0/77065830 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x556dc4692410 msgr2=0x556dc46d8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:06.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.329+0000 7fcd2bfff640 1 --2- 172.21.15.33:0/77065830 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x556dc4692410 0x556dc46d8220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:06.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.329+0000 7fcd2bfff640 1 -- 172.21.15.33:0/77065830 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556dc4693410 msgr2=0x556dc469e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:06.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.329+0000 7fcd2bfff640 1 --2- 172.21.15.33:0/77065830 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556dc4693410 0x556dc469e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:06.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.329+0000 7fcd2bfff640 1 -- 172.21.15.33:0/77065830 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556dc43b26b0 con 0x556dc4693030 2024-05-08T10:55:06.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.329+0000 7fcd3259c640 1 --2- 172.21.15.33:0/77065830 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x556dc4692410 0x556dc46d8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:55:06.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.329+0000 7fcd32d9d640 1 --2- 172.21.15.33:0/77065830 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556dc4693410 0x556dc469e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:55:06.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.329+0000 7fcd2bfff640 1 --2- 172.21.15.33:0/77065830 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556dc4693030 0x556dc469dfa0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c035040 tx=0x7fcd1c03a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8eb253a000596a2a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:06.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.329+0000 7fcd137fe640 1 -- 172.21.15.33:0/77065830 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd1c04d030 con 0x556dc4693030 2024-05-08T10:55:06.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.329+0000 7fcd137fe640 1 -- 172.21.15.33:0/77065830 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd1c04f070 con 0x556dc4693030 2024-05-08T10:55:06.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.329+0000 7fcd137fe640 1 -- 172.21.15.33:0/77065830 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd1c037050 con 0x556dc4693030 2024-05-08T10:55:06.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.330+0000 7fcd3b7f2740 1 -- 172.21.15.33:0/77065830 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556dc4693030 msgr2=0x556dc469dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:06.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.330+0000 7fcd3b7f2740 1 --2- 172.21.15.33:0/77065830 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556dc4693030 0x556dc469dfa0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c035040 tx=0x7fcd1c03a000 comp rx=0 tx=0).stop 2024-05-08T10:55:06.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.330+0000 7fcd3b7f2740 1 -- 172.21.15.33:0/77065830 shutdown_connections 2024-05-08T10:55:06.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.330+0000 7fcd3b7f2740 1 --2- 172.21.15.33:0/77065830 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556dc4693410 0x556dc469e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:06.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.330+0000 7fcd3b7f2740 1 --2- 172.21.15.33:0/77065830 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556dc4693030 0x556dc469dfa0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:06.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.330+0000 7fcd3b7f2740 1 --2- 172.21.15.33:0/77065830 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x556dc4692410 0x556dc46d8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:06.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.330+0000 7fcd3b7f2740 1 -- 172.21.15.33:0/77065830 >> 172.21.15.33:0/77065830 conn(0x556dc466fd60 msgr2=0x556dc466ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:06.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.330+0000 7fcd3b7f2740 1 -- 172.21.15.33:0/77065830 shutdown_connections 2024-05-08T10:55:06.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.330+0000 7fcd3b7f2740 1 -- 172.21.15.33:0/77065830 wait complete. 2024-05-08T10:55:06.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.330+0000 7fcd3b7f2740 1 -- start start 2024-05-08T10:55:06.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.330+0000 7fcd3b7f2740 1 Processor -- start 2024-05-08T10:55:06.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.331+0000 7fcd3b7f2740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556dc4692410 0x556dc46ce560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:06.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.331+0000 7fcd3b7f2740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556dc4693030 0x556dc46c44a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:06.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.331+0000 7fcd3b7f2740 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x556dc4693410 0x556dc4721190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:06.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.331+0000 7fcd3b7f2740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x556dc4697280 con 0x556dc4693030 2024-05-08T10:55:06.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.331+0000 7fcd3b7f2740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x556dc4696ed0 con 0x556dc4692410 2024-05-08T10:55:06.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.331+0000 7fcd3b7f2740 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x556dc4697850 con 0x556dc4693410 2024-05-08T10:55:06.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.331+0000 7fcd3b7f2740 10 client.0 _ll_register_callbacks cb 0x7fcd2c004c40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T10:55:06.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.331+0000 7fcd2bfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556dc4693030 0x556dc46c44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:06.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.331+0000 7fcd2bfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556dc4693030 0x556dc46c44a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47756/0 (socket says 172.21.15.33:47756) 2024-05-08T10:55:06.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.331+0000 7fcd2bfff640 1 -- 172.21.15.33:0/4285774168 learned_addr learned my addr 172.21.15.33:0/4285774168 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:06.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.332+0000 7fcd3259c640 1 --2- 172.21.15.33:0/4285774168 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556dc4692410 0x556dc46ce560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:06.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.332+0000 7fcd32d9d640 1 --2- 172.21.15.33:0/4285774168 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x556dc4693410 0x556dc4721190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:06.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.332+0000 7fcd2bfff640 1 -- 172.21.15.33:0/4285774168 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x556dc4693410 msgr2=0x556dc4721190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:06.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.332+0000 7fcd2bfff640 1 --2- 172.21.15.33:0/4285774168 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x556dc4693410 0x556dc4721190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:06.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.332+0000 7fcd2bfff640 1 -- 172.21.15.33:0/4285774168 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556dc4692410 msgr2=0x556dc46ce560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:06.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.332+0000 7fcd2bfff640 1 --2- 172.21.15.33:0/4285774168 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556dc4692410 0x556dc46ce560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:06.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.332+0000 7fcd2bfff640 1 -- 172.21.15.33:0/4285774168 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556dc4693f60 con 0x556dc4693030 2024-05-08T10:55:06.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.332+0000 7fcd32d9d640 1 --2- 172.21.15.33:0/4285774168 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x556dc4693410 0x556dc4721190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:55:06.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.332+0000 7fcd2bfff640 1 --2- 172.21.15.33:0/4285774168 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556dc4693030 0x556dc46c44a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c009630 tx=0x7fcd1c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd9e3943e70dbd0f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:06.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.332+0000 7fcd117fa640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-05-08T10:55:06.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.332+0000 7fcd117fa640 1 -- 172.21.15.33:0/4285774168 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd1c037070 con 0x556dc4693030 2024-05-08T10:55:06.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.332+0000 7fcd117fa640 1 -- 172.21.15.33:0/4285774168 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcd1c05caa0 con 0x556dc4693030 2024-05-08T10:55:06.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.332+0000 7fcd3b7f2740 1 -- 172.21.15.33:0/4285774168 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcd1c04f070 con 0x556dc4693030 2024-05-08T10:55:06.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.332+0000 7fcd117fa640 1 -- 172.21.15.33:0/4285774168 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcd1c05cca0 con 0x556dc4693030 2024-05-08T10:55:06.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.332+0000 7fcd3b7f2740 10 client.4629 fetch_fsmap learned FSMap version 7 2024-05-08T10:55:06.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.332+0000 7fcd3b7f2740 1 -- 172.21.15.33:0/4285774168 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x556dc46b6130 con 0x556dc4693030 2024-05-08T10:55:06.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.332+0000 7fcd117fa640 1 -- 172.21.15.33:0/4285774168 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd1c04f070 con 0x556dc4693030 2024-05-08T10:55:06.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.332+0000 7fcd117fa640 1 -- 172.21.15.33:0/4285774168 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 7) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fcd1c0037d0 con 0x556dc4693030 2024-05-08T10:55:06.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.332+0000 7fcd3b7f2740 10 client.4629 fetch_fsmap finished waiting for FSMap version 7 2024-05-08T10:55:06.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.332+0000 7fcd3b7f2740 10 client.4629 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-08T10:55:06.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.332+0000 7fcd3b7f2740 20 client.4629 populate_metadata read hostname 'smithi033' 2024-05-08T10:55:06.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.332+0000 7fcd3b7f2740 1 --2- 172.21.15.33:0/4285774168 >> [v2:172.21.15.174:6834/2139245090,v1:172.21.15.174:6836/2139245090] conn(0x556dc46d16a0 0x556dc46ab160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:06.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.332+0000 7fcd3b7f2740 4 client.4629 mds_command: new command op to 4279 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-08T10:55:06.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.333+0000 7fcd3b7f2740 1 -- 172.21.15.33:0/4285774168 --> [v2:172.21.15.174:6834/2139245090,v1:172.21.15.174:6836/2139245090] -- command(tid 0: {"prefix": "status"}) v1 -- 0x556dc45db0c0 con 0x556dc46d16a0 2024-05-08T10:55:06.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.333+0000 7fcd3259c640 1 --2- 172.21.15.33:0/4285774168 >> [v2:172.21.15.174:6834/2139245090,v1:172.21.15.174:6836/2139245090] conn(0x556dc46d16a0 0x556dc46ab160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:06.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.333+0000 7fcd117fa640 10 client.4629 ms_handle_connect on v2:172.21.15.174:6834/2139245090 2024-05-08T10:55:06.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.333+0000 7fcd3259c640 1 --2- 172.21.15.33:0/4285774168 >> [v2:172.21.15.174:6834/2139245090,v1:172.21.15.174:6836/2139245090] conn(0x556dc46d16a0 0x556dc46ab160 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5130f838872e03b6 server_cookie=6883ba5b1e7222c1 in_seq=0 out_seq=0 2024-05-08T10:55:06.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.333+0000 7fcd117fa640 1 -- 172.21.15.33:0/4285774168 <== mds.0 v2:172.21.15.174:6834/2139245090 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+323 (crc 0 0 0) 0x556dc45db0c0 con 0x556dc46d16a0 2024-05-08T10:55:06.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.333+0000 7fcd117fa640 10 client.4629 handle_command_reply: tid=0 2024-05-08T10:55:06.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.333+0000 7fcd3b7f2740 1 client.4629 shutdown 2024-05-08T10:55:06.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.333+0000 7fcd3b7f2740 1 -- 172.21.15.33:0/4285774168 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556dc4693030 msgr2=0x556dc46c44a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:06.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.333+0000 7fcd3b7f2740 1 --2- 172.21.15.33:0/4285774168 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556dc4693030 0x556dc46c44a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c009630 tx=0x7fcd1c004730 comp rx=0 tx=0).stop 2024-05-08T10:55:06.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.333+0000 7fcd3b7f2740 1 -- 172.21.15.33:0/4285774168 shutdown_connections 2024-05-08T10:55:06.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.333+0000 7fcd3b7f2740 1 --2- 172.21.15.33:0/4285774168 >> [v2:172.21.15.174:6834/2139245090,v1:172.21.15.174:6836/2139245090] conn(0x556dc46d16a0 0x556dc46ab160 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:06.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.334+0000 7fcd3b7f2740 1 --2- 172.21.15.33:0/4285774168 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x556dc4693410 0x556dc4721190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:06.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.334+0000 7fcd3b7f2740 1 --2- 172.21.15.33:0/4285774168 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556dc4693030 0x556dc46c44a0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:06.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.334+0000 7fcd117fa640 0 client.4629 ms_handle_reset on v2:172.21.15.174:6834/2139245090 2024-05-08T10:55:06.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.334+0000 7fcd3b7f2740 1 --2- 172.21.15.33:0/4285774168 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556dc4692410 0x556dc46ce560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:06.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.334+0000 7fcd3b7f2740 1 -- 172.21.15.33:0/4285774168 >> 172.21.15.33:0/4285774168 conn(0x556dc466fd60 msgr2=0x556dc46d8220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:06.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.334+0000 7fcd3b7f2740 1 -- 172.21.15.33:0/4285774168 shutdown_connections 2024-05-08T10:55:06.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.334+0000 7fcd3b7f2740 1 -- 172.21.15.33:0/4285774168 wait complete. 2024-05-08T10:55:06.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.334+0000 7fcd3b7f2740 20 client.4629 trim_cache size 0 max 16384 2024-05-08T10:55:06.338 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-05-08T10:55:06.338 INFO:teuthology.orchestra.run.smithi033.stdout: "cluster_fsid": "963217b2-c375-4f5a-95cf-88e199dd38ff", 2024-05-08T10:55:06.338 INFO:teuthology.orchestra.run.smithi033.stdout: "whoami": 0, 2024-05-08T10:55:06.338 INFO:teuthology.orchestra.run.smithi033.stdout: "id": 4279, 2024-05-08T10:55:06.338 INFO:teuthology.orchestra.run.smithi033.stdout: "want_state": "up:active", 2024-05-08T10:55:06.338 INFO:teuthology.orchestra.run.smithi033.stdout: "state": "up:active", 2024-05-08T10:55:06.338 INFO:teuthology.orchestra.run.smithi033.stdout: "fs_name": "cephfs", 2024-05-08T10:55:06.338 INFO:teuthology.orchestra.run.smithi033.stdout: "rank_uptime": 15.817719311999999, 2024-05-08T10:55:06.338 INFO:teuthology.orchestra.run.smithi033.stdout: "mdsmap_epoch": 7, 2024-05-08T10:55:06.339 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch": 20, 2024-05-08T10:55:06.339 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch_barrier": 20, 2024-05-08T10:55:06.339 INFO:teuthology.orchestra.run.smithi033.stdout: "uptime": 21.83117331 2024-05-08T10:55:06.339 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-05-08T10:55:06.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.334+0000 7fcd38a12640 1 -- 172.21.15.33:0/4272031223 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fcd1406b4d0 msgr2=0x7fcd1406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:06.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.334+0000 7fcd38a12640 1 --2- 172.21.15.33:0/4272031223 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fcd1406b4d0 0x7fcd1406d990 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c034000 tx=0x7fcd1c02e000 comp rx=0 tx=0).stop 2024-05-08T10:55:06.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.334+0000 7fcd38a12640 1 -- 172.21.15.33:0/4272031223 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd340d1ae0 msgr2=0x7fcd340b7850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:06.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.334+0000 7fcd38a12640 1 --2- 172.21.15.33:0/4272031223 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd340d1ae0 0x7fcd340b7850 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fcd2400d830 tx=0x7fcd2400dcf0 comp rx=0 tx=0).stop 2024-05-08T10:55:06.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.334+0000 7fcd38a12640 1 -- 172.21.15.33:0/4272031223 shutdown_connections 2024-05-08T10:55:06.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.334+0000 7fcd38a12640 1 --2- 172.21.15.33:0/4272031223 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fcd1406b4d0 0x7fcd1406d990 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:06.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.334+0000 7fcd38a12640 1 --2- 172.21.15.33:0/4272031223 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcd340d2890 0x7fcd341f3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:06.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.334+0000 7fcd38a12640 1 --2- 172.21.15.33:0/4272031223 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcd340d1ec0 0x7fcd3406c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:06.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.334+0000 7fcd38a12640 1 --2- 172.21.15.33:0/4272031223 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd340d1ae0 0x7fcd340b7850 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:06.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.334+0000 7fcd38a12640 1 -- 172.21.15.33:0/4272031223 >> 172.21.15.33:0/4272031223 conn(0x7fcd340d3be0 msgr2=0x7fcd3415a890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:06.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.334+0000 7fcd38a12640 1 -- 172.21.15.33:0/4272031223 shutdown_connections 2024-05-08T10:55:06.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.334+0000 7fcd38a12640 1 -- 172.21.15.33:0/4272031223 wait complete. 2024-05-08T10:55:06.343 INFO:teuthology.run_tasks:Running task sequential... 2024-05-08T10:55:06.352 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-05-08T10:55:06.352 INFO:teuthology.task.sequential:In sequential, running task print... 2024-05-08T10:55:06.353 INFO:teuthology.task.print:Enabling mgr modules 2024-05-08T10:55:06.353 INFO:teuthology.run_tasks:Running task kclient... 2024-05-08T10:55:06.391 INFO:tasks.kclient:Mounting kernel clients... 2024-05-08T10:55:06.392 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-05-08T10:55:06.392 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:55:06.392 DEBUG:teuthology.orchestra.run.smithi033:> ip netns list 2024-05-08T10:55:06.409 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:55:06.409 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link delete ceph-brx 2024-05-08T10:55:06.477 INFO:teuthology.orchestra.run.smithi033.stderr:Cannot find device "ceph-brx" 2024-05-08T10:55:06.478 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T10:55:06.478 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:55:06.478 DEBUG:teuthology.orchestra.run.smithi033:> ip netns list 2024-05-08T10:55:06.535 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:55:06.535 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link delete ceph-brx 2024-05-08T10:55:06.601 INFO:teuthology.orchestra.run.smithi033.stderr:Cannot find device "ceph-brx" 2024-05-08T10:55:06.603 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T10:55:06.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:55:06.603 DEBUG:teuthology.orchestra.run.smithi174:> ip netns list 2024-05-08T10:55:06.623 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:55:06.623 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip link delete ceph-brx 2024-05-08T10:55:06.695 INFO:teuthology.orchestra.run.smithi174.stderr:Cannot find device "ceph-brx" 2024-05-08T10:55:06.696 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T10:55:06.697 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:55:06.697 DEBUG:teuthology.orchestra.run.smithi174:> ip netns list 2024-05-08T10:55:06.755 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:55:06.755 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip link delete ceph-brx 2024-05-08T10:55:06.823 INFO:teuthology.orchestra.run.smithi174.stderr:Cannot find device "ceph-brx" 2024-05-08T10:55:06.824 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T10:55:06.825 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2024-05-08T10:55:06.825 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-08T10:55:06.825 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-08T10:55:06.825 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-08T10:55:06.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.932+0000 7fc3632ee640 1 Processor -- start 2024-05-08T10:55:06.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.933+0000 7fc3632ee640 1 -- start start 2024-05-08T10:55:06.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.933+0000 7fc3632ee640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fc35c15df20 0x7fc35c0cf170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:06.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.933+0000 7fc3632ee640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc35c0cf6b0 0x7fc35c0d2180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:06.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.933+0000 7fc3632ee640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc35c0d26c0 0x7fc35c0d01b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:06.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.933+0000 7fc3632ee640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc35c0b3140 con 0x7fc35c15df20 2024-05-08T10:55:06.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.934+0000 7fc3632ee640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc35c0b3420 con 0x7fc35c0d26c0 2024-05-08T10:55:06.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.934+0000 7fc3632ee640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc35c0b3700 con 0x7fc35c0cf6b0 2024-05-08T10:55:06.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.934+0000 7fc36108a640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fc35c15df20 0x7fc35c0cf170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:06.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.934+0000 7fc36108a640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fc35c15df20 0x7fc35c0cf170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47770/0 (socket says 172.21.15.33:47770) 2024-05-08T10:55:06.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.934+0000 7fc36108a640 1 -- 172.21.15.33:0/1056426058 learned_addr learned my addr 172.21.15.33:0/1056426058 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:06.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.934+0000 7fc360889640 1 --2- 172.21.15.33:0/1056426058 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc35c0cf6b0 0x7fc35c0d2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:06.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.934+0000 7fc36188b640 1 --2- 172.21.15.33:0/1056426058 >> v2:172.21.15.174:3300/0 conn(0x7fc35c0d26c0 0x7fc35c0d01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:06.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.934+0000 7fc36108a640 1 -- 172.21.15.33:0/1056426058 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc35c0cf6b0 msgr2=0x7fc35c0d2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:06.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.934+0000 7fc36108a640 1 --2- 172.21.15.33:0/1056426058 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc35c0cf6b0 0x7fc35c0d2180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:06.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.934+0000 7fc36108a640 1 -- 172.21.15.33:0/1056426058 >> v2:172.21.15.174:3300/0 conn(0x7fc35c0d26c0 msgr2=0x7fc35c0d01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:06.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.934+0000 7fc36108a640 1 --2- 172.21.15.33:0/1056426058 >> v2:172.21.15.174:3300/0 conn(0x7fc35c0d26c0 0x7fc35c0d01b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:06.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.934+0000 7fc36108a640 1 -- 172.21.15.33:0/1056426058 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc35c0b39e0 con 0x7fc35c15df20 2024-05-08T10:55:06.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.935+0000 7fc36108a640 1 --2- 172.21.15.33:0/1056426058 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc35c15df20 0x7fc35c0cf170 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc35c0cfe30 tx=0x7fc35802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42583a33534a3664 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:06.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.935+0000 7fc353fff640 1 -- 172.21.15.33:0/1056426058 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc358037070 con 0x7fc35c15df20 2024-05-08T10:55:06.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.935+0000 7fc353fff640 1 -- 172.21.15.33:0/1056426058 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc358032440 con 0x7fc35c15df20 2024-05-08T10:55:06.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.935+0000 7fc353fff640 1 -- 172.21.15.33:0/1056426058 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc358032810 con 0x7fc35c15df20 2024-05-08T10:55:06.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.935+0000 7fc3632ee640 1 -- 172.21.15.33:0/1056426058 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc35c15df20 msgr2=0x7fc35c0cf170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:06.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.935+0000 7fc3632ee640 1 --2- 172.21.15.33:0/1056426058 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc35c15df20 0x7fc35c0cf170 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc35c0cfe30 tx=0x7fc35802a270 comp rx=0 tx=0).stop 2024-05-08T10:55:06.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.935+0000 7fc3632ee640 1 -- 172.21.15.33:0/1056426058 shutdown_connections 2024-05-08T10:55:06.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.935+0000 7fc3632ee640 1 --2- 172.21.15.33:0/1056426058 >> v2:172.21.15.174:3300/0 conn(0x7fc35c0d26c0 0x7fc35c0d01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:06.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.935+0000 7fc3632ee640 1 --2- 172.21.15.33:0/1056426058 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc35c0cf6b0 0x7fc35c0d2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:06.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.935+0000 7fc3632ee640 1 --2- 172.21.15.33:0/1056426058 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc35c15df20 0x7fc35c0cf170 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:06.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.935+0000 7fc3632ee640 1 -- 172.21.15.33:0/1056426058 >> 172.21.15.33:0/1056426058 conn(0x7fc35c09ce70 msgr2=0x7fc35c0d3ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:06.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.935+0000 7fc3632ee640 1 -- 172.21.15.33:0/1056426058 shutdown_connections 2024-05-08T10:55:06.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.935+0000 7fc3632ee640 1 -- 172.21.15.33:0/1056426058 wait complete. 2024-05-08T10:55:06.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.937+0000 7fc3632ee640 1 Processor -- start 2024-05-08T10:55:06.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.937+0000 7fc3632ee640 1 -- start start 2024-05-08T10:55:06.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.937+0000 7fc3632ee640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc35c0cf6b0 0x7fc35c0b83f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:06.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.937+0000 7fc3632ee640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc35c0d26c0 0x7fc35c0ccbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:06.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.937+0000 7fc3632ee640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc35c15df20 0x7fc35c15b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:06.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.938+0000 7fc3632ee640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc35c0d1cc0 con 0x7fc35c0d26c0 2024-05-08T10:55:06.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.938+0000 7fc3632ee640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc35c0d1b40 con 0x7fc35c0cf6b0 2024-05-08T10:55:06.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.938+0000 7fc3632ee640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc35c0d06f0 con 0x7fc35c15df20 2024-05-08T10:55:06.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.938+0000 7fc360889640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc35c0d26c0 0x7fc35c0ccbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:06.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.938+0000 7fc360889640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc35c0d26c0 0x7fc35c0ccbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47786/0 (socket says 172.21.15.33:47786) 2024-05-08T10:55:06.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.938+0000 7fc360889640 1 -- 172.21.15.33:0/2951212989 learned_addr learned my addr 172.21.15.33:0/2951212989 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:06.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.938+0000 7fc36108a640 1 --2- 172.21.15.33:0/2951212989 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc35c0cf6b0 0x7fc35c0b83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:06.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.938+0000 7fc36188b640 1 --2- 172.21.15.33:0/2951212989 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc35c15df20 0x7fc35c15b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:06.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.938+0000 7fc360889640 1 -- 172.21.15.33:0/2951212989 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc35c15df20 msgr2=0x7fc35c15b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:06.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.938+0000 7fc360889640 1 --2- 172.21.15.33:0/2951212989 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc35c15df20 0x7fc35c15b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:06.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.938+0000 7fc360889640 1 -- 172.21.15.33:0/2951212989 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc35c0cf6b0 msgr2=0x7fc35c0b83f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:06.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.938+0000 7fc360889640 1 --2- 172.21.15.33:0/2951212989 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc35c0cf6b0 0x7fc35c0b83f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:06.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.938+0000 7fc360889640 1 -- 172.21.15.33:0/2951212989 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc35c15e5b0 con 0x7fc35c0d26c0 2024-05-08T10:55:06.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.938+0000 7fc360889640 1 --2- 172.21.15.33:0/2951212989 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc35c0d26c0 0x7fc35c0ccbe0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc34c00d800 tx=0x7fc34c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:06.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.938+0000 7fc351ffb640 1 -- 172.21.15.33:0/2951212989 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc34c018020 con 0x7fc35c0d26c0 2024-05-08T10:55:06.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.938+0000 7fc351ffb640 1 -- 172.21.15.33:0/2951212989 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc34c0096a0 con 0x7fc35c0d26c0 2024-05-08T10:55:06.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.938+0000 7fc3632ee640 1 -- 172.21.15.33:0/2951212989 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc35c15e850 con 0x7fc35c0d26c0 2024-05-08T10:55:06.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.938+0000 7fc351ffb640 1 -- 172.21.15.33:0/2951212989 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc34c009a70 con 0x7fc35c0d26c0 2024-05-08T10:55:06.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.939+0000 7fc3632ee640 1 -- 172.21.15.33:0/2951212989 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc35c15ee10 con 0x7fc35c0d26c0 2024-05-08T10:55:06.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.939+0000 7fc3632ee640 1 -- 172.21.15.33:0/2951212989 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc35c15d780 con 0x7fc35c0d26c0 2024-05-08T10:55:06.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.940+0000 7fc351ffb640 1 -- 172.21.15.33:0/2951212989 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc34c01b020 con 0x7fc35c0d26c0 2024-05-08T10:55:06.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.940+0000 7fc351ffb640 1 --2- 172.21.15.33:0/2951212989 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fc34006b4d0 0x7fc34006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:06.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.941+0000 7fc351ffb640 1 -- 172.21.15.33:0/2951212989 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc34c08a420 con 0x7fc35c0d26c0 2024-05-08T10:55:06.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.941+0000 7fc36108a640 1 --2- 172.21.15.33:0/2951212989 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fc34006b4d0 0x7fc34006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:06.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.941+0000 7fc36108a640 1 --2- 172.21.15.33:0/2951212989 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fc34006b4d0 0x7fc34006d990 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc358034000 tx=0x7fc35802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:06.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:06.945+0000 7fc351ffb640 1 -- 172.21.15.33:0/2951212989 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc35c15d780 con 0x7fc35c0d26c0 2024-05-08T10:55:07.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:07.163+0000 7fc3632ee640 1 -- 172.21.15.33:0/2951212989 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc35c069d20 con 0x7fc35c0d26c0 2024-05-08T10:55:07.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:07.164+0000 7fc351ffb640 1 -- 172.21.15.33:0/2951212989 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7fc34c022030 con 0x7fc35c0d26c0 2024-05-08T10:55:07.161 INFO:teuthology.orchestra.run.smithi033.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-08T10:55:07.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:07.165+0000 7fc3632ee640 1 -- 172.21.15.33:0/2951212989 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fc34006b4d0 msgr2=0x7fc34006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:07.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:07.165+0000 7fc3632ee640 1 --2- 172.21.15.33:0/2951212989 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fc34006b4d0 0x7fc34006d990 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc358034000 tx=0x7fc35802e000 comp rx=0 tx=0).stop 2024-05-08T10:55:07.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:07.165+0000 7fc3632ee640 1 -- 172.21.15.33:0/2951212989 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc35c0d26c0 msgr2=0x7fc35c0ccbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:07.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:07.166+0000 7fc3632ee640 1 --2- 172.21.15.33:0/2951212989 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc35c0d26c0 0x7fc35c0ccbe0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc34c00d800 tx=0x7fc34c00dcc0 comp rx=0 tx=0).stop 2024-05-08T10:55:07.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:07.166+0000 7fc3632ee640 1 -- 172.21.15.33:0/2951212989 shutdown_connections 2024-05-08T10:55:07.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:07.166+0000 7fc3632ee640 1 --2- 172.21.15.33:0/2951212989 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fc34006b4d0 0x7fc34006d990 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:07.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:07.166+0000 7fc3632ee640 1 --2- 172.21.15.33:0/2951212989 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc35c15df20 0x7fc35c15b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:07.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:07.166+0000 7fc3632ee640 1 --2- 172.21.15.33:0/2951212989 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc35c0d26c0 0x7fc35c0ccbe0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:07.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:07.166+0000 7fc3632ee640 1 --2- 172.21.15.33:0/2951212989 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc35c0cf6b0 0x7fc35c0b83f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:07.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:07.166+0000 7fc3632ee640 1 -- 172.21.15.33:0/2951212989 >> 172.21.15.33:0/2951212989 conn(0x7fc35c09ce70 msgr2=0x7fc35c0b2770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:07.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:07.166+0000 7fc3632ee640 1 -- 172.21.15.33:0/2951212989 shutdown_connections 2024-05-08T10:55:07.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:07.166+0000 7fc3632ee640 1 -- 172.21.15.33:0/2951212989 wait complete. 2024-05-08T10:55:07.174 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-08T10:55:07.174 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-08T10:55:07.174 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi033.front.sepia.ceph.com 2024-05-08T10:55:07.174 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-08T10:55:07.174 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-08T10:55:07.174 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-08T10:55:07.174 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-08T10:55:07.174 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-08T10:55:07.174 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-08T10:55:07.174 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:55:07.175 DEBUG:teuthology.orchestra.run.smithi033:> ip addr 2024-05-08T10:55:07.190 INFO:teuthology.orchestra.run.smithi033.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-08T10:55:07.191 INFO:teuthology.orchestra.run.smithi033.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-08T10:55:07.191 INFO:teuthology.orchestra.run.smithi033.stdout: inet 127.0.0.1/8 scope host lo 2024-05-08T10:55:07.191 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-05-08T10:55:07.191 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 ::1/128 scope host 2024-05-08T10:55:07.191 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-05-08T10:55:07.191 INFO:teuthology.orchestra.run.smithi033.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-08T10:55:07.191 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 0c:c4:7a:6b:fd:14 brd ff:ff:ff:ff:ff:ff 2024-05-08T10:55:07.191 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp7s0f0 2024-05-08T10:55:07.191 INFO:teuthology.orchestra.run.smithi033.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-08T10:55:07.191 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 0c:c4:7a:6b:fd:15 brd ff:ff:ff:ff:ff:ff 2024-05-08T10:55:07.191 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp7s0f1 2024-05-08T10:55:07.191 INFO:teuthology.orchestra.run.smithi033.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-08T10:55:07.191 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether ac:1f:6b:a5:d2:94 brd ff:ff:ff:ff:ff:ff 2024-05-08T10:55:07.192 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp1s0f0 2024-05-08T10:55:07.192 INFO:teuthology.orchestra.run.smithi033.stdout: inet 172.21.15.33/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-05-08T10:55:07.192 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft 42753sec preferred_lft 42753sec 2024-05-08T10:55:07.192 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::ae1f:6bff:fea5:d294/64 scope link noprefixroute 2024-05-08T10:55:07.192 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-05-08T10:55:07.192 INFO:teuthology.orchestra.run.smithi033.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-08T10:55:07.192 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether ac:1f:6b:a5:d2:95 brd ff:ff:ff:ff:ff:ff 2024-05-08T10:55:07.192 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp1s0f1 2024-05-08T10:55:07.192 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-08T10:55:07.193 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-08T10:55:07.193 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2024-05-08T10:55:07.193 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link add name ceph-brx type bridge 2024-05-08T10:55:07.193 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip addr flush dev ceph-brx 2024-05-08T10:55:07.193 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link set ceph-brx up 2024-05-08T10:55:07.193 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-08T10:55:07.193 DEBUG:teuthology.orchestra.run.smithi033:> ') 2024-05-08T10:55:07.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-08T10:55:07.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T10:55:07.384 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:55:07.384 DEBUG:teuthology.orchestra.run.smithi033:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-08T10:55:07.410 INFO:teuthology.orchestra.run.smithi033.stdout:1 2024-05-08T10:55:07.411 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:55:07.412 DEBUG:teuthology.orchestra.run.smithi033:> route 2024-05-08T10:55:07.477 INFO:teuthology.orchestra.run.smithi033.stdout:Kernel IP routing table 2024-05-08T10:55:07.477 INFO:teuthology.orchestra.run.smithi033.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-08T10:55:07.477 INFO:teuthology.orchestra.run.smithi033.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-05-08T10:55:07.477 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-05-08T10:55:07.477 INFO:teuthology.orchestra.run.smithi033.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-08T10:55:07.478 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-08T10:55:07.478 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2024-05-08T10:55:07.478 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-05-08T10:55:07.478 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-05-08T10:55:07.478 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-05-08T10:55:07.478 DEBUG:teuthology.orchestra.run.smithi033:> ') 2024-05-08T10:55:07.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-08T10:55:07.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T10:55:07.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:55:07.838 DEBUG:teuthology.orchestra.run.smithi033:> ip netns list 2024-05-08T10:55:07.855 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:55:07.855 DEBUG:teuthology.orchestra.run.smithi033:> ip netns list-id 2024-05-08T10:55:07.911 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-08T10:55:07.911 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2024-05-08T10:55:07.912 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-08T10:55:07.912 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-05-08T10:55:07.912 DEBUG:teuthology.orchestra.run.smithi033:> ') 2024-05-08T10:55:08.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-08T10:55:08.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T10:55:08.034 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-05-08T10:55:08.035 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-08T10:55:08.035 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2024-05-08T10:55:08.035 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-05-08T10:55:08.035 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-08T10:55:08.035 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-05-08T10:55:08.035 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-05-08T10:55:08.035 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-05-08T10:55:08.035 DEBUG:teuthology.orchestra.run.smithi033:> ') 2024-05-08T10:55:08.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-08T10:55:08.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T10:55:08.186 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-08T10:55:08.187 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2024-05-08T10:55:08.187 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link set brx.0 up 2024-05-08T10:55:08.187 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link set dev brx.0 master ceph-brx 2024-05-08T10:55:08.187 DEBUG:teuthology.orchestra.run.smithi033:> ') 2024-05-08T10:55:08.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-08T10:55:08.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T10:55:08.270 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-08T10:55:08.270 DEBUG:teuthology.orchestra.run.smithi033:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-08T10:55:08.286 INFO:teuthology.orchestra.run.smithi033.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-08T10:55:08.286 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-08T10:55:08.286 DEBUG:teuthology.orchestra.run.smithi033:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-08T10:55:08.342 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-05-08T10:55:08.342 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:55:08.342 DEBUG:teuthology.orchestra.run.smithi033:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-08T10:55:08.468 INFO:teuthology.orchestra.run.smithi033.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-08T10:55:08.468 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-08T10:55:08.587 INFO:teuthology.orchestra.run.smithi033.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-08T10:55:08.587 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-08T10:55:08.587 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: resolved to: "172.21.15.33:3300,172.21.15.174:3300,172.21.15.174:3301" 2024-05-08T10:55:08.587 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: trying mount with new device syntax: 0@963217b2-c375-4f5a-95cf-88e199dd38ff.cephfs=/ 2024-05-08T10:55:08.587 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.33:3300/172.21.15.174:3300/172.21.15.174:3301" will pass to kernel 2024-05-08T10:55:08.588 INFO:teuthology.orchestra.run.smithi033.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-05-08T10:55:08.588 INFO:teuthology.orchestra.run.smithi033.stdout: You just mounted a file system that supports labels which does not 2024-05-08T10:55:08.588 INFO:teuthology.orchestra.run.smithi033.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-08T10:55:08.588 INFO:teuthology.orchestra.run.smithi033.stdout: applications will generate AVC messages and not be allowed access to 2024-05-08T10:55:08.588 INFO:teuthology.orchestra.run.smithi033.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-08T10:55:08.591 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-08T10:55:08.591 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:55:08.591 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-08T10:55:08.617 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-08T10:55:08.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:08 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-08T10:55:08.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T10:55:08.720 INFO:teuthology.orchestra.run.smithi033.stdout:client4558 2024-05-08T10:55:08.721 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-05-08T10:55:08.721 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T10:55:08.737 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-08T10:55:08.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:08 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-08T10:55:08.835 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T10:55:08.841 INFO:teuthology.orchestra.run.smithi033.stdout:client4558 2024-05-08T10:55:08.841 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-08T10:55:08.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:08 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-08T10:55:08.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T10:55:08.906 INFO:teuthology.orchestra.run.smithi033.stdout:client4558 2024-05-08T10:55:08.907 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/963217b2-c375-4f5a-95cf-88e199dd38ff.client4558/status') 2024-05-08T10:55:08.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-08T10:55:08.973 INFO:teuthology.orchestra.run.smithi033.stdout:instance: client.4558 (3)172.21.15.33:0/3998864418 2024-05-08T10:55:08.973 INFO:teuthology.orchestra.run.smithi033.stdout:blocklisted: false 2024-05-08T10:55:08.973 INFO:teuthology.orchestra.run.smithi033.stderr:0+1 records in 2024-05-08T10:55:08.973 INFO:teuthology.orchestra.run.smithi033.stderr:0+1 records out 2024-05-08T10:55:08.973 INFO:teuthology.orchestra.run.smithi033.stderr:70 bytes copied, 2.5807e-05 s, 2.7 MB/s 2024-05-08T10:55:08.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T10:55:08.980 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2024-05-08T10:55:08.980 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-08T10:55:08.980 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-05-08T10:55:08.981 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-08T10:55:09.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:09.087+0000 7f8066d77640 1 Processor -- start 2024-05-08T10:55:09.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:09.087+0000 7f8066d77640 1 -- start start 2024-05-08T10:55:09.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:09.088+0000 7f8066d77640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f806006d100 0x7f80601624d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:09.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:09.088+0000 7f8066d77640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f806015efe0 con 0x7f806006aba0 2024-05-08T10:55:09.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:09.088+0000 7f8066d77640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80601619f0 con 0x7f806015e9d0 2024-05-08T10:55:09.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:09.088+0000 7f8066d77640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f806015f2c0 con 0x7f806006d100 2024-05-08T10:55:09.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:09.088+0000 7f8064b13640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f806006d100 0x7f80601624d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:09.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:09.088+0000 7f805ffff640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f806006aba0 0x7f806015e2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:48154/0 (socket says 172.21.15.33:48154) 2024-05-08T10:55:09.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:09.088+0000 7f805ffff640 1 -- 172.21.15.33:0/3029613813 learned_addr learned my addr 172.21.15.33:0/3029613813 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-05-08T10:55:09.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:09.089+0000 7f8064b13640 1 -- 172.21.15.33:0/3029613813 >> v1:172.21.15.174:6789/0 conn(0x7f806015e9d0 legacy=0x7f806006d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:09.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:09.089+0000 7f8064b13640 1 -- 172.21.15.33:0/3029613813 >> v1:172.21.15.33:6789/0 conn(0x7f806006aba0 legacy=0x7f806015e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:09.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:09.089+0000 7f8064b13640 1 -- 172.21.15.33:0/3029613813 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8060161cd0 con 0x7f806006d100 2024-05-08T10:55:09.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:09.089+0000 7f8064b13640 1 --2- 172.21.15.33:0/3029613813 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f806006d100 0x7f80601624d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f80580097a0 tx=0x7f805802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96460602c553ab8e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:09.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:09.090+0000 7f805f7fe640 1 -- 172.21.15.33:0/3029613813 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8058037070 con 0x7f806006d100 2024-05-08T10:55:09.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:09.090+0000 7f805f7fe640 1 -- 172.21.15.33:0/3029613813 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f805802ae50 con 0x7f806006d100 2024-05-08T10:55:09.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:09.090+0000 7f805f7fe640 1 -- 172.21.15.33:0/3029613813 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8058032660 con 0x7f806006d100 2024-05-08T10:55:09.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:09.090+0000 7f8066d77640 1 -- 172.21.15.33:0/3029613813 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f806006d100 msgr2=0x7f80601624d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:09.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:09.090+0000 7f8066d77640 1 --2- 172.21.15.33:0/3029613813 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f806006d100 0x7f80601624d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f80580097a0 tx=0x7f805802a140 comp rx=0 tx=0).stop 2024-05-08T10:55:09.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:09.090+0000 7f8066d77640 1 -- 172.21.15.33:0/3029613813 shutdown_connections 2024-05-08T10:55:09.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:09.090+0000 7f8066d77640 1 --2- 172.21.15.33:0/3029613813 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f806006d100 0x7f80601624d0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:09.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:09.090+0000 7f8066d77640 1 -- 172.21.15.33:0/3029613813 >> 172.21.15.33:0/3029613813 conn(0x7f80600d0090 msgr2=0x7f80600d04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:09.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:09.090+0000 7f8066d77640 1 -- 172.21.15.33:0/3029613813 shutdown_connections 2024-05-08T10:55:09.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:09.090+0000 7f8066d77640 1 -- 172.21.15.33:0/3029613813 wait complete. 2024-05-08T10:55:09.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:09.091+0000 7f8066d77640 1 Processor -- start 2024-05-08T10:55:09.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:09.091+0000 7f8066d77640 1 -- start start 2024-05-08T10:55:09.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:09.092+0000 7f8066d77640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f806006aba0 0x7f806015d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:09.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:09.092+0000 7f8066d77640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f806006d100 0x7f80601f37c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:09.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:09.092+0000 7f8066d77640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f806015e9d0 0x7f8060158820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:09.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:09.092+0000 7f8066d77640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f806006b1b0 con 0x7f806015e9d0 2024-05-08T10:55:09.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:09.092+0000 7f8066d77640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f806006b030 con 0x7f806006d100 2024-05-08T10:55:09.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:09.092+0000 7f8066d77640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f806006b330 con 0x7f806006aba0 2024-05-08T10:55:09.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:09.092+0000 7f8065314640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f806015e9d0 0x7f8060158820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:09.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:09.093+0000 7f8065314640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f806015e9d0 0x7f8060158820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47804/0 (socket says 172.21.15.33:47804) 2024-05-08T10:55:09.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:09.093+0000 7f8065314640 1 -- 172.21.15.33:0/1690450824 learned_addr learned my addr 172.21.15.33:0/1690450824 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:09.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:09.093+0000 7f805ffff640 1 --2- 172.21.15.33:0/1690450824 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f806006d100 0x7f80601f37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:09.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:09.093+0000 7f8064b13640 1 --2- 172.21.15.33:0/1690450824 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f806006aba0 0x7f806015d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:09.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:09.093+0000 7f8065314640 1 -- 172.21.15.33:0/1690450824 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f806006aba0 msgr2=0x7f806015d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:09.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:09.093+0000 7f8065314640 1 --2- 172.21.15.33:0/1690450824 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f806006aba0 0x7f806015d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:09.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:09.093+0000 7f8065314640 1 -- 172.21.15.33:0/1690450824 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f806006d100 msgr2=0x7f80601f37c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:09.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:09.093+0000 7f8065314640 1 --2- 172.21.15.33:0/1690450824 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f806006d100 0x7f80601f37c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:09.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:09.093+0000 7f8065314640 1 -- 172.21.15.33:0/1690450824 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80601f3d00 con 0x7f806015e9d0 2024-05-08T10:55:09.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:09.093+0000 7f805ffff640 1 --2- 172.21.15.33:0/1690450824 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f806006d100 0x7f80601f37c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:55:09.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:09.093+0000 7f8065314640 1 --2- 172.21.15.33:0/1690450824 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f806015e9d0 0x7f8060158820 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f804800c410 tx=0x7f804800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:09.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:09.093+0000 7f805d7fa640 1 -- 172.21.15.33:0/1690450824 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8048011790 con 0x7f806015e9d0 2024-05-08T10:55:09.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:09.093+0000 7f805d7fa640 1 -- 172.21.15.33:0/1690450824 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8048017070 con 0x7f806015e9d0 2024-05-08T10:55:09.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:09.093+0000 7f805d7fa640 1 -- 172.21.15.33:0/1690450824 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8048011b70 con 0x7f806015e9d0 2024-05-08T10:55:09.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:09.093+0000 7f8066d77640 1 -- 172.21.15.33:0/1690450824 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8060158d60 con 0x7f806015e9d0 2024-05-08T10:55:09.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:09.093+0000 7f8066d77640 1 -- 172.21.15.33:0/1690450824 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f806009c1e0 con 0x7f806015e9d0 2024-05-08T10:55:09.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:09.094+0000 7f8066d77640 1 -- 172.21.15.33:0/1690450824 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8060069d20 con 0x7f806015e9d0 2024-05-08T10:55:09.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:09.095+0000 7f805d7fa640 1 -- 172.21.15.33:0/1690450824 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8048011d10 con 0x7f806015e9d0 2024-05-08T10:55:09.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:09.095+0000 7f805d7fa640 1 --2- 172.21.15.33:0/1690450824 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f804006b4d0 0x7f804006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:09.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:09.095+0000 7f805d7fa640 1 -- 172.21.15.33:0/1690450824 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8048089d60 con 0x7f806015e9d0 2024-05-08T10:55:09.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:09.095+0000 7f8064b13640 1 --2- 172.21.15.33:0/1690450824 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f804006b4d0 0x7f804006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:09.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:09.096+0000 7f8064b13640 1 --2- 172.21.15.33:0/1690450824 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f804006b4d0 0x7f804006d990 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8058034000 tx=0x7f805802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:09.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:09.099+0000 7f805d7fa640 1 -- 172.21.15.33:0/1690450824 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8048021020 con 0x7f806015e9d0 2024-05-08T10:55:09.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:09.322+0000 7f8066d77640 1 -- 172.21.15.33:0/1690450824 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f80600008d0 con 0x7f806015e9d0 2024-05-08T10:55:09.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:09.322+0000 7f805d7fa640 1 -- 172.21.15.33:0/1690450824 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7f8060158d60 con 0x7f806015e9d0 2024-05-08T10:55:09.318 INFO:teuthology.orchestra.run.smithi033.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-08T10:55:09.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:09.324+0000 7f8066d77640 1 -- 172.21.15.33:0/1690450824 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f804006b4d0 msgr2=0x7f804006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:09.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:09.324+0000 7f8066d77640 1 --2- 172.21.15.33:0/1690450824 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f804006b4d0 0x7f804006d990 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8058034000 tx=0x7f805802e000 comp rx=0 tx=0).stop 2024-05-08T10:55:09.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:09.324+0000 7f8066d77640 1 -- 172.21.15.33:0/1690450824 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f806015e9d0 msgr2=0x7f8060158820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:09.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:09.324+0000 7f8066d77640 1 --2- 172.21.15.33:0/1690450824 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f806015e9d0 0x7f8060158820 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f804800c410 tx=0x7f804800c8d0 comp rx=0 tx=0).stop 2024-05-08T10:55:09.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:09.324+0000 7f8066d77640 1 -- 172.21.15.33:0/1690450824 shutdown_connections 2024-05-08T10:55:09.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:09.324+0000 7f8066d77640 1 --2- 172.21.15.33:0/1690450824 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f804006b4d0 0x7f804006d990 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:09.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:09.324+0000 7f8066d77640 1 --2- 172.21.15.33:0/1690450824 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f806015e9d0 0x7f8060158820 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:09.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:09.324+0000 7f8066d77640 1 --2- 172.21.15.33:0/1690450824 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f806006d100 0x7f80601f37c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:09.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:09.324+0000 7f8066d77640 1 --2- 172.21.15.33:0/1690450824 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f806006aba0 0x7f806015d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:09.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:09.324+0000 7f8066d77640 1 -- 172.21.15.33:0/1690450824 >> 172.21.15.33:0/1690450824 conn(0x7f80600d0090 msgr2=0x7f8060160570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:09.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:09.324+0000 7f8066d77640 1 -- 172.21.15.33:0/1690450824 shutdown_connections 2024-05-08T10:55:09.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:09.324+0000 7f8066d77640 1 -- 172.21.15.33:0/1690450824 wait complete. 2024-05-08T10:55:09.331 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-08T10:55:09.331 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-08T10:55:09.331 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi033.front.sepia.ceph.com 2024-05-08T10:55:09.331 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-05-08T10:55:09.331 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-05-08T10:55:09.331 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-08T10:55:09.331 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-08T10:55:09.331 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-08T10:55:09.331 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-05-08T10:55:09.332 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:55:09.332 DEBUG:teuthology.orchestra.run.smithi033:> ip addr 2024-05-08T10:55:09.348 INFO:teuthology.orchestra.run.smithi033.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-08T10:55:09.348 INFO:teuthology.orchestra.run.smithi033.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-08T10:55:09.348 INFO:teuthology.orchestra.run.smithi033.stdout: inet 127.0.0.1/8 scope host lo 2024-05-08T10:55:09.348 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-05-08T10:55:09.348 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 ::1/128 scope host 2024-05-08T10:55:09.349 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-05-08T10:55:09.349 INFO:teuthology.orchestra.run.smithi033.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-08T10:55:09.349 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 0c:c4:7a:6b:fd:14 brd ff:ff:ff:ff:ff:ff 2024-05-08T10:55:09.349 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp7s0f0 2024-05-08T10:55:09.349 INFO:teuthology.orchestra.run.smithi033.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-08T10:55:09.349 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 0c:c4:7a:6b:fd:15 brd ff:ff:ff:ff:ff:ff 2024-05-08T10:55:09.349 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp7s0f1 2024-05-08T10:55:09.349 INFO:teuthology.orchestra.run.smithi033.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-08T10:55:09.349 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether ac:1f:6b:a5:d2:94 brd ff:ff:ff:ff:ff:ff 2024-05-08T10:55:09.349 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp1s0f0 2024-05-08T10:55:09.349 INFO:teuthology.orchestra.run.smithi033.stdout: inet 172.21.15.33/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-05-08T10:55:09.349 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft 42751sec preferred_lft 42751sec 2024-05-08T10:55:09.349 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::ae1f:6bff:fea5:d294/64 scope link noprefixroute 2024-05-08T10:55:09.350 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-05-08T10:55:09.350 INFO:teuthology.orchestra.run.smithi033.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-08T10:55:09.350 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether ac:1f:6b:a5:d2:95 brd ff:ff:ff:ff:ff:ff 2024-05-08T10:55:09.350 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp1s0f1 2024-05-08T10:55:09.350 INFO:teuthology.orchestra.run.smithi033.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-08T10:55:09.350 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 5e:1d:15:2d:e4:95 brd ff:ff:ff:ff:ff:ff 2024-05-08T10:55:09.350 INFO:teuthology.orchestra.run.smithi033.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-08T10:55:09.350 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-05-08T10:55:09.350 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::acf4:9cff:fe29:3730/64 scope link tentative 2024-05-08T10:55:09.350 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-05-08T10:55:09.350 INFO:teuthology.orchestra.run.smithi033.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-08T10:55:09.350 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 5e:1d:15:2d:e4:95 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-08T10:55:09.350 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::5c1d:15ff:fe2d:e495/64 scope link tentative 2024-05-08T10:55:09.350 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-05-08T10:55:09.351 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:55:09.351 DEBUG:teuthology.orchestra.run.smithi033:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-08T10:55:09.413 INFO:teuthology.orchestra.run.smithi033.stdout:1 2024-05-08T10:55:09.415 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:55:09.415 DEBUG:teuthology.orchestra.run.smithi033:> route 2024-05-08T10:55:09.472 INFO:teuthology.orchestra.run.smithi033.stdout:Kernel IP routing table 2024-05-08T10:55:09.472 INFO:teuthology.orchestra.run.smithi033.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-08T10:55:09.472 INFO:teuthology.orchestra.run.smithi033.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-05-08T10:55:09.472 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-05-08T10:55:09.472 INFO:teuthology.orchestra.run.smithi033.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-08T10:55:09.473 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-08T10:55:09.473 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2024-05-08T10:55:09.473 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-05-08T10:55:09.473 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-05-08T10:55:09.473 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-05-08T10:55:09.473 DEBUG:teuthology.orchestra.run.smithi033:> ') 2024-05-08T10:55:09.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-08T10:55:09.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T10:55:09.602 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:55:09.602 DEBUG:teuthology.orchestra.run.smithi033:> ip netns list 2024-05-08T10:55:09.618 INFO:teuthology.orchestra.run.smithi033.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-08T10:55:09.618 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:55:09.619 DEBUG:teuthology.orchestra.run.smithi033:> ip netns list-id 2024-05-08T10:55:09.674 INFO:teuthology.orchestra.run.smithi033.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-05-08T10:55:09.674 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-08T10:55:09.674 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2024-05-08T10:55:09.674 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-08T10:55:09.674 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-05-08T10:55:09.674 DEBUG:teuthology.orchestra.run.smithi033:> ') 2024-05-08T10:55:09.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-08T10:55:09.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T10:55:09.793 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:55:09.794 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-05-08T10:55:09.819 INFO:teuthology.orchestra.run.smithi033.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-08T10:55:09.819 INFO:teuthology.orchestra.run.smithi033.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-08T10:55:09.819 INFO:teuthology.orchestra.run.smithi033.stdout: inet 127.0.0.1/8 scope host lo 2024-05-08T10:55:09.819 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-05-08T10:55:09.820 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 ::1/128 scope host 2024-05-08T10:55:09.820 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-05-08T10:55:09.820 INFO:teuthology.orchestra.run.smithi033.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-08T10:55:09.820 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether a2:26:a9:89:48:6b brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-05-08T10:55:09.820 INFO:teuthology.orchestra.run.smithi033.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-05-08T10:55:09.820 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-05-08T10:55:09.820 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::a026:a9ff:fe89:486b/64 scope link tentative 2024-05-08T10:55:09.820 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-05-08T10:55:09.821 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:55:09.821 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-05-08T10:55:09.886 INFO:teuthology.orchestra.run.smithi033.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-08T10:55:09.887 INFO:teuthology.orchestra.run.smithi033.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-08T10:55:09.887 INFO:teuthology.orchestra.run.smithi033.stdout: inet 127.0.0.1/8 scope host lo 2024-05-08T10:55:09.887 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-05-08T10:55:09.887 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 ::1/128 scope host 2024-05-08T10:55:09.887 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-05-08T10:55:09.887 INFO:teuthology.orchestra.run.smithi033.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-08T10:55:09.887 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether a2:26:a9:89:48:6b brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-05-08T10:55:09.887 INFO:teuthology.orchestra.run.smithi033.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-05-08T10:55:09.887 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-05-08T10:55:09.887 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::a026:a9ff:fe89:486b/64 scope link tentative 2024-05-08T10:55:09.887 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-05-08T10:55:09.888 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-05-08T10:55:09.889 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-08T10:55:09.889 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2024-05-08T10:55:09.889 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-05-08T10:55:09.889 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-05-08T10:55:09.889 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-05-08T10:55:09.889 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-05-08T10:55:09.889 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-05-08T10:55:09.889 DEBUG:teuthology.orchestra.run.smithi033:> ') 2024-05-08T10:55:09.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-08T10:55:10.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T10:55:10.045 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-08T10:55:10.046 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2024-05-08T10:55:10.046 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link set brx.1 up 2024-05-08T10:55:10.046 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link set dev brx.1 master ceph-brx 2024-05-08T10:55:10.046 DEBUG:teuthology.orchestra.run.smithi033:> ') 2024-05-08T10:55:10.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-08T10:55:10.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T10:55:10.127 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-08T10:55:10.128 DEBUG:teuthology.orchestra.run.smithi033:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-05-08T10:55:10.143 INFO:teuthology.orchestra.run.smithi033.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-05-08T10:55:10.143 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-08T10:55:10.143 DEBUG:teuthology.orchestra.run.smithi033:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-05-08T10:55:10.199 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2024-05-08T10:55:10.199 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:55:10.199 DEBUG:teuthology.orchestra.run.smithi033:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-08T10:55:10.284 INFO:teuthology.orchestra.run.smithi033.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-08T10:55:10.284 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-08T10:55:10.302 INFO:teuthology.orchestra.run.smithi033.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-08T10:55:10.303 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-08T10:55:10.303 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: resolved to: "172.21.15.33:3300,172.21.15.174:3300,172.21.15.174:3301" 2024-05-08T10:55:10.303 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: trying mount with new device syntax: 2@963217b2-c375-4f5a-95cf-88e199dd38ff.cephfs=/ 2024-05-08T10:55:10.303 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.33:3300/172.21.15.174:3300/172.21.15.174:3301" will pass to kernel 2024-05-08T10:55:10.303 INFO:teuthology.orchestra.run.smithi033.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2024-05-08T10:55:10.303 INFO:teuthology.orchestra.run.smithi033.stdout: You just mounted a file system that supports labels which does not 2024-05-08T10:55:10.304 INFO:teuthology.orchestra.run.smithi033.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-08T10:55:10.304 INFO:teuthology.orchestra.run.smithi033.stdout: applications will generate AVC messages and not be allowed access to 2024-05-08T10:55:10.304 INFO:teuthology.orchestra.run.smithi033.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-08T10:55:10.305 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-08T10:55:10.305 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:55:10.306 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-05-08T10:55:10.331 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-08T10:55:10.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:10 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-08T10:55:10.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T10:55:10.429 INFO:teuthology.orchestra.run.smithi033.stdout:client4487 2024-05-08T10:55:10.430 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-05-08T10:55:10.430 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T10:55:10.446 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-08T10:55:10.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:10 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-08T10:55:10.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T10:55:10.545 INFO:teuthology.orchestra.run.smithi033.stdout:client4487 2024-05-08T10:55:10.545 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-08T10:55:10.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:10 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-08T10:55:10.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T10:55:10.603 INFO:teuthology.orchestra.run.smithi033.stdout:client4487 2024-05-08T10:55:10.604 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/963217b2-c375-4f5a-95cf-88e199dd38ff.client4487/status') 2024-05-08T10:55:10.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-08T10:55:10.664 INFO:teuthology.orchestra.run.smithi033.stdout:instance: client.4487 (3)172.21.15.33:0/2595936043 2024-05-08T10:55:10.665 INFO:teuthology.orchestra.run.smithi033.stdout:blocklisted: false 2024-05-08T10:55:10.665 INFO:teuthology.orchestra.run.smithi033.stderr:0+1 records in 2024-05-08T10:55:10.665 INFO:teuthology.orchestra.run.smithi033.stderr:0+1 records out 2024-05-08T10:55:10.665 INFO:teuthology.orchestra.run.smithi033.stderr:70 bytes copied, 2.498e-05 s, 2.8 MB/s 2024-05-08T10:55:10.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T10:55:10.673 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2024-05-08T10:55:10.673 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-08T10:55:10.673 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-05-08T10:55:10.674 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-08T10:55:10.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:10.781+0000 7f399fb7e640 1 Processor -- start 2024-05-08T10:55:10.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:10.781+0000 7f399fb7e640 1 -- start start 2024-05-08T10:55:10.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:10.782+0000 7f399fb7e640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f399813fa10 0x7f399815af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:10.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:10.782+0000 7f399fb7e640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f399813fdf0 0x7f399813d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:10.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:10.782+0000 7f399fb7e640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f399806c860 con 0x7f39980b3600 2024-05-08T10:55:10.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:10.782+0000 7f399fb7e640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f399806cb40 con 0x7f399813fdf0 2024-05-08T10:55:10.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:10.782+0000 7f399fb7e640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f399806ce20 con 0x7f399813fa10 2024-05-08T10:55:10.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:10.782+0000 7f399e11b640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f39980b3600 0x7f399806d620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:48156/0 (socket says 172.21.15.33:48156) 2024-05-08T10:55:10.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:10.782+0000 7f399e11b640 1 -- 172.21.15.33:0/1394532286 learned_addr learned my addr 172.21.15.33:0/1394532286 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-05-08T10:55:10.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:10.782+0000 7f399d91a640 1 --2- 172.21.15.33:0/1394532286 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f399813fa10 0x7f399815af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:10.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:10.782+0000 7f399d119640 1 --2- 172.21.15.33:0/1394532286 >> v2:172.21.15.174:3300/0 conn(0x7f399813fdf0 0x7f399813d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:10.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:10.783+0000 7f399c918640 1 -- 172.21.15.33:0/1394532286 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 301066362 0 0) 0x7f399806c860 con 0x7f39980b3600 2024-05-08T10:55:10.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:10.783+0000 7f399c918640 1 -- 172.21.15.33:0/1394532286 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3980003520 con 0x7f39980b3600 2024-05-08T10:55:10.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:10.783+0000 7f399c918640 1 -- 172.21.15.33:0/1394532286 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 660585827 0 0) 0x7f3980003520 con 0x7f39980b3600 2024-05-08T10:55:10.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:10.783+0000 7f399c918640 1 -- 172.21.15.33:0/1394532286 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f399813fa10 msgr2=0x7f399815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:10.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:10.783+0000 7f399c918640 1 --2- 172.21.15.33:0/1394532286 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f399813fa10 0x7f399815af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:10.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:10.783+0000 7f399c918640 1 -- 172.21.15.33:0/1394532286 >> v2:172.21.15.174:3300/0 conn(0x7f399813fdf0 msgr2=0x7f399813d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:10.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:10.783+0000 7f399c918640 1 --2- 172.21.15.33:0/1394532286 >> v2:172.21.15.174:3300/0 conn(0x7f399813fdf0 0x7f399813d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:10.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:10.783+0000 7f399c918640 1 -- 172.21.15.33:0/1394532286 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f399806d100 con 0x7f39980b3600 2024-05-08T10:55:10.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:10.783+0000 7f399c918640 1 -- 172.21.15.33:0/1394532286 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2948294915 0 0) 0x7f39880019f0 con 0x7f39980b3600 2024-05-08T10:55:10.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:10.783+0000 7f399c918640 1 -- 172.21.15.33:0/1394532286 >> v1:172.21.15.33:6789/0 conn(0x7f39980b3600 legacy=0x7f399806d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:10.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:10.783+0000 7f399c918640 1 --2- 172.21.15.33:0/1394532286 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f39800039b0 0x7f3980003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:10.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:10.783+0000 7f399c918640 1 --2- 172.21.15.33:0/1394532286 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f399813fa10 0x7f3980004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:10.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:10.783+0000 7f399c918640 1 --2- 172.21.15.33:0/1394532286 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3980004d40 0x7f39800051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:10.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:10.783+0000 7f399c918640 1 -- 172.21.15.33:0/1394532286 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f399806cb40 con 0x7f3980004d40 2024-05-08T10:55:10.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:10.783+0000 7f399c918640 1 -- 172.21.15.33:0/1394532286 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f399806ce20 con 0x7f39800039b0 2024-05-08T10:55:10.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:10.783+0000 7f399c918640 1 -- 172.21.15.33:0/1394532286 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f398000b9c0 con 0x7f399813fa10 2024-05-08T10:55:10.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:10.783+0000 7f399e11b640 1 --2- 172.21.15.33:0/1394532286 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3980004d40 0x7f39800051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:10.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:10.783+0000 7f399d91a640 1 --2- 172.21.15.33:0/1394532286 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f39800039b0 0x7f3980003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:10.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:10.783+0000 7f399d119640 1 --2- 172.21.15.33:0/1394532286 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f399813fa10 0x7f3980004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:10.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:10.783+0000 7f399e11b640 1 -- 172.21.15.33:0/1394532286 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f399813fa10 msgr2=0x7f3980004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:10.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:10.783+0000 7f399e11b640 1 --2- 172.21.15.33:0/1394532286 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f399813fa10 0x7f3980004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:10.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:10.783+0000 7f399e11b640 1 -- 172.21.15.33:0/1394532286 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f39800039b0 msgr2=0x7f3980003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:10.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:10.783+0000 7f399e11b640 1 --2- 172.21.15.33:0/1394532286 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f39800039b0 0x7f3980003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:10.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:10.783+0000 7f399e11b640 1 -- 172.21.15.33:0/1394532286 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3980003520 con 0x7f3980004d40 2024-05-08T10:55:10.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:10.784+0000 7f399e11b640 1 --2- 172.21.15.33:0/1394532286 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3980004d40 0x7f39800051c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f398800cb20 tx=0x7f3980005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=528e14631181e8e5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:10.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:10.784+0000 7f399c918640 1 -- 172.21.15.33:0/1394532286 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f398800c740 con 0x7f3980004d40 2024-05-08T10:55:10.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:10.784+0000 7f399c918640 1 -- 172.21.15.33:0/1394532286 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f398802de50 con 0x7f3980004d40 2024-05-08T10:55:10.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:10.784+0000 7f399c918640 1 -- 172.21.15.33:0/1394532286 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3988035890 con 0x7f3980004d40 2024-05-08T10:55:10.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:10.785+0000 7f399fb7e640 1 -- 172.21.15.33:0/1394532286 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3980004d40 msgr2=0x7f39800051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:10.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:10.785+0000 7f399fb7e640 1 --2- 172.21.15.33:0/1394532286 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3980004d40 0x7f39800051c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f398800cb20 tx=0x7f3980005830 comp rx=0 tx=0).stop 2024-05-08T10:55:10.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:10.785+0000 7f399e11b640 1 -- 172.21.15.33:0/1394532286 reap_dead start 2024-05-08T10:55:10.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:10.785+0000 7f399fb7e640 1 -- 172.21.15.33:0/1394532286 shutdown_connections 2024-05-08T10:55:10.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:10.785+0000 7f399fb7e640 1 -- 172.21.15.33:0/1394532286 >> 172.21.15.33:0/1394532286 conn(0x7f399806aba0 msgr2=0x7f399806afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:10.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:10.785+0000 7f399fb7e640 1 -- 172.21.15.33:0/1394532286 shutdown_connections 2024-05-08T10:55:10.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:10.785+0000 7f399fb7e640 1 -- 172.21.15.33:0/1394532286 wait complete. 2024-05-08T10:55:10.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:10.786+0000 7f399fb7e640 1 Processor -- start 2024-05-08T10:55:10.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:10.786+0000 7f399fb7e640 1 -- start start 2024-05-08T10:55:10.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:10.787+0000 7f399fb7e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f399813e950 0x7f39980709f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:10.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:10.787+0000 7f399fb7e640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f39981551f0 0x7f399813c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:10.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:10.787+0000 7f399fb7e640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f399813ed30 0x7f399813cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:10.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:10.787+0000 7f399fb7e640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f399806deb0 con 0x7f399813e950 2024-05-08T10:55:10.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:10.787+0000 7f399fb7e640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f399806dd30 con 0x7f39981551f0 2024-05-08T10:55:10.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:10.787+0000 7f399fb7e640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f399815af00 con 0x7f399813ed30 2024-05-08T10:55:10.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:10.787+0000 7f399d91a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f399813e950 0x7f39980709f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:10.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:10.787+0000 7f399d91a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f399813e950 0x7f39980709f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47820/0 (socket says 172.21.15.33:47820) 2024-05-08T10:55:10.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:10.787+0000 7f399d91a640 1 -- 172.21.15.33:0/3786433686 learned_addr learned my addr 172.21.15.33:0/3786433686 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:10.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:10.787+0000 7f399e11b640 1 --2- 172.21.15.33:0/3786433686 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f399813ed30 0x7f399813cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:10.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:10.787+0000 7f399d119640 1 --2- 172.21.15.33:0/3786433686 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f39981551f0 0x7f399813c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:10.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:10.787+0000 7f399d91a640 1 -- 172.21.15.33:0/3786433686 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f399813ed30 msgr2=0x7f399813cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:10.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:10.787+0000 7f399d91a640 1 --2- 172.21.15.33:0/3786433686 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f399813ed30 0x7f399813cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:10.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:10.787+0000 7f399d91a640 1 -- 172.21.15.33:0/3786433686 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f39981551f0 msgr2=0x7f399813c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:10.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:10.787+0000 7f399d91a640 1 --2- 172.21.15.33:0/3786433686 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f39981551f0 0x7f399813c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:10.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:10.787+0000 7f399d91a640 1 -- 172.21.15.33:0/3786433686 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39980712b0 con 0x7f399813e950 2024-05-08T10:55:10.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:10.787+0000 7f399d91a640 1 --2- 172.21.15.33:0/3786433686 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f399813e950 0x7f39980709f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f39900117c0 tx=0x7f3990011bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:10.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:10.788+0000 7f39967fc640 1 -- 172.21.15.33:0/3786433686 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f399000b040 con 0x7f399813e950 2024-05-08T10:55:10.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:10.788+0000 7f39967fc640 1 -- 172.21.15.33:0/3786433686 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f399000fac0 con 0x7f399813e950 2024-05-08T10:55:10.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:10.788+0000 7f39967fc640 1 -- 172.21.15.33:0/3786433686 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f399000fe90 con 0x7f399813e950 2024-05-08T10:55:10.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:10.788+0000 7f399fb7e640 1 -- 172.21.15.33:0/3786433686 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3998071590 con 0x7f399813e950 2024-05-08T10:55:10.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:10.788+0000 7f399fb7e640 1 -- 172.21.15.33:0/3786433686 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3998071b50 con 0x7f399813e950 2024-05-08T10:55:10.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:10.789+0000 7f399fb7e640 1 -- 172.21.15.33:0/3786433686 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3998069d20 con 0x7f399813e950 2024-05-08T10:55:10.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:10.789+0000 7f39967fc640 1 -- 172.21.15.33:0/3786433686 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3990013440 con 0x7f399813e950 2024-05-08T10:55:10.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:10.789+0000 7f39967fc640 1 --2- 172.21.15.33:0/3786433686 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f398406b6a0 0x7f398406db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:10.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:10.790+0000 7f39967fc640 1 -- 172.21.15.33:0/3786433686 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f399008ad90 con 0x7f399813e950 2024-05-08T10:55:10.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:10.790+0000 7f399d119640 1 --2- 172.21.15.33:0/3786433686 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f398406b6a0 0x7f398406db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:10.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:10.790+0000 7f399d119640 1 --2- 172.21.15.33:0/3786433686 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f398406b6a0 0x7f398406db60 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f39980cfba0 tx=0x7f398c009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:10.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:10.794+0000 7f39967fc640 1 -- 172.21.15.33:0/3786433686 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3990059c10 con 0x7f399813e950 2024-05-08T10:55:11.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:11.013+0000 7f399fb7e640 1 -- 172.21.15.33:0/3786433686 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f399806b3a0 con 0x7f399813e950 2024-05-08T10:55:11.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:11.013+0000 7f39967fc640 1 -- 172.21.15.33:0/3786433686 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7f3990059510 con 0x7f399813e950 2024-05-08T10:55:11.010 INFO:teuthology.orchestra.run.smithi033.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-08T10:55:11.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:11.015+0000 7f399fb7e640 1 -- 172.21.15.33:0/3786433686 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f398406b6a0 msgr2=0x7f398406db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:11.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:11.015+0000 7f399fb7e640 1 --2- 172.21.15.33:0/3786433686 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f398406b6a0 0x7f398406db60 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f39980cfba0 tx=0x7f398c009190 comp rx=0 tx=0).stop 2024-05-08T10:55:11.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:11.015+0000 7f399fb7e640 1 -- 172.21.15.33:0/3786433686 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f399813e950 msgr2=0x7f39980709f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:11.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:11.015+0000 7f399fb7e640 1 --2- 172.21.15.33:0/3786433686 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f399813e950 0x7f39980709f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f39900117c0 tx=0x7f3990011bc0 comp rx=0 tx=0).stop 2024-05-08T10:55:11.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:11.015+0000 7f399fb7e640 1 -- 172.21.15.33:0/3786433686 shutdown_connections 2024-05-08T10:55:11.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:11.015+0000 7f399fb7e640 1 --2- 172.21.15.33:0/3786433686 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f398406b6a0 0x7f398406db60 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:11.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:11.015+0000 7f399fb7e640 1 --2- 172.21.15.33:0/3786433686 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f399813ed30 0x7f399813cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:11.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:11.015+0000 7f399fb7e640 1 --2- 172.21.15.33:0/3786433686 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f39981551f0 0x7f399813c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:11.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:11.015+0000 7f399fb7e640 1 --2- 172.21.15.33:0/3786433686 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f399813e950 0x7f39980709f0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:11.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:11.015+0000 7f399fb7e640 1 -- 172.21.15.33:0/3786433686 >> 172.21.15.33:0/3786433686 conn(0x7f399806aba0 msgr2=0x7f399815b830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:11.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:11.015+0000 7f399fb7e640 1 -- 172.21.15.33:0/3786433686 shutdown_connections 2024-05-08T10:55:11.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:11.015+0000 7f399fb7e640 1 -- 172.21.15.33:0/3786433686 wait complete. 2024-05-08T10:55:11.022 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-08T10:55:11.023 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-08T10:55:11.023 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi174.front.sepia.ceph.com 2024-05-08T10:55:11.023 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-05-08T10:55:11.023 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-05-08T10:55:11.023 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-08T10:55:11.023 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-08T10:55:11.023 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-08T10:55:11.023 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-05-08T10:55:11.023 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:55:11.023 DEBUG:teuthology.orchestra.run.smithi174:> ip addr 2024-05-08T10:55:11.043 INFO:teuthology.orchestra.run.smithi174.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-08T10:55:11.043 INFO:teuthology.orchestra.run.smithi174.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-08T10:55:11.043 INFO:teuthology.orchestra.run.smithi174.stdout: inet 127.0.0.1/8 scope host lo 2024-05-08T10:55:11.043 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2024-05-08T10:55:11.043 INFO:teuthology.orchestra.run.smithi174.stdout: inet6 ::1/128 scope host 2024-05-08T10:55:11.043 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2024-05-08T10:55:11.043 INFO:teuthology.orchestra.run.smithi174.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-08T10:55:11.043 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether 0c:c4:7a:d9:36:e0 brd ff:ff:ff:ff:ff:ff 2024-05-08T10:55:11.043 INFO:teuthology.orchestra.run.smithi174.stdout: altname enp7s0f0 2024-05-08T10:55:11.043 INFO:teuthology.orchestra.run.smithi174.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-08T10:55:11.044 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether 0c:c4:7a:d9:36:e1 brd ff:ff:ff:ff:ff:ff 2024-05-08T10:55:11.044 INFO:teuthology.orchestra.run.smithi174.stdout: altname enp7s0f1 2024-05-08T10:55:11.044 INFO:teuthology.orchestra.run.smithi174.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-08T10:55:11.044 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether 0c:c4:7a:88:77:1a brd ff:ff:ff:ff:ff:ff 2024-05-08T10:55:11.044 INFO:teuthology.orchestra.run.smithi174.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-08T10:55:11.044 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether 0c:c4:7a:88:77:1b brd ff:ff:ff:ff:ff:ff 2024-05-08T10:55:11.044 INFO:teuthology.orchestra.run.smithi174.stdout: inet 172.21.15.174/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-05-08T10:55:11.044 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft 42741sec preferred_lft 42741sec 2024-05-08T10:55:11.044 INFO:teuthology.orchestra.run.smithi174.stdout: inet6 fe80::ec4:7aff:fe88:771b/64 scope link 2024-05-08T10:55:11.044 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2024-05-08T10:55:11.044 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-08T10:55:11.044 DEBUG:teuthology.orchestra.run.smithi174:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-08T10:55:11.045 DEBUG:teuthology.orchestra.run.smithi174:> set -e 2024-05-08T10:55:11.045 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip link add name ceph-brx type bridge 2024-05-08T10:55:11.045 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip addr flush dev ceph-brx 2024-05-08T10:55:11.045 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip link set ceph-brx up 2024-05-08T10:55:11.045 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-08T10:55:11.045 DEBUG:teuthology.orchestra.run.smithi174:> ') 2024-05-08T10:55:11.139 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:55:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-08T10:55:11.270 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:55:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T10:55:11.277 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:55:11.277 DEBUG:teuthology.orchestra.run.smithi174:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-08T10:55:11.303 INFO:teuthology.orchestra.run.smithi174.stdout:1 2024-05-08T10:55:11.305 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:55:11.305 DEBUG:teuthology.orchestra.run.smithi174:> route 2024-05-08T10:55:11.367 INFO:teuthology.orchestra.run.smithi174.stdout:Kernel IP routing table 2024-05-08T10:55:11.367 INFO:teuthology.orchestra.run.smithi174.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-08T10:55:11.367 INFO:teuthology.orchestra.run.smithi174.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-08T10:55:11.367 INFO:teuthology.orchestra.run.smithi174.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-08T10:55:11.368 INFO:teuthology.orchestra.run.smithi174.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-08T10:55:11.368 DEBUG:teuthology.orchestra.run.smithi174:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-08T10:55:11.368 DEBUG:teuthology.orchestra.run.smithi174:> set -e 2024-05-08T10:55:11.368 DEBUG:teuthology.orchestra.run.smithi174:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-08T10:55:11.368 DEBUG:teuthology.orchestra.run.smithi174:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-08T10:55:11.368 DEBUG:teuthology.orchestra.run.smithi174:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-08T10:55:11.368 DEBUG:teuthology.orchestra.run.smithi174:> ') 2024-05-08T10:55:11.455 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:55:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-08T10:55:11.652 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:55:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T10:55:11.658 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:55:11.659 DEBUG:teuthology.orchestra.run.smithi174:> ip netns list 2024-05-08T10:55:11.674 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:55:11.674 DEBUG:teuthology.orchestra.run.smithi174:> ip netns list-id 2024-05-08T10:55:11.729 DEBUG:teuthology.orchestra.run.smithi174:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-08T10:55:11.729 DEBUG:teuthology.orchestra.run.smithi174:> set -e 2024-05-08T10:55:11.730 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-08T10:55:11.730 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-05-08T10:55:11.730 DEBUG:teuthology.orchestra.run.smithi174:> ') 2024-05-08T10:55:11.818 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:55:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-08T10:55:11.842 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:55:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T10:55:11.848 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-05-08T10:55:11.848 DEBUG:teuthology.orchestra.run.smithi174:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-08T10:55:11.848 DEBUG:teuthology.orchestra.run.smithi174:> set -e 2024-05-08T10:55:11.848 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-05-08T10:55:11.848 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-08T10:55:11.848 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-05-08T10:55:11.848 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-05-08T10:55:11.848 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-05-08T10:55:11.848 DEBUG:teuthology.orchestra.run.smithi174:> ') 2024-05-08T10:55:11.897 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:55:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-08T10:55:11.968 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:55:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T10:55:11.974 DEBUG:teuthology.orchestra.run.smithi174:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-08T10:55:11.974 DEBUG:teuthology.orchestra.run.smithi174:> set -e 2024-05-08T10:55:11.974 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip link set brx.0 up 2024-05-08T10:55:11.974 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip link set dev brx.0 master ceph-brx 2024-05-08T10:55:11.974 DEBUG:teuthology.orchestra.run.smithi174:> ') 2024-05-08T10:55:12.023 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:55:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-08T10:55:12.045 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:55:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T10:55:12.051 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-08T10:55:12.051 DEBUG:teuthology.orchestra.run.smithi174:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-05-08T10:55:12.066 INFO:teuthology.orchestra.run.smithi174.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-05-08T10:55:12.066 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-08T10:55:12.066 DEBUG:teuthology.orchestra.run.smithi174:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-05-08T10:55:12.121 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-05-08T10:55:12.122 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:55:12.122 DEBUG:teuthology.orchestra.run.smithi174:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-08T10:55:12.211 INFO:teuthology.orchestra.run.smithi174.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-08T10:55:12.211 INFO:teuthology.orchestra.run.smithi174.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-08T10:55:12.323 INFO:teuthology.orchestra.run.smithi174.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-08T10:55:12.323 INFO:teuthology.orchestra.run.smithi174.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-08T10:55:12.323 INFO:teuthology.orchestra.run.smithi174.stdout:mount.ceph: resolved to: "172.21.15.33:3300,172.21.15.174:3300,172.21.15.174:3301" 2024-05-08T10:55:12.323 INFO:teuthology.orchestra.run.smithi174.stdout:mount.ceph: trying mount with new device syntax: 1@963217b2-c375-4f5a-95cf-88e199dd38ff.cephfs=/ 2024-05-08T10:55:12.323 INFO:teuthology.orchestra.run.smithi174.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.33:3300/172.21.15.174:3300/172.21.15.174:3301" will pass to kernel 2024-05-08T10:55:12.323 INFO:teuthology.orchestra.run.smithi174.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-05-08T10:55:12.324 INFO:teuthology.orchestra.run.smithi174.stdout: You just mounted a file system that supports labels which does not 2024-05-08T10:55:12.324 INFO:teuthology.orchestra.run.smithi174.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-08T10:55:12.324 INFO:teuthology.orchestra.run.smithi174.stdout: applications will generate AVC messages and not be allowed access to 2024-05-08T10:55:12.324 INFO:teuthology.orchestra.run.smithi174.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-08T10:55:12.325 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-08T10:55:12.325 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:55:12.326 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-05-08T10:55:12.350 DEBUG:teuthology.orchestra.run.smithi174:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-08T10:55:12.440 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:55:12 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-08T10:55:12.442 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:55:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T10:55:12.448 INFO:teuthology.orchestra.run.smithi174.stdout:client4570 2024-05-08T10:55:12.448 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-05-08T10:55:12.448 DEBUG:teuthology.orchestra.run.smithi174:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T10:55:12.465 DEBUG:teuthology.orchestra.run.smithi174:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-08T10:55:12.553 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:55:12 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-08T10:55:12.554 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:55:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T10:55:12.560 INFO:teuthology.orchestra.run.smithi174.stdout:client4570 2024-05-08T10:55:12.560 DEBUG:teuthology.orchestra.run.smithi174:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-08T10:55:12.609 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:55:12 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-08T10:55:12.611 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:55:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T10:55:12.617 INFO:teuthology.orchestra.run.smithi174.stdout:client4570 2024-05-08T10:55:12.617 DEBUG:teuthology.orchestra.run.smithi174:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/963217b2-c375-4f5a-95cf-88e199dd38ff.client4570/status') 2024-05-08T10:55:12.665 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:55:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-08T10:55:12.675 INFO:teuthology.orchestra.run.smithi174.stdout:instance: client.4570 (3)192.168.0.1:0/648111104 2024-05-08T10:55:12.675 INFO:teuthology.orchestra.run.smithi174.stdout:blocklisted: false 2024-05-08T10:55:12.676 INFO:teuthology.orchestra.run.smithi174.stderr:0+1 records in 2024-05-08T10:55:12.676 INFO:teuthology.orchestra.run.smithi174.stderr:0+1 records out 2024-05-08T10:55:12.676 INFO:teuthology.orchestra.run.smithi174.stderr:68 bytes copied, 2.6121e-05 s, 2.6 MB/s 2024-05-08T10:55:12.676 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:55:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T10:55:12.683 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2024-05-08T10:55:12.683 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-08T10:55:12.683 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-05-08T10:55:12.683 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-08T10:55:12.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:12.803+0000 7f9c10a12640 1 Processor -- start 2024-05-08T10:55:12.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:12.803+0000 7f9c10a12640 1 -- start start 2024-05-08T10:55:12.800 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:12.804+0000 7f9c10a12640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f9c0c0d0920 0x7f9c0c15e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:12.800 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:12.804+0000 7f9c10a12640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c0c0d4910 con 0x7f9c0c0d0540 2024-05-08T10:55:12.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:12.804+0000 7f9c10a12640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c0c0d25e0 con 0x7f9c0c0b4c60 2024-05-08T10:55:12.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:12.804+0000 7f9c10a12640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c0c0d46c0 con 0x7f9c0c0d0920 2024-05-08T10:55:12.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:12.804+0000 7f9c03fff640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f9c0c0d0920 0x7f9c0c15e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:12.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:12.804+0000 7f9c0a59c640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f9c0c0d0540 0x7f9c0c15dbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:48164/0 (socket says 172.21.15.33:48164) 2024-05-08T10:55:12.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:12.804+0000 7f9c0a59c640 1 -- 172.21.15.33:0/3457660683 learned_addr learned my addr 172.21.15.33:0/3457660683 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-05-08T10:55:12.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:12.804+0000 7f9c09d9b640 1 -- 172.21.15.33:0/3457660683 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2264701043 0 0) 0x7f9c0c0d25e0 con 0x7f9c0c0b4c60 2024-05-08T10:55:12.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:12.804+0000 7f9c03fff640 1 -- 172.21.15.33:0/3457660683 >> v1:172.21.15.174:6789/0 conn(0x7f9c0c0b4c60 legacy=0x7f9c0c0ce7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:12.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:12.804+0000 7f9c03fff640 1 -- 172.21.15.33:0/3457660683 >> v1:172.21.15.33:6789/0 conn(0x7f9c0c0d0540 legacy=0x7f9c0c15dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:12.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:12.804+0000 7f9c03fff640 1 -- 172.21.15.33:0/3457660683 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c0c0b4730 con 0x7f9c0c0d0920 2024-05-08T10:55:12.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:12.805+0000 7f9c03fff640 1 --2- 172.21.15.33:0/3457660683 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c0c0d0920 0x7f9c0c15e2e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f9bf40097a0 tx=0x7f9bf402a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f141a29c5347644 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:12.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:12.805+0000 7f9c09d9b640 1 -- 172.21.15.33:0/3457660683 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf4037070 con 0x7f9c0c0d0920 2024-05-08T10:55:12.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:12.805+0000 7f9c09d9b640 1 -- 172.21.15.33:0/3457660683 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bf402ac90 con 0x7f9c0c0d0920 2024-05-08T10:55:12.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:12.805+0000 7f9c09d9b640 1 -- 172.21.15.33:0/3457660683 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf4032660 con 0x7f9c0c0d0920 2024-05-08T10:55:12.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:12.806+0000 7f9c10a12640 1 -- 172.21.15.33:0/3457660683 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c0c0d0920 msgr2=0x7f9c0c15e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:12.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:12.806+0000 7f9c10a12640 1 --2- 172.21.15.33:0/3457660683 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c0c0d0920 0x7f9c0c15e2e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f9bf40097a0 tx=0x7f9bf402a000 comp rx=0 tx=0).stop 2024-05-08T10:55:12.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:12.806+0000 7f9c10a12640 1 -- 172.21.15.33:0/3457660683 shutdown_connections 2024-05-08T10:55:12.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:12.806+0000 7f9c10a12640 1 --2- 172.21.15.33:0/3457660683 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c0c0d0920 0x7f9c0c15e2e0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:12.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:12.806+0000 7f9c10a12640 1 -- 172.21.15.33:0/3457660683 >> 172.21.15.33:0/3457660683 conn(0x7f9c0c0d3ba0 msgr2=0x7f9c0c0d3fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:12.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:12.806+0000 7f9c10a12640 1 -- 172.21.15.33:0/3457660683 shutdown_connections 2024-05-08T10:55:12.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:12.806+0000 7f9c10a12640 1 -- 172.21.15.33:0/3457660683 wait complete. 2024-05-08T10:55:12.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:12.807+0000 7f9c10a12640 1 Processor -- start 2024-05-08T10:55:12.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:12.807+0000 7f9c10a12640 1 -- start start 2024-05-08T10:55:12.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:12.808+0000 7f9c10a12640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9c0c0b4c60 0x7f9c0c150ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:12.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:12.808+0000 7f9c10a12640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c0c0d0540 0x7f9c0c0cd8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:12.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:12.808+0000 7f9c10a12640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9c0c0d0920 0x7f9c0c0cb060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:12.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:12.808+0000 7f9c10a12640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c0c0d2950 con 0x7f9c0c0d0540 2024-05-08T10:55:12.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:12.808+0000 7f9c10a12640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c0c0d2390 con 0x7f9c0c0d0920 2024-05-08T10:55:12.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:12.808+0000 7f9c10a12640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c0c0ceec0 con 0x7f9c0c0b4c60 2024-05-08T10:55:12.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:12.808+0000 7f9c03fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c0c0d0540 0x7f9c0c0cd8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:12.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:12.808+0000 7f9c03fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c0c0d0540 0x7f9c0c0cd8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47838/0 (socket says 172.21.15.33:47838) 2024-05-08T10:55:12.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:12.808+0000 7f9c03fff640 1 -- 172.21.15.33:0/2951654154 learned_addr learned my addr 172.21.15.33:0/2951654154 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:12.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:12.808+0000 7f9c0a59c640 1 --2- 172.21.15.33:0/2951654154 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9c0c0b4c60 0x7f9c0c150ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:12.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:12.808+0000 7f9c0ad9d640 1 --2- 172.21.15.33:0/2951654154 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9c0c0d0920 0x7f9c0c0cb060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:12.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:12.809+0000 7f9c03fff640 1 -- 172.21.15.33:0/2951654154 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9c0c0b4c60 msgr2=0x7f9c0c150ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:12.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:12.809+0000 7f9c03fff640 1 --2- 172.21.15.33:0/2951654154 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9c0c0b4c60 0x7f9c0c150ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:12.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:12.809+0000 7f9c03fff640 1 -- 172.21.15.33:0/2951654154 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9c0c0d0920 msgr2=0x7f9c0c0cb060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:12.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:12.809+0000 7f9c03fff640 1 --2- 172.21.15.33:0/2951654154 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9c0c0d0920 0x7f9c0c0cb060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:12.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:12.809+0000 7f9c03fff640 1 -- 172.21.15.33:0/2951654154 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c0c151420 con 0x7f9c0c0d0540 2024-05-08T10:55:12.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:12.809+0000 7f9c03fff640 1 --2- 172.21.15.33:0/2951654154 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c0c0d0540 0x7f9c0c0cd8a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9bf4000c00 tx=0x7f9bf40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:12.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:12.809+0000 7f9c02ffd640 1 -- 172.21.15.33:0/2951654154 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf4037040 con 0x7f9c0c0d0540 2024-05-08T10:55:12.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:12.809+0000 7f9c02ffd640 1 -- 172.21.15.33:0/2951654154 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bf4004030 con 0x7f9c0c0d0540 2024-05-08T10:55:12.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:12.809+0000 7f9c10a12640 1 -- 172.21.15.33:0/2951654154 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c0c0b8b90 con 0x7f9c0c0d0540 2024-05-08T10:55:12.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:12.809+0000 7f9c02ffd640 1 -- 172.21.15.33:0/2951654154 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf4004420 con 0x7f9c0c0d0540 2024-05-08T10:55:12.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:12.809+0000 7f9c10a12640 1 -- 172.21.15.33:0/2951654154 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c0c0b9150 con 0x7f9c0c0d0540 2024-05-08T10:55:12.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:12.810+0000 7f9c10a12640 1 -- 172.21.15.33:0/2951654154 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c0c069d20 con 0x7f9c0c0d0540 2024-05-08T10:55:12.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:12.811+0000 7f9c02ffd640 1 -- 172.21.15.33:0/2951654154 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9bf403a070 con 0x7f9c0c0d0540 2024-05-08T10:55:12.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:12.811+0000 7f9c02ffd640 1 --2- 172.21.15.33:0/2951654154 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f9bec06b4d0 0x7f9bec06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:12.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:12.811+0000 7f9c02ffd640 1 -- 172.21.15.33:0/2951654154 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9bf40aa750 con 0x7f9c0c0d0540 2024-05-08T10:55:12.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:12.811+0000 7f9c0a59c640 1 --2- 172.21.15.33:0/2951654154 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f9bec06b4d0 0x7f9bec06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:12.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:12.812+0000 7f9c0a59c640 1 --2- 172.21.15.33:0/2951654154 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f9bec06b4d0 0x7f9bec06d990 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9bfc000f60 tx=0x7f9bfc000bc0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:12.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:12.815+0000 7f9c02ffd640 1 -- 172.21.15.33:0/2951654154 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9bf4041020 con 0x7f9c0c0d0540 2024-05-08T10:55:13.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:13.039+0000 7f9c10a12640 1 -- 172.21.15.33:0/2951654154 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f9c0c072f70 con 0x7f9c0c0d0540 2024-05-08T10:55:13.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:13.039+0000 7f9c02ffd640 1 -- 172.21.15.33:0/2951654154 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7f9bf4078f80 con 0x7f9c0c0d0540 2024-05-08T10:55:13.036 INFO:teuthology.orchestra.run.smithi033.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-08T10:55:13.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:13.042+0000 7f9c10a12640 1 -- 172.21.15.33:0/2951654154 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f9bec06b4d0 msgr2=0x7f9bec06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:13.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:13.042+0000 7f9c10a12640 1 --2- 172.21.15.33:0/2951654154 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f9bec06b4d0 0x7f9bec06d990 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9bfc000f60 tx=0x7f9bfc000bc0 comp rx=0 tx=0).stop 2024-05-08T10:55:13.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:13.042+0000 7f9c10a12640 1 -- 172.21.15.33:0/2951654154 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c0c0d0540 msgr2=0x7f9c0c0cd8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:13.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:13.042+0000 7f9c10a12640 1 --2- 172.21.15.33:0/2951654154 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c0c0d0540 0x7f9c0c0cd8a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9bf4000c00 tx=0x7f9bf40046c0 comp rx=0 tx=0).stop 2024-05-08T10:55:13.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:13.042+0000 7f9c10a12640 1 -- 172.21.15.33:0/2951654154 shutdown_connections 2024-05-08T10:55:13.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:13.042+0000 7f9c10a12640 1 --2- 172.21.15.33:0/2951654154 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f9bec06b4d0 0x7f9bec06d990 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:13.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:13.042+0000 7f9c10a12640 1 --2- 172.21.15.33:0/2951654154 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9c0c0d0920 0x7f9c0c0cb060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:13.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:13.042+0000 7f9c10a12640 1 --2- 172.21.15.33:0/2951654154 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c0c0d0540 0x7f9c0c0cd8a0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:13.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:13.042+0000 7f9c10a12640 1 --2- 172.21.15.33:0/2951654154 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9c0c0b4c60 0x7f9c0c150ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:13.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:13.042+0000 7f9c10a12640 1 -- 172.21.15.33:0/2951654154 >> 172.21.15.33:0/2951654154 conn(0x7f9c0c0d3ba0 msgr2=0x7f9c0c0ce770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:13.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:13.042+0000 7f9c10a12640 1 -- 172.21.15.33:0/2951654154 shutdown_connections 2024-05-08T10:55:13.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:13.042+0000 7f9c10a12640 1 -- 172.21.15.33:0/2951654154 wait complete. 2024-05-08T10:55:13.049 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-08T10:55:13.049 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-08T10:55:13.049 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi174.front.sepia.ceph.com 2024-05-08T10:55:13.049 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-05-08T10:55:13.049 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-05-08T10:55:13.049 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-08T10:55:13.049 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-08T10:55:13.049 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-08T10:55:13.049 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-05-08T10:55:13.049 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:55:13.050 DEBUG:teuthology.orchestra.run.smithi174:> ip addr 2024-05-08T10:55:13.066 INFO:teuthology.orchestra.run.smithi174.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-08T10:55:13.066 INFO:teuthology.orchestra.run.smithi174.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-08T10:55:13.067 INFO:teuthology.orchestra.run.smithi174.stdout: inet 127.0.0.1/8 scope host lo 2024-05-08T10:55:13.067 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2024-05-08T10:55:13.067 INFO:teuthology.orchestra.run.smithi174.stdout: inet6 ::1/128 scope host 2024-05-08T10:55:13.067 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2024-05-08T10:55:13.067 INFO:teuthology.orchestra.run.smithi174.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-08T10:55:13.067 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether 0c:c4:7a:d9:36:e0 brd ff:ff:ff:ff:ff:ff 2024-05-08T10:55:13.067 INFO:teuthology.orchestra.run.smithi174.stdout: altname enp7s0f0 2024-05-08T10:55:13.067 INFO:teuthology.orchestra.run.smithi174.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-08T10:55:13.067 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether 0c:c4:7a:d9:36:e1 brd ff:ff:ff:ff:ff:ff 2024-05-08T10:55:13.067 INFO:teuthology.orchestra.run.smithi174.stdout: altname enp7s0f1 2024-05-08T10:55:13.067 INFO:teuthology.orchestra.run.smithi174.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-08T10:55:13.067 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether 0c:c4:7a:88:77:1a brd ff:ff:ff:ff:ff:ff 2024-05-08T10:55:13.067 INFO:teuthology.orchestra.run.smithi174.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-08T10:55:13.067 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether 0c:c4:7a:88:77:1b brd ff:ff:ff:ff:ff:ff 2024-05-08T10:55:13.067 INFO:teuthology.orchestra.run.smithi174.stdout: inet 172.21.15.174/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-05-08T10:55:13.068 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft 42739sec preferred_lft 42739sec 2024-05-08T10:55:13.068 INFO:teuthology.orchestra.run.smithi174.stdout: inet6 fe80::ec4:7aff:fe88:771b/64 scope link 2024-05-08T10:55:13.068 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2024-05-08T10:55:13.068 INFO:teuthology.orchestra.run.smithi174.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-08T10:55:13.068 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether fa:81:2a:2f:f0:1e brd ff:ff:ff:ff:ff:ff 2024-05-08T10:55:13.068 INFO:teuthology.orchestra.run.smithi174.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-08T10:55:13.068 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2024-05-08T10:55:13.068 INFO:teuthology.orchestra.run.smithi174.stdout: inet6 fe80::e48a:d8ff:fecf:e90e/64 scope link 2024-05-08T10:55:13.068 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2024-05-08T10:55:13.068 INFO:teuthology.orchestra.run.smithi174.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-08T10:55:13.068 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether fa:81:2a:2f:f0:1e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-08T10:55:13.068 INFO:teuthology.orchestra.run.smithi174.stdout: inet6 fe80::f881:2aff:fe2f:f01e/64 scope link tentative 2024-05-08T10:55:13.068 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2024-05-08T10:55:13.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:55:13.069 DEBUG:teuthology.orchestra.run.smithi174:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-08T10:55:13.130 INFO:teuthology.orchestra.run.smithi174.stdout:1 2024-05-08T10:55:13.132 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:55:13.132 DEBUG:teuthology.orchestra.run.smithi174:> route 2024-05-08T10:55:13.188 INFO:teuthology.orchestra.run.smithi174.stdout:Kernel IP routing table 2024-05-08T10:55:13.188 INFO:teuthology.orchestra.run.smithi174.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-08T10:55:13.188 INFO:teuthology.orchestra.run.smithi174.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-08T10:55:13.188 INFO:teuthology.orchestra.run.smithi174.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-08T10:55:13.188 INFO:teuthology.orchestra.run.smithi174.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-08T10:55:13.189 DEBUG:teuthology.orchestra.run.smithi174:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-08T10:55:13.189 DEBUG:teuthology.orchestra.run.smithi174:> set -e 2024-05-08T10:55:13.189 DEBUG:teuthology.orchestra.run.smithi174:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-08T10:55:13.189 DEBUG:teuthology.orchestra.run.smithi174:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-08T10:55:13.189 DEBUG:teuthology.orchestra.run.smithi174:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-08T10:55:13.189 DEBUG:teuthology.orchestra.run.smithi174:> ') 2024-05-08T10:55:13.276 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:55:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-08T10:55:13.308 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:55:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T10:55:13.314 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:55:13.314 DEBUG:teuthology.orchestra.run.smithi174:> ip netns list 2024-05-08T10:55:13.329 INFO:teuthology.orchestra.run.smithi174.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-05-08T10:55:13.330 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:55:13.330 DEBUG:teuthology.orchestra.run.smithi174:> ip netns list-id 2024-05-08T10:55:13.385 INFO:teuthology.orchestra.run.smithi174.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-05-08T10:55:13.385 DEBUG:teuthology.orchestra.run.smithi174:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-08T10:55:13.385 DEBUG:teuthology.orchestra.run.smithi174:> set -e 2024-05-08T10:55:13.385 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-08T10:55:13.385 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-05-08T10:55:13.385 DEBUG:teuthology.orchestra.run.smithi174:> ') 2024-05-08T10:55:13.474 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:55:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-08T10:55:13.496 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:55:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T10:55:13.502 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:55:13.502 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-05-08T10:55:13.526 INFO:teuthology.orchestra.run.smithi174.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-08T10:55:13.526 INFO:teuthology.orchestra.run.smithi174.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-08T10:55:13.527 INFO:teuthology.orchestra.run.smithi174.stdout: inet 127.0.0.1/8 scope host lo 2024-05-08T10:55:13.527 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2024-05-08T10:55:13.527 INFO:teuthology.orchestra.run.smithi174.stdout: inet6 ::1/128 scope host 2024-05-08T10:55:13.527 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2024-05-08T10:55:13.527 INFO:teuthology.orchestra.run.smithi174.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-08T10:55:13.527 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether fe:4c:91:93:e7:9f brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-05-08T10:55:13.527 INFO:teuthology.orchestra.run.smithi174.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-05-08T10:55:13.527 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2024-05-08T10:55:13.527 INFO:teuthology.orchestra.run.smithi174.stdout: inet6 fe80::fc4c:91ff:fe93:e79f/64 scope link tentative 2024-05-08T10:55:13.527 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2024-05-08T10:55:13.528 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:55:13.528 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-05-08T10:55:13.592 INFO:teuthology.orchestra.run.smithi174.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-08T10:55:13.592 INFO:teuthology.orchestra.run.smithi174.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-08T10:55:13.592 INFO:teuthology.orchestra.run.smithi174.stdout: inet 127.0.0.1/8 scope host lo 2024-05-08T10:55:13.592 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2024-05-08T10:55:13.593 INFO:teuthology.orchestra.run.smithi174.stdout: inet6 ::1/128 scope host 2024-05-08T10:55:13.593 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2024-05-08T10:55:13.593 INFO:teuthology.orchestra.run.smithi174.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-08T10:55:13.593 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether fe:4c:91:93:e7:9f brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-05-08T10:55:13.593 INFO:teuthology.orchestra.run.smithi174.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-05-08T10:55:13.593 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2024-05-08T10:55:13.593 INFO:teuthology.orchestra.run.smithi174.stdout: inet6 fe80::fc4c:91ff:fe93:e79f/64 scope link tentative 2024-05-08T10:55:13.593 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2024-05-08T10:55:13.594 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-05-08T10:55:13.594 DEBUG:teuthology.orchestra.run.smithi174:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-08T10:55:13.594 DEBUG:teuthology.orchestra.run.smithi174:> set -e 2024-05-08T10:55:13.594 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-05-08T10:55:13.594 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-05-08T10:55:13.594 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-05-08T10:55:13.594 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-05-08T10:55:13.595 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-05-08T10:55:13.595 DEBUG:teuthology.orchestra.run.smithi174:> ') 2024-05-08T10:55:13.683 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:55:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-08T10:55:13.740 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:55:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T10:55:13.747 DEBUG:teuthology.orchestra.run.smithi174:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-08T10:55:13.747 DEBUG:teuthology.orchestra.run.smithi174:> set -e 2024-05-08T10:55:13.747 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip link set brx.1 up 2024-05-08T10:55:13.747 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip link set dev brx.1 master ceph-brx 2024-05-08T10:55:13.747 DEBUG:teuthology.orchestra.run.smithi174:> ') 2024-05-08T10:55:13.796 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:55:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-08T10:55:13.818 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:55:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T10:55:13.824 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-08T10:55:13.824 DEBUG:teuthology.orchestra.run.smithi174:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-05-08T10:55:13.839 INFO:teuthology.orchestra.run.smithi174.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-05-08T10:55:13.839 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-08T10:55:13.839 DEBUG:teuthology.orchestra.run.smithi174:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-05-08T10:55:13.894 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2024-05-08T10:55:13.894 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:55:13.894 DEBUG:teuthology.orchestra.run.smithi174:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-08T10:55:13.977 INFO:teuthology.orchestra.run.smithi174.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-08T10:55:13.977 INFO:teuthology.orchestra.run.smithi174.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-08T10:55:13.985 INFO:teuthology.orchestra.run.smithi174.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-08T10:55:13.985 INFO:teuthology.orchestra.run.smithi174.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-08T10:55:13.985 INFO:teuthology.orchestra.run.smithi174.stdout:mount.ceph: resolved to: "172.21.15.33:3300,172.21.15.174:3300,172.21.15.174:3301" 2024-05-08T10:55:13.985 INFO:teuthology.orchestra.run.smithi174.stdout:mount.ceph: trying mount with new device syntax: 3@963217b2-c375-4f5a-95cf-88e199dd38ff.cephfs=/ 2024-05-08T10:55:13.985 INFO:teuthology.orchestra.run.smithi174.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.33:3300/172.21.15.174:3300/172.21.15.174:3301" will pass to kernel 2024-05-08T10:55:13.985 INFO:teuthology.orchestra.run.smithi174.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2024-05-08T10:55:13.986 INFO:teuthology.orchestra.run.smithi174.stdout: You just mounted a file system that supports labels which does not 2024-05-08T10:55:13.986 INFO:teuthology.orchestra.run.smithi174.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-08T10:55:13.986 INFO:teuthology.orchestra.run.smithi174.stdout: applications will generate AVC messages and not be allowed access to 2024-05-08T10:55:13.986 INFO:teuthology.orchestra.run.smithi174.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-08T10:55:13.988 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-08T10:55:13.988 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:55:13.988 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-05-08T10:55:14.055 DEBUG:teuthology.orchestra.run.smithi174:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-08T10:55:14.143 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:55:14 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-08T10:55:14.145 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:55:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T10:55:14.151 INFO:teuthology.orchestra.run.smithi174.stdout:client4499 2024-05-08T10:55:14.151 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-05-08T10:55:14.151 DEBUG:teuthology.orchestra.run.smithi174:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T10:55:14.167 DEBUG:teuthology.orchestra.run.smithi174:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-08T10:55:14.256 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:55:14 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-08T10:55:14.258 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:55:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T10:55:14.263 INFO:teuthology.orchestra.run.smithi174.stdout:client4499 2024-05-08T10:55:14.264 DEBUG:teuthology.orchestra.run.smithi174:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-08T10:55:14.312 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:55:14 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-08T10:55:14.313 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:55:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T10:55:14.319 INFO:teuthology.orchestra.run.smithi174.stdout:client4499 2024-05-08T10:55:14.319 DEBUG:teuthology.orchestra.run.smithi174:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/963217b2-c375-4f5a-95cf-88e199dd38ff.client4499/status') 2024-05-08T10:55:14.367 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:55:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-08T10:55:14.377 INFO:teuthology.orchestra.run.smithi174.stdout:instance: client.4499 (3)192.168.0.2:0/817875322 2024-05-08T10:55:14.377 INFO:teuthology.orchestra.run.smithi174.stdout:blocklisted: false 2024-05-08T10:55:14.378 INFO:teuthology.orchestra.run.smithi174.stderr:0+1 records in 2024-05-08T10:55:14.378 INFO:teuthology.orchestra.run.smithi174.stderr:0+1 records out 2024-05-08T10:55:14.378 INFO:teuthology.orchestra.run.smithi174.stderr:68 bytes copied, 3.829e-05 s, 1.8 MB/s 2024-05-08T10:55:14.378 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-08T10:55:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T10:55:14.385 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-05-08T10:55:14.404 INFO:tasks.cephfs_test_runner:Starting test: test_flush (tasks.cephfs.test_flush.TestFlush) 2024-05-08T10:55:14.405 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T10:55:14.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.525+0000 7f0478433640 1 Processor -- start 2024-05-08T10:55:14.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.525+0000 7f0478433640 1 -- start start 2024-05-08T10:55:14.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.526+0000 7f0478433640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f047015dfb0 0x7f04700d13a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:14.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.526+0000 7f0478433640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f0470071f80 0x7f047006aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:14.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.526+0000 7f0478433640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f047006b4f0 con 0x7f047006b0e0 2024-05-08T10:55:14.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.526+0000 7f0478433640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0470071730 con 0x7f047015dfb0 2024-05-08T10:55:14.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.526+0000 7f0478433640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0470071a10 con 0x7f0470071f80 2024-05-08T10:55:14.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.526+0000 7f04761cf640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f047015dfb0 0x7f04700d13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:14.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.526+0000 7f04761cf640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f047015dfb0 0x7f04700d13a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47846/0 (socket says 172.21.15.33:47846) 2024-05-08T10:55:14.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.526+0000 7f04761cf640 1 -- 172.21.15.33:0/592772275 learned_addr learned my addr 172.21.15.33:0/592772275 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:14.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.526+0000 7f04759ce640 1 --2- 172.21.15.33:0/592772275 >> v2:172.21.15.174:3300/0 conn(0x7f0470071f80 0x7f047006aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:14.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.527+0000 7f04761cf640 1 -- 172.21.15.33:0/592772275 >> v2:172.21.15.174:3300/0 conn(0x7f0470071f80 msgr2=0x7f047006aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:14.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.527+0000 7f04761cf640 1 --2- 172.21.15.33:0/592772275 >> v2:172.21.15.174:3300/0 conn(0x7f0470071f80 0x7f047006aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:14.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.527+0000 7f04761cf640 1 -- 172.21.15.33:0/592772275 >> v1:172.21.15.174:6789/0 conn(0x7f047006b0e0 legacy=0x7f04700cd2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:14.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.527+0000 7f04761cf640 1 -- 172.21.15.33:0/592772275 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0470071cf0 con 0x7f047015dfb0 2024-05-08T10:55:14.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.527+0000 7f04761cf640 1 --2- 172.21.15.33:0/592772275 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f047015dfb0 0x7f04700d13a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f04700714b0 tx=0x7f046802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=987c1ebf179f082a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:14.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.528+0000 7f04751cd640 1 -- 172.21.15.33:0/592772275 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0468037070 con 0x7f047015dfb0 2024-05-08T10:55:14.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.528+0000 7f04751cd640 1 -- 172.21.15.33:0/592772275 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0468032440 con 0x7f047015dfb0 2024-05-08T10:55:14.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.528+0000 7f04751cd640 1 -- 172.21.15.33:0/592772275 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0468032810 con 0x7f047015dfb0 2024-05-08T10:55:14.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.528+0000 7f0478433640 1 -- 172.21.15.33:0/592772275 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f047015dfb0 msgr2=0x7f04700d13a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:14.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.528+0000 7f0478433640 1 --2- 172.21.15.33:0/592772275 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f047015dfb0 0x7f04700d13a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f04700714b0 tx=0x7f046802a270 comp rx=0 tx=0).stop 2024-05-08T10:55:14.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.528+0000 7f0478433640 1 -- 172.21.15.33:0/592772275 shutdown_connections 2024-05-08T10:55:14.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.528+0000 7f0478433640 1 --2- 172.21.15.33:0/592772275 >> v2:172.21.15.174:3300/0 conn(0x7f0470071f80 0x7f047006aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:14.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.528+0000 7f0478433640 1 --2- 172.21.15.33:0/592772275 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f047015dfb0 0x7f04700d13a0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:14.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.528+0000 7f0478433640 1 -- 172.21.15.33:0/592772275 >> 172.21.15.33:0/592772275 conn(0x7f04700d08b0 msgr2=0x7f04700d0c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:14.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.528+0000 7f0478433640 1 -- 172.21.15.33:0/592772275 shutdown_connections 2024-05-08T10:55:14.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.528+0000 7f0478433640 1 -- 172.21.15.33:0/592772275 wait complete. 2024-05-08T10:55:14.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.530+0000 7f0478433640 1 Processor -- start 2024-05-08T10:55:14.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.530+0000 7f0478433640 1 -- start start 2024-05-08T10:55:14.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.530+0000 7f0478433640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f047006b0e0 0x7f0470154480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:14.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.530+0000 7f0478433640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0470071f80 0x7f047015f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:14.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.530+0000 7f0478433640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f047015dfb0 0x7f0470159780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:14.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.530+0000 7f0478433640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f047006ecf0 con 0x7f047015dfb0 2024-05-08T10:55:14.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.530+0000 7f0478433640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04700ceb30 con 0x7f047006b0e0 2024-05-08T10:55:14.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.530+0000 7f0478433640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0470072700 con 0x7f0470071f80 2024-05-08T10:55:14.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.530+0000 7f04769d0640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f047015dfb0 0x7f0470159780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:14.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.531+0000 7f04769d0640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f047015dfb0 0x7f0470159780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47850/0 (socket says 172.21.15.33:47850) 2024-05-08T10:55:14.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.531+0000 7f04769d0640 1 -- 172.21.15.33:0/2804669289 learned_addr learned my addr 172.21.15.33:0/2804669289 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:14.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.531+0000 7f04761cf640 1 --2- 172.21.15.33:0/2804669289 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f047006b0e0 0x7f0470154480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:14.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.531+0000 7f04759ce640 1 --2- 172.21.15.33:0/2804669289 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0470071f80 0x7f047015f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:14.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.531+0000 7f04769d0640 1 -- 172.21.15.33:0/2804669289 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0470071f80 msgr2=0x7f047015f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:14.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.531+0000 7f04769d0640 1 --2- 172.21.15.33:0/2804669289 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0470071f80 0x7f047015f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:14.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.531+0000 7f04769d0640 1 -- 172.21.15.33:0/2804669289 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f047006b0e0 msgr2=0x7f0470154480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:14.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.531+0000 7f04769d0640 1 --2- 172.21.15.33:0/2804669289 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f047006b0e0 0x7f0470154480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:14.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.531+0000 7f04769d0640 1 -- 172.21.15.33:0/2804669289 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0470160060 con 0x7f047015dfb0 2024-05-08T10:55:14.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.531+0000 7f04769d0640 1 --2- 172.21.15.33:0/2804669289 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f047015dfb0 0x7f0470159780 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f046000c6e0 tx=0x7f046000cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:14.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.531+0000 7f046effd640 1 -- 172.21.15.33:0/2804669289 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0460003b70 con 0x7f047015dfb0 2024-05-08T10:55:14.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.531+0000 7f046effd640 1 -- 172.21.15.33:0/2804669289 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0460003d30 con 0x7f047015dfb0 2024-05-08T10:55:14.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.531+0000 7f0478433640 1 -- 172.21.15.33:0/2804669289 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0470160340 con 0x7f047015dfb0 2024-05-08T10:55:14.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.531+0000 7f046effd640 1 -- 172.21.15.33:0/2804669289 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0460005310 con 0x7f047015dfb0 2024-05-08T10:55:14.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.531+0000 7f0478433640 1 -- 172.21.15.33:0/2804669289 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0470160900 con 0x7f047015dfb0 2024-05-08T10:55:14.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.532+0000 7f0478433640 1 -- 172.21.15.33:0/2804669289 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0470069d20 con 0x7f047015dfb0 2024-05-08T10:55:14.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.533+0000 7f046effd640 1 -- 172.21.15.33:0/2804669289 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f04600054b0 con 0x7f047015dfb0 2024-05-08T10:55:14.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.533+0000 7f046effd640 1 --2- 172.21.15.33:0/2804669289 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f045c06b4d0 0x7f045c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:14.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.534+0000 7f046effd640 1 -- 172.21.15.33:0/2804669289 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0460089ee0 con 0x7f047015dfb0 2024-05-08T10:55:14.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.534+0000 7f04761cf640 1 --2- 172.21.15.33:0/2804669289 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f045c06b4d0 0x7f045c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:14.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.534+0000 7f04761cf640 1 --2- 172.21.15.33:0/2804669289 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f045c06b4d0 0x7f045c06d990 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0468034000 tx=0x7f046802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:14.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.538+0000 7f046effd640 1 -- 172.21.15.33:0/2804669289 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f047006b4f0 con 0x7f047015dfb0 2024-05-08T10:55:14.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.721+0000 7f0478433640 1 -- 172.21.15.33:0/2804669289 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f04700cdce0 con 0x7f047015dfb0 2024-05-08T10:55:14.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.722+0000 7f046effd640 1 -- 172.21.15.33:0/2804669289 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16617 (secure 0 0 0) 0x7f0460058df0 con 0x7f047015dfb0 2024-05-08T10:55:14.719 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:55:14.719 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":20,"fsid":"963217b2-c375-4f5a-95cf-88e199dd38ff","created":"2024-05-08T10:54:26.711528+0000","modified":"2024-05-08T10:54:51.528856+0000","last_up_change":"2024-05-08T10:54:37.987478+0000","last_in_change":"2024-05-08T10:54:28.834106+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T10:54:38.989228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T10:54:47.774236+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T10:54:48.869679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c5da4fb5-d4f2-4982-a804-2aa92fe77731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3990629207},{"type":"v1","addr":"172.21.15.33:6817","nonce":3990629207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3990629207},{"type":"v1","addr":"172.21.15.33:6819","nonce":3990629207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3990629207},{"type":"v1","addr":"172.21.15.33:6823","nonce":3990629207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3990629207},{"type":"v1","addr":"172.21.15.33:6821","nonce":3990629207}]},"public_addr":"172.21.15.33:6817/3990629207","cluster_addr":"172.21.15.33:6819/3990629207","heartbeat_back_addr":"172.21.15.33:6823/3990629207","heartbeat_front_addr":"172.21.15.33:6821/3990629207","state":["exists","up"]},{"osd":1,"uuid":"f8fdd8db-c2a3-4d28-81f3-b30f44bea7c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":1758076090},{"type":"v1","addr":"172.21.15.33:6825","nonce":1758076090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":1758076090},{"type":"v1","addr":"172.21.15.33:6827","nonce":1758076090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":1758076090},{"type":"v1","addr":"172.21.15.33:6831","nonce":1758076090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":1758076090},{"type":"v1","addr":"172.21.15.33:6829","nonce":1758076090}]},"public_addr":"172.21.15.33:6825/1758076090","cluster_addr":"172.21.15.33:6827/1758076090","heartbeat_back_addr":"172.21.15.33:6831/1758076090","heartbeat_front_addr":"172.21.15.33:6829/1758076090","state":["exists","up"]},{"osd":2,"uuid":"87d465f3-b40f-48dd-bae2-4c67904d4828","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":2940853479},{"type":"v1","addr":"172.21.15.33:6801","nonce":2940853479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6803","nonce":2940853479},{"type":"v1","addr":"172.21.15.33:6805","nonce":2940853479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6811","nonce":2940853479},{"type":"v1","addr":"172.21.15.33:6813","nonce":2940853479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6807","nonce":2940853479},{"type":"v1","addr":"172.21.15.33:6809","nonce":2940853479}]},"public_addr":"172.21.15.33:6801/2940853479","cluster_addr":"172.21.15.33:6805/2940853479","heartbeat_back_addr":"172.21.15.33:6813/2940853479","heartbeat_front_addr":"172.21.15.33:6809/2940853479","state":["exists","up"]},{"osd":3,"uuid":"79450edf-9637-4181-9372-e1cd5e91e73e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":4029047077},{"type":"v1","addr":"172.21.15.33:6804","nonce":4029047077}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":4029047077},{"type":"v1","addr":"172.21.15.33:6808","nonce":4029047077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":4029047077},{"type":"v1","addr":"172.21.15.33:6815","nonce":4029047077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":4029047077},{"type":"v1","addr":"172.21.15.33:6812","nonce":4029047077}]},"public_addr":"172.21.15.33:6804/4029047077","cluster_addr":"172.21.15.33:6808/4029047077","heartbeat_back_addr":"172.21.15.33:6815/4029047077","heartbeat_front_addr":"172.21.15.33:6812/4029047077","state":["exists","up"]},{"osd":4,"uuid":"bd0debfa-e559-4b1e-920d-6b2639c7085e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":1697399220},{"type":"v1","addr":"172.21.15.174:6801","nonce":1697399220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":1697399220},{"type":"v1","addr":"172.21.15.174:6803","nonce":1697399220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":1697399220},{"type":"v1","addr":"172.21.15.174:6807","nonce":1697399220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":1697399220},{"type":"v1","addr":"172.21.15.174:6805","nonce":1697399220}]},"public_addr":"172.21.15.174:6801/1697399220","cluster_addr":"172.21.15.174:6803/1697399220","heartbeat_back_addr":"172.21.15.174:6807/1697399220","heartbeat_front_addr":"172.21.15.174:6805/1697399220","state":["exists","up"]},{"osd":5,"uuid":"ff0f51c0-672b-448f-9de1-b9305ce8c00d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":1511860729},{"type":"v1","addr":"172.21.15.174:6825","nonce":1511860729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":1511860729},{"type":"v1","addr":"172.21.15.174:6827","nonce":1511860729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":1511860729},{"type":"v1","addr":"172.21.15.174:6831","nonce":1511860729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":1511860729},{"type":"v1","addr":"172.21.15.174:6829","nonce":1511860729}]},"public_addr":"172.21.15.174:6825/1511860729","cluster_addr":"172.21.15.174:6827/1511860729","heartbeat_back_addr":"172.21.15.174:6831/1511860729","heartbeat_front_addr":"172.21.15.174:6829/1511860729","state":["exists","up"]},{"osd":6,"uuid":"93061f6c-c0ce-47e9-88a0-1151c5ccb4e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":2326407945},{"type":"v1","addr":"172.21.15.174:6817","nonce":2326407945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":2326407945},{"type":"v1","addr":"172.21.15.174:6819","nonce":2326407945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":2326407945},{"type":"v1","addr":"172.21.15.174:6823","nonce":2326407945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":2326407945},{"type":"v1","addr":"172.21.15.174:6821","nonce":2326407945}]},"public_addr":"172.21.15.174:6817/2326407945","cluster_addr":"172.21.15.174:6819/2326407945","heartbeat_back_addr":"172.21.15.174:6823/2326407945","heartbeat_front_addr":"172.21.15.174:6821/2326407945","state":["exists","up"]},{"osd":7,"uuid":"7be1dcf3-1957-4ec3-bacf-f5f9fff580a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":1637570253},{"type":"v1","addr":"172.21.15.174:6809","nonce":1637570253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":1637570253},{"type":"v1","addr":"172.21.15.174:6811","nonce":1637570253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":1637570253},{"type":"v1","addr":"172.21.15.174:6815","nonce":1637570253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":1637570253},{"type":"v1","addr":"172.21.15.174:6813","nonce":1637570253}]},"public_addr":"172.21.15.174:6809/1637570253","cluster_addr":"172.21.15.174:6811/1637570253","heartbeat_back_addr":"172.21.15.174:6815/1637570253","heartbeat_front_addr":"172.21.15.174:6813/1637570253","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:33.997709+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:34.016568+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:33.990484+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:33.980666+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:33.920609+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:34.005069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:34.018345+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:34.061646+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T10:55:14.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.724+0000 7f0478433640 1 -- 172.21.15.33:0/2804669289 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f045c06b4d0 msgr2=0x7f045c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:14.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.724+0000 7f0478433640 1 --2- 172.21.15.33:0/2804669289 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f045c06b4d0 0x7f045c06d990 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0468034000 tx=0x7f046802e000 comp rx=0 tx=0).stop 2024-05-08T10:55:14.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.724+0000 7f0478433640 1 -- 172.21.15.33:0/2804669289 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f047015dfb0 msgr2=0x7f0470159780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:14.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.724+0000 7f0478433640 1 --2- 172.21.15.33:0/2804669289 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f047015dfb0 0x7f0470159780 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f046000c6e0 tx=0x7f046000cba0 comp rx=0 tx=0).stop 2024-05-08T10:55:14.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.724+0000 7f0478433640 1 -- 172.21.15.33:0/2804669289 shutdown_connections 2024-05-08T10:55:14.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.725+0000 7f0478433640 1 --2- 172.21.15.33:0/2804669289 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f045c06b4d0 0x7f045c06d990 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:14.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.725+0000 7f0478433640 1 --2- 172.21.15.33:0/2804669289 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f047015dfb0 0x7f0470159780 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:14.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.725+0000 7f0478433640 1 --2- 172.21.15.33:0/2804669289 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0470071f80 0x7f047015f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:14.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.725+0000 7f0478433640 1 --2- 172.21.15.33:0/2804669289 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f047006b0e0 0x7f0470154480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:14.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.725+0000 7f0478433640 1 -- 172.21.15.33:0/2804669289 >> 172.21.15.33:0/2804669289 conn(0x7f04700d08b0 msgr2=0x7f04700d0c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:14.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.725+0000 7f0478433640 1 -- 172.21.15.33:0/2804669289 shutdown_connections 2024-05-08T10:55:14.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.725+0000 7f0478433640 1 -- 172.21.15.33:0/2804669289 wait complete. 2024-05-08T10:55:14.732 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T10:54:38.989228+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-08T10:54:47.774236+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-08T10:54:48.869679+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-08T10:55:14.732 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T10:55:14.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.843+0000 7f8f8cc9a640 1 Processor -- start 2024-05-08T10:55:14.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.843+0000 7f8f8cc9a640 1 -- start start 2024-05-08T10:55:14.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.844+0000 7f8f8cc9a640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8f8815a450 0x7f8f880b3de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:14.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.844+0000 7f8f8cc9a640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f8f880ccff0 0x7f8f880b4320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:14.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.844+0000 7f8f8cc9a640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f88071470 con 0x7f8f880ae9d0 2024-05-08T10:55:14.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.844+0000 7f8f8cc9a640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f880b4860 con 0x7f8f880ccff0 2024-05-08T10:55:14.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.844+0000 7f8f8cc9a640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f8815a830 con 0x7f8f8815a450 2024-05-08T10:55:14.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.844+0000 7f8f86d9d640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f8f880ae9d0 0x7f8f880703c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:48166/0 (socket says 172.21.15.33:48166) 2024-05-08T10:55:14.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.844+0000 7f8f86d9d640 1 -- 172.21.15.33:0/2962492608 learned_addr learned my addr 172.21.15.33:0/2962492608 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-05-08T10:55:14.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.844+0000 7f8f7dd9b640 1 --2- 172.21.15.33:0/2962492608 >> v2:172.21.15.174:3300/0 conn(0x7f8f880ccff0 0x7f8f880b4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:14.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.844+0000 7f8f8659c640 1 --2- 172.21.15.33:0/2962492608 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8f8815a450 0x7f8f880b3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:14.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.844+0000 7f8f85d9b640 1 -- 172.21.15.33:0/2962492608 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 897833363 0 0) 0x7f8f88071470 con 0x7f8f880ae9d0 2024-05-08T10:55:14.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.844+0000 7f8f85d9b640 1 -- 172.21.15.33:0/2962492608 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f74003520 con 0x7f8f880ae9d0 2024-05-08T10:55:14.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.844+0000 7f8f7dd9b640 1 -- 172.21.15.33:0/2962492608 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8f8815a450 msgr2=0x7f8f880b3de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:14.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.844+0000 7f8f7dd9b640 1 --2- 172.21.15.33:0/2962492608 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8f8815a450 0x7f8f880b3de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:14.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.844+0000 7f8f7dd9b640 1 -- 172.21.15.33:0/2962492608 >> v1:172.21.15.33:6789/0 conn(0x7f8f880ae9d0 legacy=0x7f8f880703c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:14.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.844+0000 7f8f7dd9b640 1 -- 172.21.15.33:0/2962492608 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f880722f0 con 0x7f8f880ccff0 2024-05-08T10:55:14.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.844+0000 7f8f8659c640 1 --2- 172.21.15.33:0/2962492608 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8f8815a450 0x7f8f880b3de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T10:55:14.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.845+0000 7f8f7dd9b640 1 --2- 172.21.15.33:0/2962492608 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8f880ccff0 0x7f8f880b4320 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8f700097a0 tx=0x7f8f7002a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a35ec6f0b980ef server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:14.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.845+0000 7f8f85d9b640 1 -- 172.21.15.33:0/2962492608 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f70037070 con 0x7f8f880ccff0 2024-05-08T10:55:14.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.845+0000 7f8f85d9b640 1 -- 172.21.15.33:0/2962492608 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f7002ae50 con 0x7f8f880ccff0 2024-05-08T10:55:14.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.845+0000 7f8f85d9b640 1 -- 172.21.15.33:0/2962492608 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f70032660 con 0x7f8f880ccff0 2024-05-08T10:55:14.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.846+0000 7f8f8cc9a640 1 -- 172.21.15.33:0/2962492608 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8f880ccff0 msgr2=0x7f8f880b4320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:14.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.846+0000 7f8f8cc9a640 1 --2- 172.21.15.33:0/2962492608 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8f880ccff0 0x7f8f880b4320 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8f700097a0 tx=0x7f8f7002a100 comp rx=0 tx=0).stop 2024-05-08T10:55:14.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.846+0000 7f8f8cc9a640 1 -- 172.21.15.33:0/2962492608 shutdown_connections 2024-05-08T10:55:14.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.846+0000 7f8f8cc9a640 1 --2- 172.21.15.33:0/2962492608 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8f880ccff0 0x7f8f880b4320 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:14.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.846+0000 7f8f8cc9a640 1 --2- 172.21.15.33:0/2962492608 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8f8815a450 0x7f8f880b3de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:14.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.846+0000 7f8f8cc9a640 1 -- 172.21.15.33:0/2962492608 >> 172.21.15.33:0/2962492608 conn(0x7f8f880b1400 msgr2=0x7f8f880b1810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:14.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.846+0000 7f8f8cc9a640 1 -- 172.21.15.33:0/2962492608 shutdown_connections 2024-05-08T10:55:14.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.846+0000 7f8f8cc9a640 1 -- 172.21.15.33:0/2962492608 wait complete. 2024-05-08T10:55:14.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.847+0000 7f8f8cc9a640 1 Processor -- start 2024-05-08T10:55:14.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.847+0000 7f8f8cc9a640 1 -- start start 2024-05-08T10:55:14.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.848+0000 7f8f8cc9a640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8f880ae9d0 0x7f8f88151700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:14.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.848+0000 7f8f8cc9a640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8f880ccff0 0x7f8f88151c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:14.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.848+0000 7f8f8cc9a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f8815a450 0x7f8f88149d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:14.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.848+0000 7f8f8cc9a640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f880aef90 con 0x7f8f8815a450 2024-05-08T10:55:14.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.848+0000 7f8f8cc9a640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f880725d0 con 0x7f8f880ae9d0 2024-05-08T10:55:14.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.848+0000 7f8f8cc9a640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f880af110 con 0x7f8f880ccff0 2024-05-08T10:55:14.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.848+0000 7f8f86d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f8815a450 0x7f8f88149d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:14.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.848+0000 7f8f86d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f8815a450 0x7f8f88149d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47852/0 (socket says 172.21.15.33:47852) 2024-05-08T10:55:14.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.848+0000 7f8f86d9d640 1 -- 172.21.15.33:0/2173663725 learned_addr learned my addr 172.21.15.33:0/2173663725 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:14.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.849+0000 7f8f8659c640 1 --2- 172.21.15.33:0/2173663725 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8f880ae9d0 0x7f8f88151700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:14.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.849+0000 7f8f7dd9b640 1 --2- 172.21.15.33:0/2173663725 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8f880ccff0 0x7f8f88151c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:14.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.849+0000 7f8f86d9d640 1 -- 172.21.15.33:0/2173663725 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8f880ccff0 msgr2=0x7f8f88151c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:14.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.849+0000 7f8f86d9d640 1 --2- 172.21.15.33:0/2173663725 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8f880ccff0 0x7f8f88151c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:14.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.849+0000 7f8f86d9d640 1 -- 172.21.15.33:0/2173663725 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8f880ae9d0 msgr2=0x7f8f88151700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:14.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.849+0000 7f8f86d9d640 1 --2- 172.21.15.33:0/2173663725 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8f880ae9d0 0x7f8f88151700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:14.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.849+0000 7f8f86d9d640 1 -- 172.21.15.33:0/2173663725 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f880b05e0 con 0x7f8f8815a450 2024-05-08T10:55:14.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.849+0000 7f8f7dd9b640 1 --2- 172.21.15.33:0/2173663725 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8f880ccff0 0x7f8f88151c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:55:14.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.849+0000 7f8f86d9d640 1 --2- 172.21.15.33:0/2173663725 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f8815a450 0x7f8f88149d50 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f8f8000caa0 tx=0x7f8f8000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:14.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.849+0000 7f8f7f7fe640 1 -- 172.21.15.33:0/2173663725 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f80017070 con 0x7f8f8815a450 2024-05-08T10:55:14.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.849+0000 7f8f7f7fe640 1 -- 172.21.15.33:0/2173663725 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f8000ac00 con 0x7f8f8815a450 2024-05-08T10:55:14.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.849+0000 7f8f8cc9a640 1 -- 172.21.15.33:0/2173663725 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f880b08c0 con 0x7f8f8815a450 2024-05-08T10:55:14.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.849+0000 7f8f7f7fe640 1 -- 172.21.15.33:0/2173663725 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f80012400 con 0x7f8f8815a450 2024-05-08T10:55:14.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.849+0000 7f8f8cc9a640 1 -- 172.21.15.33:0/2173663725 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f8814e020 con 0x7f8f8815a450 2024-05-08T10:55:14.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.850+0000 7f8f8cc9a640 1 -- 172.21.15.33:0/2173663725 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f88069d20 con 0x7f8f8815a450 2024-05-08T10:55:14.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.851+0000 7f8f7f7fe640 1 -- 172.21.15.33:0/2173663725 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8f8001a070 con 0x7f8f8815a450 2024-05-08T10:55:14.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.851+0000 7f8f7f7fe640 1 --2- 172.21.15.33:0/2173663725 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f8f6806b500 0x7f8f6806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:14.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.851+0000 7f8f7f7fe640 1 -- 172.21.15.33:0/2173663725 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8f8008a0c0 con 0x7f8f8815a450 2024-05-08T10:55:14.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.851+0000 7f8f8659c640 1 --2- 172.21.15.33:0/2173663725 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f8f6806b500 0x7f8f6806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:14.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.852+0000 7f8f8659c640 1 --2- 172.21.15.33:0/2173663725 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f8f6806b500 0x7f8f6806d9c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8f78009560 tx=0x7f8f78008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:14.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:14.855+0000 7f8f7f7fe640 1 -- 172.21.15.33:0/2173663725 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8f80058eb0 con 0x7f8f8815a450 2024-05-08T10:55:15.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.036+0000 7f8f8cc9a640 1 -- 172.21.15.33:0/2173663725 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8f8814ec20 con 0x7f8f8815a450 2024-05-08T10:55:15.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.037+0000 7f8f7f7fe640 1 -- 172.21.15.33:0/2173663725 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8f800587b0 con 0x7f8f8815a450 2024-05-08T10:55:15.033 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2024-05-08T10:55:15.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.038+0000 7f8f8cc9a640 1 -- 172.21.15.33:0/2173663725 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f8f6806b500 msgr2=0x7f8f6806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:15.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.038+0000 7f8f8cc9a640 1 --2- 172.21.15.33:0/2173663725 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f8f6806b500 0x7f8f6806d9c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8f78009560 tx=0x7f8f78008040 comp rx=0 tx=0).stop 2024-05-08T10:55:15.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.038+0000 7f8f8cc9a640 1 -- 172.21.15.33:0/2173663725 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f8815a450 msgr2=0x7f8f88149d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:15.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.038+0000 7f8f8cc9a640 1 --2- 172.21.15.33:0/2173663725 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f8815a450 0x7f8f88149d50 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f8f8000caa0 tx=0x7f8f8000cf60 comp rx=0 tx=0).stop 2024-05-08T10:55:15.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.038+0000 7f8f8cc9a640 1 -- 172.21.15.33:0/2173663725 shutdown_connections 2024-05-08T10:55:15.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.038+0000 7f8f8cc9a640 1 --2- 172.21.15.33:0/2173663725 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f8f6806b500 0x7f8f6806d9c0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:15.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.038+0000 7f8f8cc9a640 1 --2- 172.21.15.33:0/2173663725 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f8815a450 0x7f8f88149d50 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:15.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.038+0000 7f8f8cc9a640 1 --2- 172.21.15.33:0/2173663725 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8f880ccff0 0x7f8f88151c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:15.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.038+0000 7f8f8cc9a640 1 --2- 172.21.15.33:0/2173663725 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8f880ae9d0 0x7f8f88151700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:15.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.038+0000 7f8f8cc9a640 1 -- 172.21.15.33:0/2173663725 >> 172.21.15.33:0/2173663725 conn(0x7f8f880b1400 msgr2=0x7f8f88155340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:15.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.038+0000 7f8f8cc9a640 1 -- 172.21.15.33:0/2173663725 shutdown_connections 2024-05-08T10:55:15.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.039+0000 7f8f8cc9a640 1 -- 172.21.15.33:0/2173663725 wait complete. 2024-05-08T10:55:15.046 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-08T10:55:15.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.157+0000 7fae8afb7640 1 Processor -- start 2024-05-08T10:55:15.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.157+0000 7fae8afb7640 1 -- start start 2024-05-08T10:55:15.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.157+0000 7fae8afb7640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fae840cef30 0x7fae84144400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:15.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.158+0000 7fae8afb7640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae84144210 con 0x7fae84143e30 2024-05-08T10:55:15.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.158+0000 7fae8afb7640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae8415b4c0 con 0x7fae840b1f20 2024-05-08T10:55:15.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.158+0000 7fae8afb7640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae8415c0d0 con 0x7fae840cef30 2024-05-08T10:55:15.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.158+0000 7fae88d53640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fae84143e30 0x7fae840ce820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:48180/0 (socket says 172.21.15.33:48180) 2024-05-08T10:55:15.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.158+0000 7fae88d53640 1 -- 172.21.15.33:0/3198731718 learned_addr learned my addr 172.21.15.33:0/3198731718 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-05-08T10:55:15.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.158+0000 7fae83fff640 1 --2- 172.21.15.33:0/3198731718 >> v2:172.21.15.174:3300/0 conn(0x7fae840cef30 0x7fae84144400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:15.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.158+0000 7fae837fe640 1 -- 172.21.15.33:0/3198731718 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3316354520 0 0) 0x7fae84144210 con 0x7fae84143e30 2024-05-08T10:55:15.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.158+0000 7fae837fe640 1 -- 172.21.15.33:0/3198731718 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae74003520 con 0x7fae84143e30 2024-05-08T10:55:15.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.158+0000 7fae837fe640 1 -- 172.21.15.33:0/3198731718 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1245397879 0 0) 0x7fae8415b4c0 con 0x7fae840b1f20 2024-05-08T10:55:15.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.158+0000 7fae837fe640 1 -- 172.21.15.33:0/3198731718 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae84144210 con 0x7fae840b1f20 2024-05-08T10:55:15.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.158+0000 7fae83fff640 1 -- 172.21.15.33:0/3198731718 >> v1:172.21.15.174:6789/0 conn(0x7fae840b1f20 legacy=0x7fae8415e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:15.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.158+0000 7fae83fff640 1 -- 172.21.15.33:0/3198731718 >> v1:172.21.15.33:6789/0 conn(0x7fae84143e30 legacy=0x7fae840ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:15.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.158+0000 7fae83fff640 1 -- 172.21.15.33:0/3198731718 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae8415b7a0 con 0x7fae840cef30 2024-05-08T10:55:15.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.159+0000 7fae83fff640 1 --2- 172.21.15.33:0/3198731718 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fae840cef30 0x7fae84144400 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fae700097a0 tx=0x7fae7002a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cff95bcab8108dda server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:15.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.159+0000 7fae837fe640 1 -- 172.21.15.33:0/3198731718 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae70037070 con 0x7fae840cef30 2024-05-08T10:55:15.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.159+0000 7fae837fe640 1 -- 172.21.15.33:0/3198731718 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae70032440 con 0x7fae840cef30 2024-05-08T10:55:15.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.159+0000 7fae837fe640 1 -- 172.21.15.33:0/3198731718 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae70032810 con 0x7fae840cef30 2024-05-08T10:55:15.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.160+0000 7fae8afb7640 1 -- 172.21.15.33:0/3198731718 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fae840cef30 msgr2=0x7fae84144400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:15.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.160+0000 7fae8afb7640 1 --2- 172.21.15.33:0/3198731718 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fae840cef30 0x7fae84144400 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fae700097a0 tx=0x7fae7002a230 comp rx=0 tx=0).stop 2024-05-08T10:55:15.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.160+0000 7fae8afb7640 1 -- 172.21.15.33:0/3198731718 shutdown_connections 2024-05-08T10:55:15.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.160+0000 7fae8afb7640 1 --2- 172.21.15.33:0/3198731718 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fae840cef30 0x7fae84144400 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:15.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.160+0000 7fae8afb7640 1 -- 172.21.15.33:0/3198731718 >> 172.21.15.33:0/3198731718 conn(0x7fae840b1400 msgr2=0x7fae840b1810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:15.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.160+0000 7fae8afb7640 1 -- 172.21.15.33:0/3198731718 shutdown_connections 2024-05-08T10:55:15.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.160+0000 7fae8afb7640 1 -- 172.21.15.33:0/3198731718 wait complete. 2024-05-08T10:55:15.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.161+0000 7fae8afb7640 1 Processor -- start 2024-05-08T10:55:15.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.161+0000 7fae8afb7640 1 -- start start 2024-05-08T10:55:15.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.162+0000 7fae8afb7640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fae840b1f20 0x7fae841422f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:15.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.162+0000 7fae8afb7640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fae840cef30 0x7fae840aa560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:15.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.162+0000 7fae8afb7640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fae84143e30 0x7fae840aaaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:15.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.162+0000 7fae8afb7640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae8415b1b0 con 0x7fae84143e30 2024-05-08T10:55:15.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.162+0000 7fae8afb7640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae8415bd60 con 0x7fae840cef30 2024-05-08T10:55:15.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.162+0000 7fae8afb7640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae840703c0 con 0x7fae840b1f20 2024-05-08T10:55:15.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.162+0000 7fae89554640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fae84143e30 0x7fae840aaaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:15.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.162+0000 7fae89554640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fae84143e30 0x7fae840aaaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47858/0 (socket says 172.21.15.33:47858) 2024-05-08T10:55:15.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.162+0000 7fae89554640 1 -- 172.21.15.33:0/178678422 learned_addr learned my addr 172.21.15.33:0/178678422 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:15.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.162+0000 7fae83fff640 1 --2- 172.21.15.33:0/178678422 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fae840cef30 0x7fae840aa560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:15.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.162+0000 7fae88d53640 1 --2- 172.21.15.33:0/178678422 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fae840b1f20 0x7fae841422f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:15.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.162+0000 7fae89554640 1 -- 172.21.15.33:0/178678422 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fae840b1f20 msgr2=0x7fae841422f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:15.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.162+0000 7fae89554640 1 --2- 172.21.15.33:0/178678422 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fae840b1f20 0x7fae841422f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:15.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.162+0000 7fae89554640 1 -- 172.21.15.33:0/178678422 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fae840cef30 msgr2=0x7fae840aa560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:15.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.162+0000 7fae89554640 1 --2- 172.21.15.33:0/178678422 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fae840cef30 0x7fae840aa560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:15.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.162+0000 7fae89554640 1 -- 172.21.15.33:0/178678422 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae84071750 con 0x7fae84143e30 2024-05-08T10:55:15.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.162+0000 7fae89554640 1 --2- 172.21.15.33:0/178678422 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fae84143e30 0x7fae840aaaa0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fae7c00c790 tx=0x7fae7c00cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:15.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.162+0000 7fae817fa640 1 -- 172.21.15.33:0/178678422 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae7c003b70 con 0x7fae84143e30 2024-05-08T10:55:15.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.163+0000 7fae817fa640 1 -- 172.21.15.33:0/178678422 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae7c003d10 con 0x7fae84143e30 2024-05-08T10:55:15.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.163+0000 7fae8afb7640 1 -- 172.21.15.33:0/178678422 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae84071a30 con 0x7fae84143e30 2024-05-08T10:55:15.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.163+0000 7fae817fa640 1 -- 172.21.15.33:0/178678422 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae7c00aa50 con 0x7fae84143e30 2024-05-08T10:55:15.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.163+0000 7fae8afb7640 1 -- 172.21.15.33:0/178678422 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae84071ff0 con 0x7fae84143e30 2024-05-08T10:55:15.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.164+0000 7fae8afb7640 1 -- 172.21.15.33:0/178678422 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae84069d20 con 0x7fae84143e30 2024-05-08T10:55:15.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.164+0000 7fae817fa640 1 -- 172.21.15.33:0/178678422 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fae7c00abf0 con 0x7fae84143e30 2024-05-08T10:55:15.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.164+0000 7fae817fa640 1 --2- 172.21.15.33:0/178678422 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fae6806b4d0 0x7fae6806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:15.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.165+0000 7fae817fa640 1 -- 172.21.15.33:0/178678422 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fae7c08a160 con 0x7fae84143e30 2024-05-08T10:55:15.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.165+0000 7fae88d53640 1 --2- 172.21.15.33:0/178678422 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fae6806b4d0 0x7fae6806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:15.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.165+0000 7fae88d53640 1 --2- 172.21.15.33:0/178678422 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fae6806b4d0 0x7fae6806d990 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fae780011e0 tx=0x7fae78009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:15.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.168+0000 7fae817fa640 1 -- 172.21.15.33:0/178678422 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fae7c059070 con 0x7fae84143e30 2024-05-08T10:55:15.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.352+0000 7fae8afb7640 1 -- 172.21.15.33:0/178678422 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fae8406e540 con 0x7fae84143e30 2024-05-08T10:55:15.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.352+0000 7fae817fa640 1 -- 172.21.15.33:0/178678422 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fae7c058970 con 0x7fae84143e30 2024-05-08T10:55:15.349 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 32 2024-05-08T10:55:15.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.354+0000 7fae8afb7640 1 -- 172.21.15.33:0/178678422 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fae6806b4d0 msgr2=0x7fae6806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:15.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.354+0000 7fae8afb7640 1 --2- 172.21.15.33:0/178678422 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fae6806b4d0 0x7fae6806d990 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fae780011e0 tx=0x7fae78009040 comp rx=0 tx=0).stop 2024-05-08T10:55:15.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.354+0000 7fae8afb7640 1 -- 172.21.15.33:0/178678422 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fae84143e30 msgr2=0x7fae840aaaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:15.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.354+0000 7fae8afb7640 1 --2- 172.21.15.33:0/178678422 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fae84143e30 0x7fae840aaaa0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fae7c00c790 tx=0x7fae7c00cc50 comp rx=0 tx=0).stop 2024-05-08T10:55:15.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.354+0000 7fae8afb7640 1 -- 172.21.15.33:0/178678422 shutdown_connections 2024-05-08T10:55:15.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.354+0000 7fae8afb7640 1 --2- 172.21.15.33:0/178678422 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fae6806b4d0 0x7fae6806d990 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:15.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.354+0000 7fae8afb7640 1 --2- 172.21.15.33:0/178678422 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fae84143e30 0x7fae840aaaa0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:15.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.354+0000 7fae8afb7640 1 --2- 172.21.15.33:0/178678422 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fae840cef30 0x7fae840aa560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:15.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.354+0000 7fae8afb7640 1 --2- 172.21.15.33:0/178678422 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fae840b1f20 0x7fae841422f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:15.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.354+0000 7fae8afb7640 1 -- 172.21.15.33:0/178678422 >> 172.21.15.33:0/178678422 conn(0x7fae840b1400 msgr2=0x7fae84143420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:15.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.355+0000 7fae8afb7640 1 -- 172.21.15.33:0/178678422 shutdown_connections 2024-05-08T10:55:15.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.355+0000 7fae8afb7640 1 -- 172.21.15.33:0/178678422 wait complete. 2024-05-08T10:55:15.362 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-08T10:55:15.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.472+0000 7fa26f5b0640 1 Processor -- start 2024-05-08T10:55:15.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.473+0000 7fa26f5b0640 1 -- start start 2024-05-08T10:55:15.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.473+0000 7fa26f5b0640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa2680b33b0 0x7fa2680d0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:15.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.473+0000 7fa26f5b0640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2680d0e60 con 0x7fa2680d0a50 2024-05-08T10:55:15.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.473+0000 7fa26f5b0640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2680cfb90 con 0x7fa2680b4320 2024-05-08T10:55:15.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.473+0000 7fa26f5b0640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2680cf5d0 con 0x7fa2680b33b0 2024-05-08T10:55:15.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.473+0000 7fa26db4d640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fa2680d0a50 0x7fa2680d1fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:48182/0 (socket says 172.21.15.33:48182) 2024-05-08T10:55:15.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.474+0000 7fa26db4d640 1 -- 172.21.15.33:0/3124229907 learned_addr learned my addr 172.21.15.33:0/3124229907 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-05-08T10:55:15.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.474+0000 7fa26cb4b640 1 --2- 172.21.15.33:0/3124229907 >> v2:172.21.15.174:3300/0 conn(0x7fa2680b33b0 0x7fa2680d0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:15.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.474+0000 7fa267fff640 1 -- 172.21.15.33:0/3124229907 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3315290720 0 0) 0x7fa258001490 con 0x7fa2680d0a50 2024-05-08T10:55:15.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.474+0000 7fa267fff640 1 -- 172.21.15.33:0/3124229907 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa250003520 con 0x7fa2680d0a50 2024-05-08T10:55:15.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.474+0000 7fa26cb4b640 1 -- 172.21.15.33:0/3124229907 >> v1:172.21.15.174:6789/0 conn(0x7fa2680b4320 legacy=0x7fa2680d4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:15.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.474+0000 7fa267fff640 1 -- 172.21.15.33:0/3124229907 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1797829231 0 0) 0x7fa2680cfb90 con 0x7fa2680b4320 2024-05-08T10:55:15.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.474+0000 7fa26cb4b640 1 -- 172.21.15.33:0/3124229907 >> v1:172.21.15.33:6789/0 conn(0x7fa2680d0a50 legacy=0x7fa2680d1fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:15.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.474+0000 7fa26cb4b640 1 -- 172.21.15.33:0/3124229907 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2680cf8b0 con 0x7fa2680b33b0 2024-05-08T10:55:15.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.475+0000 7fa26cb4b640 1 --2- 172.21.15.33:0/3124229907 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa2680b33b0 0x7fa2680d0510 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa25c0097a0 tx=0x7fa25c02a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2956864439b8495b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:15.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.475+0000 7fa267fff640 1 -- 172.21.15.33:0/3124229907 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa25c037070 con 0x7fa2680b33b0 2024-05-08T10:55:15.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.475+0000 7fa267fff640 1 -- 172.21.15.33:0/3124229907 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa25c032440 con 0x7fa2680b33b0 2024-05-08T10:55:15.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.475+0000 7fa267fff640 1 -- 172.21.15.33:0/3124229907 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa25c0327f0 con 0x7fa2680b33b0 2024-05-08T10:55:15.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.475+0000 7fa26f5b0640 1 -- 172.21.15.33:0/3124229907 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa2680b33b0 msgr2=0x7fa2680d0510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:15.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.475+0000 7fa26f5b0640 1 --2- 172.21.15.33:0/3124229907 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa2680b33b0 0x7fa2680d0510 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa25c0097a0 tx=0x7fa25c02a230 comp rx=0 tx=0).stop 2024-05-08T10:55:15.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.475+0000 7fa26f5b0640 1 -- 172.21.15.33:0/3124229907 shutdown_connections 2024-05-08T10:55:15.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.475+0000 7fa26f5b0640 1 --2- 172.21.15.33:0/3124229907 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa2680b33b0 0x7fa2680d0510 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:15.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.475+0000 7fa26f5b0640 1 -- 172.21.15.33:0/3124229907 >> 172.21.15.33:0/3124229907 conn(0x7fa26809ce90 msgr2=0x7fa2680d3b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:15.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.476+0000 7fa26f5b0640 1 -- 172.21.15.33:0/3124229907 shutdown_connections 2024-05-08T10:55:15.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.476+0000 7fa26f5b0640 1 -- 172.21.15.33:0/3124229907 wait complete. 2024-05-08T10:55:15.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.477+0000 7fa26f5b0640 1 Processor -- start 2024-05-08T10:55:15.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.477+0000 7fa26f5b0640 1 -- start start 2024-05-08T10:55:15.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.477+0000 7fa26f5b0640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa2680b33b0 0x7fa268154e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:15.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.477+0000 7fa26f5b0640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa2680b4320 0x7fa2680c7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:15.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.477+0000 7fa26f5b0640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa2680d0a50 0x7fa2680c9f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:15.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.477+0000 7fa26f5b0640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2680b3860 con 0x7fa2680b4320 2024-05-08T10:55:15.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.477+0000 7fa26f5b0640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2680d1a90 con 0x7fa2680b33b0 2024-05-08T10:55:15.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.477+0000 7fa26f5b0640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2680b4ca0 con 0x7fa2680d0a50 2024-05-08T10:55:15.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.478+0000 7fa26cb4b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa2680b4320 0x7fa2680c7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:15.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.478+0000 7fa26cb4b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa2680b4320 0x7fa2680c7e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47864/0 (socket says 172.21.15.33:47864) 2024-05-08T10:55:15.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.478+0000 7fa26cb4b640 1 -- 172.21.15.33:0/859870807 learned_addr learned my addr 172.21.15.33:0/859870807 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:15.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.478+0000 7fa26d34c640 1 --2- 172.21.15.33:0/859870807 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa2680b33b0 0x7fa268154e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:15.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.478+0000 7fa26db4d640 1 --2- 172.21.15.33:0/859870807 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa2680d0a50 0x7fa2680c9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:15.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.478+0000 7fa26cb4b640 1 -- 172.21.15.33:0/859870807 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa2680d0a50 msgr2=0x7fa2680c9f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:15.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.478+0000 7fa26cb4b640 1 --2- 172.21.15.33:0/859870807 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa2680d0a50 0x7fa2680c9f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:15.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.478+0000 7fa26cb4b640 1 -- 172.21.15.33:0/859870807 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa2680b33b0 msgr2=0x7fa268154e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:15.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.478+0000 7fa26cb4b640 1 --2- 172.21.15.33:0/859870807 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa2680b33b0 0x7fa268154e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:15.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.478+0000 7fa26cb4b640 1 -- 172.21.15.33:0/859870807 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2680c87f0 con 0x7fa2680b4320 2024-05-08T10:55:15.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.478+0000 7fa26db4d640 1 --2- 172.21.15.33:0/859870807 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa2680d0a50 0x7fa2680c9f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:55:15.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.478+0000 7fa26d34c640 1 --2- 172.21.15.33:0/859870807 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa2680b33b0 0x7fa268154e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:55:15.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.478+0000 7fa26cb4b640 1 --2- 172.21.15.33:0/859870807 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa2680b4320 0x7fa2680c7e80 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa25c02a270 tx=0x7fa25c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:15.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.478+0000 7fa265ffb640 1 -- 172.21.15.33:0/859870807 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa25c037040 con 0x7fa2680b4320 2024-05-08T10:55:15.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.478+0000 7fa265ffb640 1 -- 172.21.15.33:0/859870807 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa25c042070 con 0x7fa2680b4320 2024-05-08T10:55:15.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.478+0000 7fa265ffb640 1 -- 172.21.15.33:0/859870807 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa25c030900 con 0x7fa2680b4320 2024-05-08T10:55:15.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.478+0000 7fa26f5b0640 1 -- 172.21.15.33:0/859870807 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2680c8ad0 con 0x7fa2680b4320 2024-05-08T10:55:15.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.479+0000 7fa26f5b0640 1 -- 172.21.15.33:0/859870807 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2680cc260 con 0x7fa2680b4320 2024-05-08T10:55:15.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.480+0000 7fa26f5b0640 1 -- 172.21.15.33:0/859870807 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa268069d20 con 0x7fa2680b4320 2024-05-08T10:55:15.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.480+0000 7fa265ffb640 1 -- 172.21.15.33:0/859870807 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa25c030aa0 con 0x7fa2680b4320 2024-05-08T10:55:15.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.480+0000 7fa265ffb640 1 --2- 172.21.15.33:0/859870807 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fa25406b4d0 0x7fa25406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:15.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.481+0000 7fa265ffb640 1 -- 172.21.15.33:0/859870807 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa25c0aabf0 con 0x7fa2680b4320 2024-05-08T10:55:15.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.481+0000 7fa26d34c640 1 --2- 172.21.15.33:0/859870807 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fa25406b4d0 0x7fa25406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:15.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.481+0000 7fa26d34c640 1 --2- 172.21.15.33:0/859870807 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fa25406b4d0 0x7fa25406d990 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa260000f60 tx=0x7fa260009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:15.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.485+0000 7fa265ffb640 1 -- 172.21.15.33:0/859870807 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa25c079a80 con 0x7fa2680b4320 2024-05-08T10:55:15.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.664+0000 7fa26f5b0640 1 -- 172.21.15.33:0/859870807 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa2680d11c0 con 0x7fa2680b4320 2024-05-08T10:55:15.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.665+0000 7fa265ffb640 1 -- 172.21.15.33:0/859870807 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa25c079380 con 0x7fa2680b4320 2024-05-08T10:55:15.661 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 64 2024-05-08T10:55:15.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.667+0000 7fa26f5b0640 1 -- 172.21.15.33:0/859870807 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fa25406b4d0 msgr2=0x7fa25406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:15.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.667+0000 7fa26f5b0640 1 --2- 172.21.15.33:0/859870807 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fa25406b4d0 0x7fa25406d990 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa260000f60 tx=0x7fa260009040 comp rx=0 tx=0).stop 2024-05-08T10:55:15.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.667+0000 7fa26f5b0640 1 -- 172.21.15.33:0/859870807 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa2680b4320 msgr2=0x7fa2680c7e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:15.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.667+0000 7fa26f5b0640 1 --2- 172.21.15.33:0/859870807 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa2680b4320 0x7fa2680c7e80 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa25c02a270 tx=0x7fa25c0046c0 comp rx=0 tx=0).stop 2024-05-08T10:55:15.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.667+0000 7fa26f5b0640 1 -- 172.21.15.33:0/859870807 shutdown_connections 2024-05-08T10:55:15.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.667+0000 7fa26f5b0640 1 --2- 172.21.15.33:0/859870807 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fa25406b4d0 0x7fa25406d990 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:15.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.667+0000 7fa26f5b0640 1 --2- 172.21.15.33:0/859870807 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa2680d0a50 0x7fa2680c9f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:15.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.667+0000 7fa26f5b0640 1 --2- 172.21.15.33:0/859870807 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa2680b4320 0x7fa2680c7e80 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:15.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.667+0000 7fa26f5b0640 1 --2- 172.21.15.33:0/859870807 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa2680b33b0 0x7fa268154e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:15.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.667+0000 7fa26f5b0640 1 -- 172.21.15.33:0/859870807 >> 172.21.15.33:0/859870807 conn(0x7fa26809ce90 msgr2=0x7fa2680d3a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:15.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.667+0000 7fa26f5b0640 1 -- 172.21.15.33:0/859870807 shutdown_connections 2024-05-08T10:55:15.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.667+0000 7fa26f5b0640 1 -- 172.21.15.33:0/859870807 wait complete. 2024-05-08T10:55:15.674 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_flush.TestFlush.test_flush' 2024-05-08T10:55:15.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.782+0000 7f0db379e640 1 Processor -- start 2024-05-08T10:55:15.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.782+0000 7f0db379e640 1 -- start start 2024-05-08T10:55:15.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.783+0000 7f0db379e640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0dac0b4c60 0x7f0dac15e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:15.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.783+0000 7f0db379e640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dac0d4910 con 0x7f0dac0d0540 2024-05-08T10:55:15.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.783+0000 7f0db379e640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dac0d25e0 con 0x7f0dac0d0920 2024-05-08T10:55:15.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.783+0000 7f0db379e640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dac0d46c0 con 0x7f0dac0b4c60 2024-05-08T10:55:15.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.783+0000 7f0db153a640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f0dac0d0540 0x7f0dac15dbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:53084/0 (socket says 172.21.15.33:53084) 2024-05-08T10:55:15.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.783+0000 7f0db153a640 1 -- 172.21.15.33:0/41505730 learned_addr learned my addr 172.21.15.33:0/41505730 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-05-08T10:55:15.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.784+0000 7f0db1d3b640 1 --2- 172.21.15.33:0/41505730 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0dac0b4c60 0x7f0dac15e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:15.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.784+0000 7f0da3fff640 1 -- 172.21.15.33:0/41505730 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 536317381 0 0) 0x7f0dac0d4910 con 0x7f0dac0d0540 2024-05-08T10:55:15.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.784+0000 7f0da3fff640 1 -- 172.21.15.33:0/41505730 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d98003520 con 0x7f0dac0d0540 2024-05-08T10:55:15.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.784+0000 7f0da3fff640 1 -- 172.21.15.33:0/41505730 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 20992477 0 0) 0x7f0d98003520 con 0x7f0dac0d0540 2024-05-08T10:55:15.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.784+0000 7f0da3fff640 1 -- 172.21.15.33:0/41505730 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0dac0b4c60 msgr2=0x7f0dac15e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:15.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.784+0000 7f0da3fff640 1 --2- 172.21.15.33:0/41505730 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0dac0b4c60 0x7f0dac15e2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:15.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.784+0000 7f0da3fff640 1 -- 172.21.15.33:0/41505730 >> v1:172.21.15.174:6789/0 conn(0x7f0dac0d0920 legacy=0x7f0dac0ce7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:15.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.784+0000 7f0da3fff640 1 -- 172.21.15.33:0/41505730 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dac0b4730 con 0x7f0dac0d0540 2024-05-08T10:55:15.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.784+0000 7f0da3fff640 1 -- 172.21.15.33:0/41505730 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2948294915 0 0) 0x7f0da80019f0 con 0x7f0dac0d0540 2024-05-08T10:55:15.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.784+0000 7f0da3fff640 1 -- 172.21.15.33:0/41505730 >> v1:172.21.15.33:6789/0 conn(0x7f0dac0d0540 legacy=0x7f0dac15dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:15.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.784+0000 7f0da3fff640 1 --2- 172.21.15.33:0/41505730 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0dac0b4c60 0x7f0d980039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:15.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.784+0000 7f0da3fff640 1 --2- 172.21.15.33:0/41505730 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d98003f20 0x7f0d98004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:15.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.784+0000 7f0da3fff640 1 --2- 172.21.15.33:0/41505730 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0d98004d40 0x7f0d980051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:15.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.784+0000 7f0da3fff640 1 -- 172.21.15.33:0/41505730 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dac0d46c0 con 0x7f0d98003f20 2024-05-08T10:55:15.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.784+0000 7f0da3fff640 1 -- 172.21.15.33:0/41505730 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d9800bb80 con 0x7f0d98004d40 2024-05-08T10:55:15.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.784+0000 7f0da3fff640 1 -- 172.21.15.33:0/41505730 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d9800bd80 con 0x7f0dac0b4c60 2024-05-08T10:55:15.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.784+0000 7f0db0d39640 1 --2- 172.21.15.33:0/41505730 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d98003f20 0x7f0d98004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:15.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.784+0000 7f0db153a640 1 --2- 172.21.15.33:0/41505730 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0dac0b4c60 0x7f0d980039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:15.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.784+0000 7f0db1d3b640 1 --2- 172.21.15.33:0/41505730 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0d98004d40 0x7f0d980051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:15.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.784+0000 7f0db0d39640 1 -- 172.21.15.33:0/41505730 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0dac0b4c60 msgr2=0x7f0d980039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:15.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.784+0000 7f0db0d39640 1 --2- 172.21.15.33:0/41505730 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0dac0b4c60 0x7f0d980039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:15.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.784+0000 7f0db0d39640 1 -- 172.21.15.33:0/41505730 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0d98004d40 msgr2=0x7f0d980051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:15.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.784+0000 7f0db0d39640 1 --2- 172.21.15.33:0/41505730 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0d98004d40 0x7f0d980051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:15.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.784+0000 7f0db0d39640 1 -- 172.21.15.33:0/41505730 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d98003520 con 0x7f0d98003f20 2024-05-08T10:55:15.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.785+0000 7f0db0d39640 1 --2- 172.21.15.33:0/41505730 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d98003f20 0x7f0d98004800 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0d9c001830 tx=0x7f0d98005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74b8cd2ace6a0f67 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:15.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.785+0000 7f0da3fff640 1 -- 172.21.15.33:0/41505730 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d9c037070 con 0x7f0d98003f20 2024-05-08T10:55:15.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.785+0000 7f0da3fff640 1 -- 172.21.15.33:0/41505730 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d9c02abe0 con 0x7f0d98003f20 2024-05-08T10:55:15.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.785+0000 7f0da3fff640 1 -- 172.21.15.33:0/41505730 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d9c001430 con 0x7f0d98003f20 2024-05-08T10:55:15.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.786+0000 7f0db379e640 1 -- 172.21.15.33:0/41505730 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d98003f20 msgr2=0x7f0d98004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:15.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.786+0000 7f0db379e640 1 --2- 172.21.15.33:0/41505730 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d98003f20 0x7f0d98004800 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0d9c001830 tx=0x7f0d98005830 comp rx=0 tx=0).stop 2024-05-08T10:55:15.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.786+0000 7f0db1d3b640 1 -- 172.21.15.33:0/41505730 reap_dead start 2024-05-08T10:55:15.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.786+0000 7f0db379e640 1 -- 172.21.15.33:0/41505730 shutdown_connections 2024-05-08T10:55:15.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.786+0000 7f0db379e640 1 -- 172.21.15.33:0/41505730 >> 172.21.15.33:0/41505730 conn(0x7f0dac0d3ba0 msgr2=0x7f0dac0d3fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:15.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.786+0000 7f0db379e640 1 -- 172.21.15.33:0/41505730 shutdown_connections 2024-05-08T10:55:15.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.786+0000 7f0db379e640 1 -- 172.21.15.33:0/41505730 wait complete. 2024-05-08T10:55:15.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.787+0000 7f0db379e640 1 Processor -- start 2024-05-08T10:55:15.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.787+0000 7f0db379e640 1 -- start start 2024-05-08T10:55:15.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.788+0000 7f0db379e640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0d98003f20 0x7f0dac15b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:15.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.788+0000 7f0db379e640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0dac0b7ec0 0x7f0dac0b8320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:15.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.788+0000 7f0db379e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0dac0b2b50 0x7f0dac0b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:15.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.788+0000 7f0db379e640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dac0d2390 con 0x7f0dac0b2b50 2024-05-08T10:55:15.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.788+0000 7f0db379e640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dac0b5420 con 0x7f0d98003f20 2024-05-08T10:55:15.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.788+0000 7f0db379e640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dac0d2950 con 0x7f0dac0b7ec0 2024-05-08T10:55:15.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.788+0000 7f0db1d3b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0dac0b2b50 0x7f0dac0b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:15.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.788+0000 7f0db1d3b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0dac0b2b50 0x7f0dac0b2fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58116/0 (socket says 172.21.15.33:58116) 2024-05-08T10:55:15.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.788+0000 7f0db1d3b640 1 -- 172.21.15.33:0/2052904447 learned_addr learned my addr 172.21.15.33:0/2052904447 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:15.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.788+0000 7f0db153a640 1 --2- 172.21.15.33:0/2052904447 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0d98003f20 0x7f0dac15b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:15.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.788+0000 7f0db0d39640 1 --2- 172.21.15.33:0/2052904447 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0dac0b7ec0 0x7f0dac0b8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:15.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.788+0000 7f0db1d3b640 1 -- 172.21.15.33:0/2052904447 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0dac0b7ec0 msgr2=0x7f0dac0b8320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:15.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.788+0000 7f0db1d3b640 1 --2- 172.21.15.33:0/2052904447 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0dac0b7ec0 0x7f0dac0b8320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:15.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.788+0000 7f0db1d3b640 1 -- 172.21.15.33:0/2052904447 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0d98003f20 msgr2=0x7f0dac15b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:15.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.788+0000 7f0db1d3b640 1 --2- 172.21.15.33:0/2052904447 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0d98003f20 0x7f0dac15b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:15.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.788+0000 7f0db1d3b640 1 -- 172.21.15.33:0/2052904447 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dac0caec0 con 0x7f0dac0b2b50 2024-05-08T10:55:15.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.788+0000 7f0db153a640 1 --2- 172.21.15.33:0/2052904447 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0d98003f20 0x7f0dac15b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:55:15.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.789+0000 7f0db1d3b640 1 --2- 172.21.15.33:0/2052904447 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0dac0b2b50 0x7f0dac0b2fd0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0dac161cb0 tx=0x7f0da4011cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:15.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.789+0000 7f0da1ffb640 1 -- 172.21.15.33:0/2052904447 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da4004240 con 0x7f0dac0b2b50 2024-05-08T10:55:15.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.789+0000 7f0da1ffb640 1 -- 172.21.15.33:0/2052904447 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0da401b070 con 0x7f0dac0b2b50 2024-05-08T10:55:15.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.789+0000 7f0db379e640 1 -- 172.21.15.33:0/2052904447 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dac0cb1a0 con 0x7f0dac0b2b50 2024-05-08T10:55:15.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.789+0000 7f0da1ffb640 1 -- 172.21.15.33:0/2052904447 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da400f770 con 0x7f0dac0b2b50 2024-05-08T10:55:15.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.789+0000 7f0db379e640 1 -- 172.21.15.33:0/2052904447 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dac0cb760 con 0x7f0dac0b2b50 2024-05-08T10:55:15.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.790+0000 7f0db379e640 1 -- 172.21.15.33:0/2052904447 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dac0b3510 con 0x7f0dac0b2b50 2024-05-08T10:55:15.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.790+0000 7f0da1ffb640 1 -- 172.21.15.33:0/2052904447 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0da4012040 con 0x7f0dac0b2b50 2024-05-08T10:55:15.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.791+0000 7f0da1ffb640 1 --2- 172.21.15.33:0/2052904447 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f0d9006b4d0 0x7f0d9006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:15.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.791+0000 7f0da1ffb640 1 -- 172.21.15.33:0/2052904447 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0da408a190 con 0x7f0dac0b2b50 2024-05-08T10:55:15.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.791+0000 7f0db153a640 1 --2- 172.21.15.33:0/2052904447 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f0d9006b4d0 0x7f0d9006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:15.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.792+0000 7f0db153a640 1 --2- 172.21.15.33:0/2052904447 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f0d9006b4d0 0x7f0d9006d990 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0da8004c40 tx=0x7f0da8006040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:15.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:15.795+0000 7f0da1ffb640 1 -- 172.21.15.33:0/2052904447 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0da4058f80 con 0x7f0dac0b2b50 2024-05-08T10:55:16.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:16.043+0000 7f0db379e640 1 -- 172.21.15.33:0/2052904447 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_flush.TestFlush.test_flush"]} v 0) v1 -- 0x7f0dac067440 con 0x7f0dac0b2b50 2024-05-08T10:55:16.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:16.616+0000 7f0da1ffb640 1 -- 172.21.15.33:0/2052904447 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_flush.TestFlush.test_flush"]}]=0 v49) v1 ==== 126+0+0 (secure 0 0 0) 0x7f0da4058880 con 0x7f0dac0b2b50 2024-05-08T10:55:16.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:16.619+0000 7f0db379e640 1 -- 172.21.15.33:0/2052904447 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f0d9006b4d0 msgr2=0x7f0d9006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:16.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:16.619+0000 7f0db379e640 1 --2- 172.21.15.33:0/2052904447 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f0d9006b4d0 0x7f0d9006d990 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0da8004c40 tx=0x7f0da8006040 comp rx=0 tx=0).stop 2024-05-08T10:55:16.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:16.619+0000 7f0db379e640 1 -- 172.21.15.33:0/2052904447 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0dac0b2b50 msgr2=0x7f0dac0b2fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:16.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:16.619+0000 7f0db379e640 1 --2- 172.21.15.33:0/2052904447 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0dac0b2b50 0x7f0dac0b2fd0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0dac161cb0 tx=0x7f0da4011cf0 comp rx=0 tx=0).stop 2024-05-08T10:55:16.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:16.619+0000 7f0db379e640 1 -- 172.21.15.33:0/2052904447 shutdown_connections 2024-05-08T10:55:16.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:16.619+0000 7f0db379e640 1 --2- 172.21.15.33:0/2052904447 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f0d9006b4d0 0x7f0d9006d990 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:16.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:16.619+0000 7f0db379e640 1 --2- 172.21.15.33:0/2052904447 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0dac0b2b50 0x7f0dac0b2fd0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:16.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:16.619+0000 7f0db379e640 1 --2- 172.21.15.33:0/2052904447 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0dac0b7ec0 0x7f0dac0b8320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:16.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:16.619+0000 7f0db379e640 1 --2- 172.21.15.33:0/2052904447 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0d98003f20 0x7f0dac15b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:16.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:16.619+0000 7f0db379e640 1 -- 172.21.15.33:0/2052904447 >> 172.21.15.33:0/2052904447 conn(0x7f0dac0d3ba0 msgr2=0x7f0dac0d3f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:16.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:16.619+0000 7f0db379e640 1 -- 172.21.15.33:0/2052904447 shutdown_connections 2024-05-08T10:55:16.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:16.619+0000 7f0db379e640 1 -- 172.21.15.33:0/2052904447 wait complete. 2024-05-08T10:55:16.630 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-05-08T10:55:16.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:16.746+0000 7f950a0bd640 1 Processor -- start 2024-05-08T10:55:16.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:16.747+0000 7f950a0bd640 1 -- start start 2024-05-08T10:55:16.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:16.747+0000 7f950a0bd640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f9504155000 0x7f95040d0870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:16.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:16.747+0000 7f950a0bd640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f950415bb70 0x7f95040d0db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:16.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:16.747+0000 7f950a0bd640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95041553e0 con 0x7f95040b42e0 2024-05-08T10:55:16.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:16.747+0000 7f950a0bd640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95040b4ef0 con 0x7f9504155000 2024-05-08T10:55:16.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:16.747+0000 7f950a0bd640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f950415b090 con 0x7f950415bb70 2024-05-08T10:55:16.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:16.748+0000 7f95037fe640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f9504155000 0x7f95040d0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:16.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:16.748+0000 7f9503fff640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f95040b42e0 0x7f95040af490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:53096/0 (socket says 172.21.15.33:53096) 2024-05-08T10:55:16.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:16.748+0000 7f9503fff640 1 -- 172.21.15.33:0/232335816 learned_addr learned my addr 172.21.15.33:0/232335816 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-05-08T10:55:16.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:16.748+0000 7f9502ffd640 1 --2- 172.21.15.33:0/232335816 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f950415bb70 0x7f95040d0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:16.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:16.748+0000 7f95037fe640 1 -- 172.21.15.33:0/232335816 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f950415bb70 msgr2=0x7f95040d0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:16.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:16.748+0000 7f95037fe640 1 --2- 172.21.15.33:0/232335816 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f950415bb70 0x7f95040d0db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:16.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:16.748+0000 7f95037fe640 1 -- 172.21.15.33:0/232335816 >> v1:172.21.15.33:6789/0 conn(0x7f95040b42e0 legacy=0x7f95040af490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:16.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:16.748+0000 7f95037fe640 1 -- 172.21.15.33:0/232335816 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f950415b370 con 0x7f9504155000 2024-05-08T10:55:16.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:16.748+0000 7f95027fc640 1 -- 172.21.15.33:0/232335816 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 80862917 0 0) 0x7f95041553e0 con 0x7f95040b42e0 2024-05-08T10:55:16.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:16.749+0000 7f95037fe640 1 --2- 172.21.15.33:0/232335816 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9504155000 0x7f95040d0870 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f94f4009d90 tx=0x7f94f402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=602677cf7a8714 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:16.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:16.749+0000 7f95027fc640 1 -- 172.21.15.33:0/232335816 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94f4007740 con 0x7f9504155000 2024-05-08T10:55:16.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:16.749+0000 7f95027fc640 1 -- 172.21.15.33:0/232335816 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94f40078e0 con 0x7f9504155000 2024-05-08T10:55:16.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:16.749+0000 7f95027fc640 1 -- 172.21.15.33:0/232335816 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94f4007cb0 con 0x7f9504155000 2024-05-08T10:55:16.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:16.749+0000 7f950a0bd640 1 -- 172.21.15.33:0/232335816 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9504155000 msgr2=0x7f95040d0870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:16.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:16.749+0000 7f950a0bd640 1 --2- 172.21.15.33:0/232335816 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9504155000 0x7f95040d0870 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f94f4009d90 tx=0x7f94f402a660 comp rx=0 tx=0).stop 2024-05-08T10:55:16.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:16.749+0000 7f950a0bd640 1 -- 172.21.15.33:0/232335816 shutdown_connections 2024-05-08T10:55:16.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:16.749+0000 7f950a0bd640 1 --2- 172.21.15.33:0/232335816 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f950415bb70 0x7f95040d0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:16.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:16.749+0000 7f950a0bd640 1 --2- 172.21.15.33:0/232335816 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9504155000 0x7f95040d0870 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:16.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:16.749+0000 7f950a0bd640 1 -- 172.21.15.33:0/232335816 >> 172.21.15.33:0/232335816 conn(0x7f950406bcb0 msgr2=0x7f950406c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:16.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:16.749+0000 7f950a0bd640 1 -- 172.21.15.33:0/232335816 shutdown_connections 2024-05-08T10:55:16.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:16.750+0000 7f950a0bd640 1 -- 172.21.15.33:0/232335816 wait complete. 2024-05-08T10:55:16.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:16.751+0000 7f950a0bd640 1 Processor -- start 2024-05-08T10:55:16.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:16.751+0000 7f950a0bd640 1 -- start start 2024-05-08T10:55:16.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:16.752+0000 7f950a0bd640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f95040b42e0 0x7f9504159d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:16.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:16.752+0000 7f950a0bd640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9504155000 0x7f9504157f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:16.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:16.752+0000 7f950a0bd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f950415bb70 0x7f950413ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:16.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:16.752+0000 7f950a0bd640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95040b4790 con 0x7f950415bb70 2024-05-08T10:55:16.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:16.752+0000 7f950a0bd640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95040b51d0 con 0x7f9504155000 2024-05-08T10:55:16.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:16.752+0000 7f950a0bd640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95040b4910 con 0x7f95040b42e0 2024-05-08T10:55:16.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:16.752+0000 7f9503fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f950415bb70 0x7f950413ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:16.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:16.752+0000 7f9503fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f950415bb70 0x7f950413ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58134/0 (socket says 172.21.15.33:58134) 2024-05-08T10:55:16.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:16.752+0000 7f9503fff640 1 -- 172.21.15.33:0/608289278 learned_addr learned my addr 172.21.15.33:0/608289278 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:16.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:16.752+0000 7f95037fe640 1 --2- 172.21.15.33:0/608289278 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f95040b42e0 0x7f9504159d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:16.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:16.752+0000 7f9502ffd640 1 --2- 172.21.15.33:0/608289278 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9504155000 0x7f9504157f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:16.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:16.752+0000 7f9503fff640 1 -- 172.21.15.33:0/608289278 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f95040b42e0 msgr2=0x7f9504159d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:16.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:16.752+0000 7f9503fff640 1 --2- 172.21.15.33:0/608289278 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f95040b42e0 0x7f9504159d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:16.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:16.752+0000 7f9503fff640 1 -- 172.21.15.33:0/608289278 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9504155000 msgr2=0x7f9504157f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:16.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:16.752+0000 7f9503fff640 1 --2- 172.21.15.33:0/608289278 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9504155000 0x7f9504157f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:16.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:16.752+0000 7f9503fff640 1 -- 172.21.15.33:0/608289278 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9504155750 con 0x7f950415bb70 2024-05-08T10:55:16.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:16.752+0000 7f9503fff640 1 --2- 172.21.15.33:0/608289278 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f950415bb70 0x7f950413ff60 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f94fc00c450 tx=0x7f94fc00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:16.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:16.752+0000 7f94fbfff640 1 -- 172.21.15.33:0/608289278 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94fc018070 con 0x7f950415bb70 2024-05-08T10:55:16.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:16.752+0000 7f94fbfff640 1 -- 172.21.15.33:0/608289278 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94fc007500 con 0x7f950415bb70 2024-05-08T10:55:16.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:16.752+0000 7f950a0bd640 1 -- 172.21.15.33:0/608289278 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9504155a30 con 0x7f950415bb70 2024-05-08T10:55:16.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:16.753+0000 7f94fbfff640 1 -- 172.21.15.33:0/608289278 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94fc004a20 con 0x7f950415bb70 2024-05-08T10:55:16.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:16.753+0000 7f950a0bd640 1 -- 172.21.15.33:0/608289278 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9504155ff0 con 0x7f950415bb70 2024-05-08T10:55:16.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:16.754+0000 7f950a0bd640 1 -- 172.21.15.33:0/608289278 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f950406b9d0 con 0x7f950415bb70 2024-05-08T10:55:16.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:16.754+0000 7f94fbfff640 1 -- 172.21.15.33:0/608289278 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f94fc01b070 con 0x7f950415bb70 2024-05-08T10:55:16.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:16.755+0000 7f94fbfff640 1 --2- 172.21.15.33:0/608289278 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f94e406b4d0 0x7f94e406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:16.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:16.755+0000 7f94fbfff640 1 -- 172.21.15.33:0/608289278 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f94fc089450 con 0x7f950415bb70 2024-05-08T10:55:16.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:16.755+0000 7f95037fe640 1 --2- 172.21.15.33:0/608289278 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f94e406b4d0 0x7f94e406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:16.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:16.756+0000 7f95037fe640 1 --2- 172.21.15.33:0/608289278 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f94e406b4d0 0x7f94e406d990 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f94f4034000 tx=0x7f94f402f000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:16.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:16.759+0000 7f94fbfff640 1 -- 172.21.15.33:0/608289278 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f950406b9d0 con 0x7f950415bb70 2024-05-08T10:55:16.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:16.940+0000 7f950a0bd640 1 -- 172.21.15.33:0/608289278 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f9504069d20 con 0x7f950415bb70 2024-05-08T10:55:16.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:16.945+0000 7f94fbfff640 1 -- 172.21.15.33:0/608289278 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f94fc057d40 con 0x7f950415bb70 2024-05-08T10:55:16.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:16.947+0000 7f950a0bd640 1 -- 172.21.15.33:0/608289278 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f94e406b4d0 msgr2=0x7f94e406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:16.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:16.947+0000 7f950a0bd640 1 --2- 172.21.15.33:0/608289278 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f94e406b4d0 0x7f94e406d990 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f94f4034000 tx=0x7f94f402f000 comp rx=0 tx=0).stop 2024-05-08T10:55:16.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:16.947+0000 7f950a0bd640 1 -- 172.21.15.33:0/608289278 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f950415bb70 msgr2=0x7f950413ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:16.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:16.947+0000 7f950a0bd640 1 --2- 172.21.15.33:0/608289278 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f950415bb70 0x7f950413ff60 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f94fc00c450 tx=0x7f94fc00c910 comp rx=0 tx=0).stop 2024-05-08T10:55:16.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:16.947+0000 7f950a0bd640 1 -- 172.21.15.33:0/608289278 shutdown_connections 2024-05-08T10:55:16.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:16.947+0000 7f950a0bd640 1 --2- 172.21.15.33:0/608289278 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f94e406b4d0 0x7f94e406d990 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:16.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:16.947+0000 7f950a0bd640 1 --2- 172.21.15.33:0/608289278 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f950415bb70 0x7f950413ff60 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:16.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:16.947+0000 7f950a0bd640 1 --2- 172.21.15.33:0/608289278 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9504155000 0x7f9504157f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:16.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:16.947+0000 7f950a0bd640 1 --2- 172.21.15.33:0/608289278 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f95040b42e0 0x7f9504159d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:16.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:16.947+0000 7f950a0bd640 1 -- 172.21.15.33:0/608289278 >> 172.21.15.33:0/608289278 conn(0x7f950406bcb0 msgr2=0x7f95040cf930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:16.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:16.947+0000 7f950a0bd640 1 -- 172.21.15.33:0/608289278 shutdown_connections 2024-05-08T10:55:16.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:16.947+0000 7f950a0bd640 1 -- 172.21.15.33:0/608289278 wait complete. 2024-05-08T10:55:16.955 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-05-08T10:55:16.956 DEBUG:teuthology.orchestra.run.smithi033:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-08T10:55:16.993 DEBUG:teuthology.orchestra.run.smithi174:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-08T10:55:17.045 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-05-08T10:55:17.045 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-05-08T10:55:17.045 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T10:55:17.061 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-05-08T10:55:17.061 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T10:55:17.117 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-05-08T10:55:17.117 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T10:55:17.173 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-08T10:55:17.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.320+0000 7f7d59142640 1 Processor -- start 2024-05-08T10:55:17.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.320+0000 7f7d59142640 1 -- start start 2024-05-08T10:55:17.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.320+0000 7f7d59142640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f7d5415df00 0x7f7d540d0b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:17.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.320+0000 7f7d59142640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7d540d2070 0x7f7d540b3b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:17.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.320+0000 7f7d59142640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d540d1160 con 0x7f7d540d2570 2024-05-08T10:55:17.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.320+0000 7f7d59142640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d540b3700 con 0x7f7d5415df00 2024-05-08T10:55:17.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.320+0000 7f7d59142640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d540b30b0 con 0x7f7d540d2070 2024-05-08T10:55:17.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.321+0000 7f7d52d9d640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f7d5415df00 0x7f7d540d0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:17.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.321+0000 7f7d52d9d640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f7d5415df00 0x7f7d540d0b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58138/0 (socket says 172.21.15.33:58138) 2024-05-08T10:55:17.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.321+0000 7f7d52d9d640 1 -- 172.21.15.33:0/8793962 learned_addr learned my addr 172.21.15.33:0/8793962 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:17.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.321+0000 7f7d5359e640 1 --2- 172.21.15.33:0/8793962 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7d540d2070 0x7f7d540b3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:17.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.321+0000 7f7d52d9d640 1 -- 172.21.15.33:0/8793962 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7d540d2070 msgr2=0x7f7d540b3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:17.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.321+0000 7f7d52d9d640 1 --2- 172.21.15.33:0/8793962 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7d540d2070 0x7f7d540b3b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:17.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.321+0000 7f7d52d9d640 1 -- 172.21.15.33:0/8793962 >> v1:172.21.15.174:6789/0 conn(0x7f7d540d2570 legacy=0x7f7d540d1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:17.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.321+0000 7f7d52d9d640 1 -- 172.21.15.33:0/8793962 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d540b3390 con 0x7f7d5415df00 2024-05-08T10:55:17.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.322+0000 7f7d52d9d640 1 --2- 172.21.15.33:0/8793962 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7d5415df00 0x7f7d540d0b30 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7d44009870 tx=0x7f7d4402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e159b072094bbb7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:17.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.322+0000 7f7d5259c640 1 -- 172.21.15.33:0/8793962 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d44037070 con 0x7f7d5415df00 2024-05-08T10:55:17.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.322+0000 7f7d5259c640 1 -- 172.21.15.33:0/8793962 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d44032440 con 0x7f7d5415df00 2024-05-08T10:55:17.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.322+0000 7f7d5259c640 1 -- 172.21.15.33:0/8793962 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d44032810 con 0x7f7d5415df00 2024-05-08T10:55:17.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.322+0000 7f7d59142640 1 -- 172.21.15.33:0/8793962 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7d5415df00 msgr2=0x7f7d540d0b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:17.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.322+0000 7f7d59142640 1 --2- 172.21.15.33:0/8793962 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7d5415df00 0x7f7d540d0b30 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7d44009870 tx=0x7f7d4402a270 comp rx=0 tx=0).stop 2024-05-08T10:55:17.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.322+0000 7f7d59142640 1 -- 172.21.15.33:0/8793962 shutdown_connections 2024-05-08T10:55:17.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.322+0000 7f7d59142640 1 --2- 172.21.15.33:0/8793962 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7d540d2070 0x7f7d540b3b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:17.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.322+0000 7f7d59142640 1 --2- 172.21.15.33:0/8793962 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7d5415df00 0x7f7d540d0b30 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:17.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.322+0000 7f7d59142640 1 -- 172.21.15.33:0/8793962 >> 172.21.15.33:0/8793962 conn(0x7f7d540d3b80 msgr2=0x7f7d540d3f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:17.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.323+0000 7f7d59142640 1 -- 172.21.15.33:0/8793962 shutdown_connections 2024-05-08T10:55:17.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.323+0000 7f7d59142640 1 -- 172.21.15.33:0/8793962 wait complete. 2024-05-08T10:55:17.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.324+0000 7f7d59142640 1 Processor -- start 2024-05-08T10:55:17.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.324+0000 7f7d59142640 1 -- start start 2024-05-08T10:55:17.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.325+0000 7f7d59142640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7d540d2070 0x7f7d541f6f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:17.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.325+0000 7f7d59142640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7d540d2570 0x7f7d541f40b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:17.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.325+0000 7f7d59142640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7d5415df00 0x7f7d54157eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:17.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.325+0000 7f7d59142640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d5415e2e0 con 0x7f7d5415df00 2024-05-08T10:55:17.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.325+0000 7f7d59142640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d540d1440 con 0x7f7d540d2570 2024-05-08T10:55:17.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.325+0000 7f7d59142640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d540b40d0 con 0x7f7d540d2070 2024-05-08T10:55:17.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.325+0000 7f7d5359e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7d5415df00 0x7f7d54157eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:17.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.325+0000 7f7d5359e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7d5415df00 0x7f7d54157eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58144/0 (socket says 172.21.15.33:58144) 2024-05-08T10:55:17.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.325+0000 7f7d5359e640 1 -- 172.21.15.33:0/4202086378 learned_addr learned my addr 172.21.15.33:0/4202086378 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:17.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.325+0000 7f7d52d9d640 1 --2- 172.21.15.33:0/4202086378 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7d540d2070 0x7f7d541f6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:17.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.325+0000 7f7d4bfff640 1 --2- 172.21.15.33:0/4202086378 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7d540d2570 0x7f7d541f40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:17.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.325+0000 7f7d5359e640 1 -- 172.21.15.33:0/4202086378 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7d540d2070 msgr2=0x7f7d541f6f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:17.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.325+0000 7f7d5359e640 1 --2- 172.21.15.33:0/4202086378 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7d540d2070 0x7f7d541f6f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:17.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.325+0000 7f7d5359e640 1 -- 172.21.15.33:0/4202086378 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7d540d2570 msgr2=0x7f7d541f40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:17.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.325+0000 7f7d5359e640 1 --2- 172.21.15.33:0/4202086378 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7d540d2570 0x7f7d541f40b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:17.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.325+0000 7f7d5359e640 1 -- 172.21.15.33:0/4202086378 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d540cbe90 con 0x7f7d5415df00 2024-05-08T10:55:17.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.325+0000 7f7d5359e640 1 --2- 172.21.15.33:0/4202086378 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7d5415df00 0x7f7d54157eb0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c007e40 tx=0x7f7d4c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:17.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.325+0000 7f7d4b7fe640 1 -- 172.21.15.33:0/4202086378 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d4c014620 con 0x7f7d5415df00 2024-05-08T10:55:17.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.325+0000 7f7d4b7fe640 1 -- 172.21.15.33:0/4202086378 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d4c019070 con 0x7f7d5415df00 2024-05-08T10:55:17.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.325+0000 7f7d59142640 1 -- 172.21.15.33:0/4202086378 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d54159e80 con 0x7f7d5415df00 2024-05-08T10:55:17.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.326+0000 7f7d4b7fe640 1 -- 172.21.15.33:0/4202086378 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d4c014a20 con 0x7f7d5415df00 2024-05-08T10:55:17.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.326+0000 7f7d59142640 1 -- 172.21.15.33:0/4202086378 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d540cc410 con 0x7f7d5415df00 2024-05-08T10:55:17.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.327+0000 7f7d59142640 1 -- 172.21.15.33:0/4202086378 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d54069d20 con 0x7f7d5415df00 2024-05-08T10:55:17.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.327+0000 7f7d4b7fe640 1 -- 172.21.15.33:0/4202086378 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7d4c014bc0 con 0x7f7d5415df00 2024-05-08T10:55:17.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.327+0000 7f7d4b7fe640 1 --2- 172.21.15.33:0/4202086378 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f7d3406b4d0 0x7f7d3406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:17.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.328+0000 7f7d4b7fe640 1 -- 172.21.15.33:0/4202086378 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7d4c08a970 con 0x7f7d5415df00 2024-05-08T10:55:17.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.328+0000 7f7d52d9d640 1 --2- 172.21.15.33:0/4202086378 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f7d3406b4d0 0x7f7d3406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:17.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.328+0000 7f7d52d9d640 1 --2- 172.21.15.33:0/4202086378 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f7d3406b4d0 0x7f7d3406d990 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7d44034000 tx=0x7f7d4402e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:17.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.332+0000 7f7d4b7fe640 1 -- 172.21.15.33:0/4202086378 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7d4c059210 con 0x7f7d5415df00 2024-05-08T10:55:17.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.525+0000 7f7d59142640 1 -- 172.21.15.33:0/4202086378 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f7d540d0740 con 0x7f7d5415df00 2024-05-08T10:55:17.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.525+0000 7f7d4b7fe640 1 -- 172.21.15.33:0/4202086378 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7f7d4c05d2b0 con 0x7f7d5415df00 2024-05-08T10:55:17.523 INFO:teuthology.orchestra.run.smithi033.stderr:listed 0 entries 2024-05-08T10:55:17.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.527+0000 7f7d59142640 1 -- 172.21.15.33:0/4202086378 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f7d3406b4d0 msgr2=0x7f7d3406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:17.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.527+0000 7f7d59142640 1 --2- 172.21.15.33:0/4202086378 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f7d3406b4d0 0x7f7d3406d990 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7d44034000 tx=0x7f7d4402e000 comp rx=0 tx=0).stop 2024-05-08T10:55:17.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.527+0000 7f7d59142640 1 -- 172.21.15.33:0/4202086378 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7d5415df00 msgr2=0x7f7d54157eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:17.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.527+0000 7f7d59142640 1 --2- 172.21.15.33:0/4202086378 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7d5415df00 0x7f7d54157eb0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c007e40 tx=0x7f7d4c00e4b0 comp rx=0 tx=0).stop 2024-05-08T10:55:17.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.527+0000 7f7d59142640 1 -- 172.21.15.33:0/4202086378 shutdown_connections 2024-05-08T10:55:17.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.527+0000 7f7d59142640 1 --2- 172.21.15.33:0/4202086378 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f7d3406b4d0 0x7f7d3406d990 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:17.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.527+0000 7f7d59142640 1 --2- 172.21.15.33:0/4202086378 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7d5415df00 0x7f7d54157eb0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:17.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.527+0000 7f7d59142640 1 --2- 172.21.15.33:0/4202086378 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7d540d2570 0x7f7d541f40b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:17.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.527+0000 7f7d59142640 1 --2- 172.21.15.33:0/4202086378 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7d540d2070 0x7f7d541f6f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:17.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.527+0000 7f7d59142640 1 -- 172.21.15.33:0/4202086378 >> 172.21.15.33:0/4202086378 conn(0x7f7d540d3b80 msgr2=0x7f7d540cfa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:17.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.527+0000 7f7d59142640 1 -- 172.21.15.33:0/4202086378 shutdown_connections 2024-05-08T10:55:17.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.527+0000 7f7d59142640 1 -- 172.21.15.33:0/4202086378 wait complete. 2024-05-08T10:55:17.535 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-08T10:55:17.535 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:55:17.536 DEBUG:teuthology.orchestra.run.smithi033:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-05-08T10:55:17.563 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi033.front.sepia.ceph.com 2024-05-08T10:55:17.563 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:55:17.563 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-08T10:55:17.627 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-05-08T10:55:17.627 DEBUG:teuthology.orchestra.run.smithi174:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T10:55:17.646 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-05-08T10:55:17.646 DEBUG:teuthology.orchestra.run.smithi174:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T10:55:17.703 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-05-08T10:55:17.703 DEBUG:teuthology.orchestra.run.smithi174:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T10:55:17.761 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-08T10:55:17.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.869+0000 7fe207b5e640 1 Processor -- start 2024-05-08T10:55:17.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.869+0000 7fe207b5e640 1 -- start start 2024-05-08T10:55:17.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.870+0000 7fe207b5e640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe200144630 0x7fe2000b35d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:17.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.870+0000 7fe207b5e640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fe2000d04d0 0x7fe20015cd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:17.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.870+0000 7fe207b5e640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2000b4140 con 0x7fe2000b3b10 2024-05-08T10:55:17.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.870+0000 7fe207b5e640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe20015c330 con 0x7fe2000d04d0 2024-05-08T10:55:17.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.870+0000 7fe207b5e640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2000b4420 con 0x7fe200144630 2024-05-08T10:55:17.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.870+0000 7fe2060fb640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fe2000d04d0 0x7fe20015cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:17.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.870+0000 7fe2050f9640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fe2000b3b10 0x7fe2000cfdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:53098/0 (socket says 172.21.15.33:53098) 2024-05-08T10:55:17.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.870+0000 7fe2050f9640 1 -- 172.21.15.33:0/1888405050 learned_addr learned my addr 172.21.15.33:0/1888405050 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-05-08T10:55:17.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.870+0000 7fe2060fb640 1 -- 172.21.15.33:0/1888405050 >> v2:172.21.15.174:3300/0 conn(0x7fe200144630 msgr2=0x7fe2000b35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:17.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.870+0000 7fe2060fb640 1 --2- 172.21.15.33:0/1888405050 >> v2:172.21.15.174:3300/0 conn(0x7fe200144630 0x7fe2000b35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:17.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.870+0000 7fe2060fb640 1 -- 172.21.15.33:0/1888405050 >> v1:172.21.15.33:6789/0 conn(0x7fe2000b3b10 legacy=0x7fe2000cfdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:17.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.870+0000 7fe2060fb640 1 -- 172.21.15.33:0/1888405050 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe20015c580 con 0x7fe2000d04d0 2024-05-08T10:55:17.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.870+0000 7fe2048f8640 1 -- 172.21.15.33:0/1888405050 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2041913264 0 0) 0x7fe2000b4140 con 0x7fe2000b3b10 2024-05-08T10:55:17.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.871+0000 7fe2060fb640 1 --2- 172.21.15.33:0/1888405050 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe2000d04d0 0x7fe20015cd80 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe1f800bfa0 tx=0x7fe1f802c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c1ac1a950d615fa server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:17.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.871+0000 7fe2048f8640 1 -- 172.21.15.33:0/1888405050 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f8039070 con 0x7fe2000d04d0 2024-05-08T10:55:17.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.871+0000 7fe2048f8640 1 -- 172.21.15.33:0/1888405050 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1f8009540 con 0x7fe2000d04d0 2024-05-08T10:55:17.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.871+0000 7fe2048f8640 1 -- 172.21.15.33:0/1888405050 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f8009910 con 0x7fe2000d04d0 2024-05-08T10:55:17.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.872+0000 7fe207b5e640 1 -- 172.21.15.33:0/1888405050 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe2000d04d0 msgr2=0x7fe20015cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:17.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.872+0000 7fe207b5e640 1 --2- 172.21.15.33:0/1888405050 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe2000d04d0 0x7fe20015cd80 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe1f800bfa0 tx=0x7fe1f802c8b0 comp rx=0 tx=0).stop 2024-05-08T10:55:17.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.872+0000 7fe207b5e640 1 -- 172.21.15.33:0/1888405050 shutdown_connections 2024-05-08T10:55:17.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.872+0000 7fe207b5e640 1 --2- 172.21.15.33:0/1888405050 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe2000d04d0 0x7fe20015cd80 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:17.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.872+0000 7fe207b5e640 1 --2- 172.21.15.33:0/1888405050 >> v2:172.21.15.174:3300/0 conn(0x7fe200144630 0x7fe2000b35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:17.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.872+0000 7fe207b5e640 1 -- 172.21.15.33:0/1888405050 >> 172.21.15.33:0/1888405050 conn(0x7fe20006afc0 msgr2=0x7fe20006b3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:17.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.872+0000 7fe207b5e640 1 -- 172.21.15.33:0/1888405050 shutdown_connections 2024-05-08T10:55:17.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.872+0000 7fe207b5e640 1 -- 172.21.15.33:0/1888405050 wait complete. 2024-05-08T10:55:17.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.873+0000 7fe207b5e640 1 Processor -- start 2024-05-08T10:55:17.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.873+0000 7fe207b5e640 1 -- start start 2024-05-08T10:55:17.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.874+0000 7fe207b5e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe2000b3b10 0x7fe2001405b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:17.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.874+0000 7fe207b5e640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe2000d04d0 0x7fe200152c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:17.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.874+0000 7fe207b5e640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe200144630 0x7fe200153150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:17.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.874+0000 7fe207b5e640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe20015d2c0 con 0x7fe2000b3b10 2024-05-08T10:55:17.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.874+0000 7fe207b5e640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2000b2be0 con 0x7fe2000d04d0 2024-05-08T10:55:17.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.874+0000 7fe207b5e640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe20015d440 con 0x7fe200144630 2024-05-08T10:55:17.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.874+0000 7fe2058fa640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe2000b3b10 0x7fe2001405b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:17.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.874+0000 7fe2058fa640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe2000b3b10 0x7fe2001405b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58160/0 (socket says 172.21.15.33:58160) 2024-05-08T10:55:17.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.874+0000 7fe2058fa640 1 -- 172.21.15.33:0/4092884791 learned_addr learned my addr 172.21.15.33:0/4092884791 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:17.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.874+0000 7fe2050f9640 1 --2- 172.21.15.33:0/4092884791 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe2000d04d0 0x7fe200152c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:17.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.874+0000 7fe2060fb640 1 --2- 172.21.15.33:0/4092884791 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe200144630 0x7fe200153150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:17.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.874+0000 7fe2058fa640 1 -- 172.21.15.33:0/4092884791 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe200144630 msgr2=0x7fe200153150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:17.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.874+0000 7fe2058fa640 1 --2- 172.21.15.33:0/4092884791 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe200144630 0x7fe200153150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:17.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.874+0000 7fe2058fa640 1 -- 172.21.15.33:0/4092884791 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe2000d04d0 msgr2=0x7fe200152c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:17.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.874+0000 7fe2058fa640 1 --2- 172.21.15.33:0/4092884791 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe2000d04d0 0x7fe200152c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:17.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.874+0000 7fe2058fa640 1 -- 172.21.15.33:0/4092884791 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2000ce1f0 con 0x7fe2000b3b10 2024-05-08T10:55:17.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.874+0000 7fe2050f9640 1 --2- 172.21.15.33:0/4092884791 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe2000d04d0 0x7fe200152c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:55:17.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.875+0000 7fe2058fa640 1 --2- 172.21.15.33:0/4092884791 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe2000b3b10 0x7fe2001405b0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc00b410 tx=0x7fe1fc00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:17.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.875+0000 7fe1f67fc640 1 -- 172.21.15.33:0/4092884791 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1fc015020 con 0x7fe2000b3b10 2024-05-08T10:55:17.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.875+0000 7fe1f67fc640 1 -- 172.21.15.33:0/4092884791 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1fc011850 con 0x7fe2000b3b10 2024-05-08T10:55:17.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.875+0000 7fe1f67fc640 1 -- 172.21.15.33:0/4092884791 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1fc011c40 con 0x7fe2000b3b10 2024-05-08T10:55:17.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.875+0000 7fe207b5e640 1 -- 172.21.15.33:0/4092884791 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2000ce4d0 con 0x7fe2000b3b10 2024-05-08T10:55:17.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.875+0000 7fe207b5e640 1 -- 172.21.15.33:0/4092884791 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2000cea90 con 0x7fe2000b3b10 2024-05-08T10:55:17.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.876+0000 7fe207b5e640 1 -- 172.21.15.33:0/4092884791 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe200069d20 con 0x7fe2000b3b10 2024-05-08T10:55:17.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.876+0000 7fe1f67fc640 1 -- 172.21.15.33:0/4092884791 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe1fc018020 con 0x7fe2000b3b10 2024-05-08T10:55:17.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.877+0000 7fe1f67fc640 1 --2- 172.21.15.33:0/4092884791 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fe1e406b4d0 0x7fe1e406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:17.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.877+0000 7fe1f67fc640 1 -- 172.21.15.33:0/4092884791 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe1fc08a1c0 con 0x7fe2000b3b10 2024-05-08T10:55:17.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.877+0000 7fe2050f9640 1 --2- 172.21.15.33:0/4092884791 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fe1e406b4d0 0x7fe1e406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:17.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.877+0000 7fe2050f9640 1 --2- 172.21.15.33:0/4092884791 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fe1e406b4d0 0x7fe1e406d990 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe200158b60 tx=0x7fe1f0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:17.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:17.881+0000 7fe1f67fc640 1 -- 172.21.15.33:0/4092884791 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe1fc01f020 con 0x7fe2000b3b10 2024-05-08T10:55:18.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:18.076+0000 7fe207b5e640 1 -- 172.21.15.33:0/4092884791 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fe20006e3b0 con 0x7fe2000b3b10 2024-05-08T10:55:18.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:18.077+0000 7fe1f67fc640 1 -- 172.21.15.33:0/4092884791 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7fe1fc0172c0 con 0x7fe2000b3b10 2024-05-08T10:55:18.074 INFO:teuthology.orchestra.run.smithi033.stderr:listed 0 entries 2024-05-08T10:55:18.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:18.078+0000 7fe207b5e640 1 -- 172.21.15.33:0/4092884791 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fe1e406b4d0 msgr2=0x7fe1e406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:18.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:18.078+0000 7fe207b5e640 1 --2- 172.21.15.33:0/4092884791 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fe1e406b4d0 0x7fe1e406d990 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe200158b60 tx=0x7fe1f0009040 comp rx=0 tx=0).stop 2024-05-08T10:55:18.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:18.078+0000 7fe207b5e640 1 -- 172.21.15.33:0/4092884791 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe2000b3b10 msgr2=0x7fe2001405b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:18.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:18.078+0000 7fe207b5e640 1 --2- 172.21.15.33:0/4092884791 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe2000b3b10 0x7fe2001405b0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc00b410 tx=0x7fe1fc00b8d0 comp rx=0 tx=0).stop 2024-05-08T10:55:18.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:18.079+0000 7fe207b5e640 1 -- 172.21.15.33:0/4092884791 shutdown_connections 2024-05-08T10:55:18.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:18.079+0000 7fe207b5e640 1 --2- 172.21.15.33:0/4092884791 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fe1e406b4d0 0x7fe1e406d990 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:18.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:18.079+0000 7fe207b5e640 1 --2- 172.21.15.33:0/4092884791 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe200144630 0x7fe200153150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:18.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:18.079+0000 7fe207b5e640 1 --2- 172.21.15.33:0/4092884791 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe2000d04d0 0x7fe200152c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:18.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:18.079+0000 7fe207b5e640 1 --2- 172.21.15.33:0/4092884791 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe2000b3b10 0x7fe2001405b0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:18.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:18.079+0000 7fe207b5e640 1 -- 172.21.15.33:0/4092884791 >> 172.21.15.33:0/4092884791 conn(0x7fe20006afc0 msgr2=0x7fe2000aeae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:18.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:18.079+0000 7fe207b5e640 1 -- 172.21.15.33:0/4092884791 shutdown_connections 2024-05-08T10:55:18.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:18.079+0000 7fe207b5e640 1 -- 172.21.15.33:0/4092884791 wait complete. 2024-05-08T10:55:18.086 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-05-08T10:55:18.087 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:55:18.087 DEBUG:teuthology.orchestra.run.smithi174:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-05-08T10:55:18.119 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi174.front.sepia.ceph.com 2024-05-08T10:55:18.119 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:55:18.119 DEBUG:teuthology.orchestra.run.smithi174:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-05-08T10:55:18.179 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-05-08T10:55:18.180 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T10:55:18.196 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-05-08T10:55:18.196 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T10:55:18.252 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-05-08T10:55:18.252 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T10:55:18.309 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-08T10:55:18.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:18.457+0000 7f851351b640 1 Processor -- start 2024-05-08T10:55:18.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:18.457+0000 7f851351b640 1 -- start start 2024-05-08T10:55:18.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:18.458+0000 7f851351b640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f850c15e2c0 0x7f850c0b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:18.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:18.458+0000 7f851351b640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f850c0b40a0 0x7f850c162380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:18.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:18.458+0000 7f851351b640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f850c06c3f0 con 0x7f850c15dee0 2024-05-08T10:55:18.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:18.458+0000 7f851351b640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f850c06bec0 con 0x7f850c0b40a0 2024-05-08T10:55:18.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:18.458+0000 7f851351b640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f850c1629f0 con 0x7f850c15e2c0 2024-05-08T10:55:18.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:18.458+0000 7f8511ab8640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f850c0b40a0 0x7f850c162380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:18.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:18.458+0000 7f8510ab6640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f850c15e2c0 0x7f850c0b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:18.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:18.458+0000 7f8510ab6640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f850c15e2c0 0x7f850c0b2c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.33:42404/0 (socket says 172.21.15.33:42404) 2024-05-08T10:55:18.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:18.458+0000 7f8511ab8640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f850c0b40a0 0x7f850c162380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.33:50416/0 (socket says 172.21.15.33:50416) 2024-05-08T10:55:18.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:18.458+0000 7f8510ab6640 1 -- 172.21.15.33:0/131080712 learned_addr learned my addr 172.21.15.33:0/131080712 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:18.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:18.458+0000 7f85112b7640 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f850c15dee0 0x7f850c161c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.33:49152/0 (socket says 172.21.15.33:49152) 2024-05-08T10:55:18.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:18.459+0000 7f8510ab6640 1 -- 172.21.15.33:0/131080712 >> v2:172.21.15.174:3300/0 conn(0x7f850c0b40a0 msgr2=0x7f850c162380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:18.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:18.459+0000 7f8510ab6640 1 --2- 172.21.15.33:0/131080712 >> v2:172.21.15.174:3300/0 conn(0x7f850c0b40a0 0x7f850c162380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:18.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:18.459+0000 7f8510ab6640 1 -- 172.21.15.33:0/131080712 >> v1:172.21.15.174:6789/0 conn(0x7f850c15dee0 legacy=0x7f850c161c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:18.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:18.459+0000 7f8510ab6640 1 -- 172.21.15.33:0/131080712 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f850c06c110 con 0x7f850c15e2c0 2024-05-08T10:55:18.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:18.459+0000 7f8503fff640 1 -- 172.21.15.33:0/131080712 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 349376201 0 0) 0x7f850c06c3f0 con 0x7f850c15dee0 2024-05-08T10:55:18.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:18.459+0000 7f8511ab8640 1 --2- 172.21.15.33:0/131080712 >> v2:172.21.15.174:3300/0 conn(0x7f850c0b40a0 0x7f850c162380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T10:55:18.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:18.459+0000 7f8510ab6640 1 --2- 172.21.15.33:0/131080712 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f850c15e2c0 0x7f850c0b2c50 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f84fc009870 tx=0x7f84fc02a130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b15aab3e29d8fd08 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:18.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:18.460+0000 7f8503fff640 1 -- 172.21.15.33:0/131080712 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84fc037070 con 0x7f850c15e2c0 2024-05-08T10:55:18.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:18.460+0000 7f8503fff640 1 -- 172.21.15.33:0/131080712 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84fc032440 con 0x7f850c15e2c0 2024-05-08T10:55:18.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:18.460+0000 7f8503fff640 1 -- 172.21.15.33:0/131080712 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84fc032810 con 0x7f850c15e2c0 2024-05-08T10:55:18.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:18.460+0000 7f851351b640 1 -- 172.21.15.33:0/131080712 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f850c15e2c0 msgr2=0x7f850c0b2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:18.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:18.460+0000 7f851351b640 1 --2- 172.21.15.33:0/131080712 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f850c15e2c0 0x7f850c0b2c50 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f84fc009870 tx=0x7f84fc02a130 comp rx=0 tx=0).stop 2024-05-08T10:55:18.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:18.460+0000 7f851351b640 1 -- 172.21.15.33:0/131080712 shutdown_connections 2024-05-08T10:55:18.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:18.460+0000 7f851351b640 1 --2- 172.21.15.33:0/131080712 >> v2:172.21.15.174:3300/0 conn(0x7f850c0b40a0 0x7f850c162380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:18.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:18.460+0000 7f851351b640 1 --2- 172.21.15.33:0/131080712 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f850c15e2c0 0x7f850c0b2c50 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:18.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:18.460+0000 7f851351b640 1 -- 172.21.15.33:0/131080712 >> 172.21.15.33:0/131080712 conn(0x7f850c0b3580 msgr2=0x7f850c0b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:18.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:18.460+0000 7f851351b640 1 -- 172.21.15.33:0/131080712 shutdown_connections 2024-05-08T10:55:18.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:18.460+0000 7f851351b640 1 -- 172.21.15.33:0/131080712 wait complete. 2024-05-08T10:55:18.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:18.461+0000 7f851351b640 1 Processor -- start 2024-05-08T10:55:18.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:18.461+0000 7f851351b640 1 -- start start 2024-05-08T10:55:18.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:18.462+0000 7f851351b640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f850c0b40a0 0x7f850c156af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:18.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:18.462+0000 7f851351b640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f850c15dee0 0x7f850c0c79d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:18.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:18.462+0000 7f851351b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f850c15e2c0 0x7f850c145730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:18.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:18.462+0000 7f851351b640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f850c0b4fc0 con 0x7f850c15e2c0 2024-05-08T10:55:18.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:18.462+0000 7f851351b640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f850c0b4e40 con 0x7f850c0b40a0 2024-05-08T10:55:18.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:18.462+0000 7f851351b640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f850c0b5140 con 0x7f850c15dee0 2024-05-08T10:55:18.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:18.462+0000 7f8511ab8640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f850c15e2c0 0x7f850c145730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:18.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:18.462+0000 7f8511ab8640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f850c15e2c0 0x7f850c145730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58164/0 (socket says 172.21.15.33:58164) 2024-05-08T10:55:18.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:18.462+0000 7f8511ab8640 1 -- 172.21.15.33:0/98440324 learned_addr learned my addr 172.21.15.33:0/98440324 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:18.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:18.462+0000 7f85112b7640 1 --2- 172.21.15.33:0/98440324 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f850c0b40a0 0x7f850c156af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:18.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:18.462+0000 7f8510ab6640 1 --2- 172.21.15.33:0/98440324 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f850c15dee0 0x7f850c0c79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:18.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:18.463+0000 7f8511ab8640 1 -- 172.21.15.33:0/98440324 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f850c15dee0 msgr2=0x7f850c0c79d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:18.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:18.463+0000 7f8511ab8640 1 --2- 172.21.15.33:0/98440324 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f850c15dee0 0x7f850c0c79d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:18.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:18.463+0000 7f8511ab8640 1 -- 172.21.15.33:0/98440324 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f850c0b40a0 msgr2=0x7f850c156af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:18.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:18.463+0000 7f8511ab8640 1 --2- 172.21.15.33:0/98440324 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f850c0b40a0 0x7f850c156af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:18.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:18.463+0000 7f8511ab8640 1 -- 172.21.15.33:0/98440324 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f850c157030 con 0x7f850c15e2c0 2024-05-08T10:55:18.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:18.463+0000 7f8511ab8640 1 --2- 172.21.15.33:0/98440324 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f850c15e2c0 0x7f850c145730 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f850400e930 tx=0x7f850400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:18.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:18.463+0000 7f8501ffb640 1 -- 172.21.15.33:0/98440324 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8504017070 con 0x7f850c15e2c0 2024-05-08T10:55:18.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:18.463+0000 7f8501ffb640 1 -- 172.21.15.33:0/98440324 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f850400ca00 con 0x7f850c15e2c0 2024-05-08T10:55:18.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:18.463+0000 7f851351b640 1 -- 172.21.15.33:0/98440324 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f850c0c7f10 con 0x7f850c15e2c0 2024-05-08T10:55:18.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:18.463+0000 7f8501ffb640 1 -- 172.21.15.33:0/98440324 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f850400cdd0 con 0x7f850c15e2c0 2024-05-08T10:55:18.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:18.463+0000 7f851351b640 1 -- 172.21.15.33:0/98440324 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f850c0c6ef0 con 0x7f850c15e2c0 2024-05-08T10:55:18.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:18.464+0000 7f851351b640 1 -- 172.21.15.33:0/98440324 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f850c069d20 con 0x7f850c15e2c0 2024-05-08T10:55:18.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:18.465+0000 7f8501ffb640 1 -- 172.21.15.33:0/98440324 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8504013470 con 0x7f850c15e2c0 2024-05-08T10:55:18.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:18.465+0000 7f8501ffb640 1 --2- 172.21.15.33:0/98440324 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f84f006b4d0 0x7f84f006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:18.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:18.465+0000 7f8501ffb640 1 -- 172.21.15.33:0/98440324 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8504089ca0 con 0x7f850c15e2c0 2024-05-08T10:55:18.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:18.465+0000 7f85112b7640 1 --2- 172.21.15.33:0/98440324 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f84f006b4d0 0x7f84f006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:18.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:18.466+0000 7f85112b7640 1 --2- 172.21.15.33:0/98440324 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f84f006b4d0 0x7f84f006d990 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f85080012e0 tx=0x7f8508001700 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:18.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:18.469+0000 7f8501ffb640 1 -- 172.21.15.33:0/98440324 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f850c157030 con 0x7f850c15e2c0 2024-05-08T10:55:18.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:18.662+0000 7f851351b640 1 -- 172.21.15.33:0/98440324 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f850c0d25e0 con 0x7f850c15e2c0 2024-05-08T10:55:18.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:18.663+0000 7f8501ffb640 1 -- 172.21.15.33:0/98440324 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7f8504058590 con 0x7f850c15e2c0 2024-05-08T10:55:18.660 INFO:teuthology.orchestra.run.smithi033.stderr:listed 0 entries 2024-05-08T10:55:18.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:18.665+0000 7f851351b640 1 -- 172.21.15.33:0/98440324 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f84f006b4d0 msgr2=0x7f84f006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:18.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:18.665+0000 7f851351b640 1 --2- 172.21.15.33:0/98440324 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f84f006b4d0 0x7f84f006d990 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f85080012e0 tx=0x7f8508001700 comp rx=0 tx=0).stop 2024-05-08T10:55:18.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:18.665+0000 7f851351b640 1 -- 172.21.15.33:0/98440324 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f850c15e2c0 msgr2=0x7f850c145730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:18.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:18.665+0000 7f851351b640 1 --2- 172.21.15.33:0/98440324 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f850c15e2c0 0x7f850c145730 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f850400e930 tx=0x7f850400edf0 comp rx=0 tx=0).stop 2024-05-08T10:55:18.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:18.665+0000 7f851351b640 1 -- 172.21.15.33:0/98440324 shutdown_connections 2024-05-08T10:55:18.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:18.665+0000 7f851351b640 1 --2- 172.21.15.33:0/98440324 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f84f006b4d0 0x7f84f006d990 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:18.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:18.665+0000 7f851351b640 1 --2- 172.21.15.33:0/98440324 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f850c15e2c0 0x7f850c145730 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:18.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:18.665+0000 7f851351b640 1 --2- 172.21.15.33:0/98440324 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f850c15dee0 0x7f850c0c79d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:18.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:18.665+0000 7f851351b640 1 --2- 172.21.15.33:0/98440324 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f850c0b40a0 0x7f850c156af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:18.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:18.665+0000 7f851351b640 1 -- 172.21.15.33:0/98440324 >> 172.21.15.33:0/98440324 conn(0x7f850c0b3580 msgr2=0x7f850c0ceee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:18.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:18.665+0000 7f851351b640 1 -- 172.21.15.33:0/98440324 shutdown_connections 2024-05-08T10:55:18.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:18.665+0000 7f851351b640 1 -- 172.21.15.33:0/98440324 wait complete. 2024-05-08T10:55:18.673 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-05-08T10:55:18.673 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:55:18.673 DEBUG:teuthology.orchestra.run.smithi033:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-05-08T10:55:18.700 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi033.front.sepia.ceph.com 2024-05-08T10:55:18.700 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:55:18.700 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-05-08T10:55:18.757 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-05-08T10:55:18.757 DEBUG:teuthology.orchestra.run.smithi174:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T10:55:18.777 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-05-08T10:55:18.777 DEBUG:teuthology.orchestra.run.smithi174:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T10:55:18.836 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-05-08T10:55:18.836 DEBUG:teuthology.orchestra.run.smithi174:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T10:55:18.895 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-08T10:55:19.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.005+0000 7fe72e8df640 1 Processor -- start 2024-05-08T10:55:19.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.005+0000 7fe72e8df640 1 -- start start 2024-05-08T10:55:19.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.006+0000 7fe72e8df640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe728163090 0x7fe72815f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:19.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.006+0000 7fe72e8df640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe72806ad40 con 0x7fe7280b2750 2024-05-08T10:55:19.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.006+0000 7fe72e8df640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe72806afe0 con 0x7fe72815e510 2024-05-08T10:55:19.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.006+0000 7fe72e8df640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7280b2c70 con 0x7fe728163090 2024-05-08T10:55:19.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.006+0000 7fe7277fe640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fe7280b2750 0x7fe728162980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:53102/0 (socket says 172.21.15.33:53102) 2024-05-08T10:55:19.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.006+0000 7fe7277fe640 1 -- 172.21.15.33:0/3907179890 learned_addr learned my addr 172.21.15.33:0/3907179890 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-05-08T10:55:19.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.006+0000 7fe72ce7c640 1 --2- 172.21.15.33:0/3907179890 >> v2:172.21.15.174:3300/0 conn(0x7fe728163090 0x7fe72815f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:19.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.006+0000 7fe726ffd640 1 -- 172.21.15.33:0/3907179890 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2002182193 0 0) 0x7fe72806ad40 con 0x7fe7280b2750 2024-05-08T10:55:19.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.006+0000 7fe726ffd640 1 -- 172.21.15.33:0/3907179890 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe710003520 con 0x7fe7280b2750 2024-05-08T10:55:19.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.007+0000 7fe726ffd640 1 -- 172.21.15.33:0/3907179890 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2073063019 0 0) 0x7fe710003520 con 0x7fe7280b2750 2024-05-08T10:55:19.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.007+0000 7fe726ffd640 1 -- 172.21.15.33:0/3907179890 >> v2:172.21.15.174:3300/0 conn(0x7fe728163090 msgr2=0x7fe72815f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:19.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.007+0000 7fe726ffd640 1 --2- 172.21.15.33:0/3907179890 >> v2:172.21.15.174:3300/0 conn(0x7fe728163090 0x7fe72815f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:19.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.007+0000 7fe726ffd640 1 -- 172.21.15.33:0/3907179890 >> v1:172.21.15.174:6789/0 conn(0x7fe72815e510 legacy=0x7fe7280b2040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:19.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.007+0000 7fe726ffd640 1 -- 172.21.15.33:0/3907179890 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe72806b2c0 con 0x7fe7280b2750 2024-05-08T10:55:19.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.007+0000 7fe726ffd640 1 -- 172.21.15.33:0/3907179890 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2948294915 0 0) 0x7fe71c001670 con 0x7fe7280b2750 2024-05-08T10:55:19.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.007+0000 7fe726ffd640 1 -- 172.21.15.33:0/3907179890 >> v1:172.21.15.33:6789/0 conn(0x7fe7280b2750 legacy=0x7fe728162980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:19.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.007+0000 7fe726ffd640 1 --2- 172.21.15.33:0/3907179890 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe7100039b0 0x7fe710003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:19.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.007+0000 7fe726ffd640 1 --2- 172.21.15.33:0/3907179890 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe710004800 0x7fe710004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:19.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.007+0000 7fe726ffd640 1 --2- 172.21.15.33:0/3907179890 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe7100051c0 0x7fe71000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:19.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.007+0000 7fe726ffd640 1 -- 172.21.15.33:0/3907179890 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7280b2c70 con 0x7fe710004800 2024-05-08T10:55:19.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.007+0000 7fe726ffd640 1 -- 172.21.15.33:0/3907179890 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe71000c060 con 0x7fe7100039b0 2024-05-08T10:55:19.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.007+0000 7fe726ffd640 1 -- 172.21.15.33:0/3907179890 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe71000c260 con 0x7fe7100051c0 2024-05-08T10:55:19.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.007+0000 7fe7277fe640 1 --2- 172.21.15.33:0/3907179890 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe710004800 0x7fe710004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:19.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.007+0000 7fe727fff640 1 --2- 172.21.15.33:0/3907179890 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe7100039b0 0x7fe710003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:19.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.007+0000 7fe72ce7c640 1 --2- 172.21.15.33:0/3907179890 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe7100051c0 0x7fe71000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:19.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.007+0000 7fe7277fe640 1 -- 172.21.15.33:0/3907179890 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe7100051c0 msgr2=0x7fe71000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:19.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.007+0000 7fe7277fe640 1 --2- 172.21.15.33:0/3907179890 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe7100051c0 0x7fe71000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:19.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.007+0000 7fe7277fe640 1 -- 172.21.15.33:0/3907179890 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe7100039b0 msgr2=0x7fe710003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:19.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.007+0000 7fe7277fe640 1 --2- 172.21.15.33:0/3907179890 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe7100039b0 0x7fe710003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:19.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.007+0000 7fe7277fe640 1 -- 172.21.15.33:0/3907179890 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe710003520 con 0x7fe710004800 2024-05-08T10:55:19.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.007+0000 7fe72ce7c640 1 --2- 172.21.15.33:0/3907179890 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe7100051c0 0x7fe71000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:55:19.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.007+0000 7fe72ce7c640 1 -- 172.21.15.33:0/3907179890 reap_dead start 2024-05-08T10:55:19.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.008+0000 7fe7277fe640 1 --2- 172.21.15.33:0/3907179890 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe710004800 0x7fe710004c80 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe71c00c210 tx=0x7fe710005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26e0a46f31150043 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:19.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.008+0000 7fe726ffd640 1 -- 172.21.15.33:0/3907179890 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe71c007d30 con 0x7fe710004800 2024-05-08T10:55:19.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.008+0000 7fe726ffd640 1 -- 172.21.15.33:0/3907179890 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe71c005ad0 con 0x7fe710004800 2024-05-08T10:55:19.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.008+0000 7fe726ffd640 1 -- 172.21.15.33:0/3907179890 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe71c007070 con 0x7fe710004800 2024-05-08T10:55:19.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.009+0000 7fe72e8df640 1 -- 172.21.15.33:0/3907179890 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe710004800 msgr2=0x7fe710004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:19.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.009+0000 7fe72e8df640 1 --2- 172.21.15.33:0/3907179890 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe710004800 0x7fe710004c80 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe71c00c210 tx=0x7fe710005830 comp rx=0 tx=0).stop 2024-05-08T10:55:19.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.009+0000 7fe72e8df640 1 -- 172.21.15.33:0/3907179890 shutdown_connections 2024-05-08T10:55:19.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.009+0000 7fe72e8df640 1 --2- 172.21.15.33:0/3907179890 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe710004800 0x7fe710004c80 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:19.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.009+0000 7fe72e8df640 1 -- 172.21.15.33:0/3907179890 >> 172.21.15.33:0/3907179890 conn(0x7fe7280711d0 msgr2=0x7fe7280b4eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:19.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.009+0000 7fe72e8df640 1 -- 172.21.15.33:0/3907179890 shutdown_connections 2024-05-08T10:55:19.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.009+0000 7fe72e8df640 1 -- 172.21.15.33:0/3907179890 wait complete. 2024-05-08T10:55:19.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.010+0000 7fe72e8df640 1 Processor -- start 2024-05-08T10:55:19.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.010+0000 7fe72e8df640 1 -- start start 2024-05-08T10:55:19.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.011+0000 7fe72e8df640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe710004800 0x7fe72815a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:19.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.011+0000 7fe72e8df640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe7281f4950 0x7fe7281f3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:19.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.011+0000 7fe72e8df640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe72809c4c0 0x7fe72809c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:19.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.011+0000 7fe72e8df640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe72815f870 con 0x7fe72809c4c0 2024-05-08T10:55:19.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.011+0000 7fe72e8df640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe72815f9f0 con 0x7fe7281f4950 2024-05-08T10:55:19.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.011+0000 7fe72e8df640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe72815fb70 con 0x7fe710004800 2024-05-08T10:55:19.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.011+0000 7fe72ce7c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe72809c4c0 0x7fe72809c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:19.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.011+0000 7fe72ce7c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe72809c4c0 0x7fe72809c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58184/0 (socket says 172.21.15.33:58184) 2024-05-08T10:55:19.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.011+0000 7fe72ce7c640 1 -- 172.21.15.33:0/3511099681 learned_addr learned my addr 172.21.15.33:0/3511099681 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:19.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.011+0000 7fe727fff640 1 --2- 172.21.15.33:0/3511099681 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe710004800 0x7fe72815a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:19.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.011+0000 7fe7277fe640 1 --2- 172.21.15.33:0/3511099681 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe7281f4950 0x7fe7281f3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:19.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.011+0000 7fe72ce7c640 1 -- 172.21.15.33:0/3511099681 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe710004800 msgr2=0x7fe72815a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:19.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.011+0000 7fe72ce7c640 1 --2- 172.21.15.33:0/3511099681 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe710004800 0x7fe72815a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:19.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.011+0000 7fe72ce7c640 1 -- 172.21.15.33:0/3511099681 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe7281f4950 msgr2=0x7fe7281f3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:19.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.011+0000 7fe72ce7c640 1 --2- 172.21.15.33:0/3511099681 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe7281f4950 0x7fe7281f3810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:19.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.011+0000 7fe72ce7c640 1 -- 172.21.15.33:0/3511099681 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7281f3d50 con 0x7fe72809c4c0 2024-05-08T10:55:19.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.011+0000 7fe7277fe640 1 --2- 172.21.15.33:0/3511099681 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe7281f4950 0x7fe7281f3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:55:19.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.011+0000 7fe72ce7c640 1 --2- 172.21.15.33:0/3511099681 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe72809c4c0 0x7fe72809c940 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe720007d80 tx=0x7fe7200115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:19.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.012+0000 7fe724ff9640 1 -- 172.21.15.33:0/3511099681 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe720011de0 con 0x7fe72809c4c0 2024-05-08T10:55:19.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.012+0000 7fe724ff9640 1 -- 172.21.15.33:0/3511099681 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe72001c070 con 0x7fe72809c4c0 2024-05-08T10:55:19.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.012+0000 7fe72e8df640 1 -- 172.21.15.33:0/3511099681 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7281f4dd0 con 0x7fe72809c4c0 2024-05-08T10:55:19.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.012+0000 7fe724ff9640 1 -- 172.21.15.33:0/3511099681 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7200166b0 con 0x7fe72809c4c0 2024-05-08T10:55:19.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.012+0000 7fe72e8df640 1 -- 172.21.15.33:0/3511099681 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe72809b160 con 0x7fe72809c4c0 2024-05-08T10:55:19.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.013+0000 7fe72e8df640 1 -- 172.21.15.33:0/3511099681 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe728069d20 con 0x7fe72809c4c0 2024-05-08T10:55:19.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.013+0000 7fe724ff9640 1 -- 172.21.15.33:0/3511099681 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe720005d10 con 0x7fe72809c4c0 2024-05-08T10:55:19.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.014+0000 7fe724ff9640 1 --2- 172.21.15.33:0/3511099681 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fe71406b500 0x7fe71406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:19.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.014+0000 7fe724ff9640 1 -- 172.21.15.33:0/3511099681 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe72008a7c0 con 0x7fe72809c4c0 2024-05-08T10:55:19.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.014+0000 7fe727fff640 1 --2- 172.21.15.33:0/3511099681 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fe71406b500 0x7fe71406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:19.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.014+0000 7fe727fff640 1 --2- 172.21.15.33:0/3511099681 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fe71406b500 0x7fe71406d9c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe718000c00 tx=0x7fe718009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:19.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.018+0000 7fe724ff9640 1 -- 172.21.15.33:0/3511099681 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe720059640 con 0x7fe72809c4c0 2024-05-08T10:55:19.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.216+0000 7fe72e8df640 1 -- 172.21.15.33:0/3511099681 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fe7281610f0 con 0x7fe72809c4c0 2024-05-08T10:55:19.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.216+0000 7fe724ff9640 1 -- 172.21.15.33:0/3511099681 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7fe720058f40 con 0x7fe72809c4c0 2024-05-08T10:55:19.214 INFO:teuthology.orchestra.run.smithi033.stderr:listed 0 entries 2024-05-08T10:55:19.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.218+0000 7fe72e8df640 1 -- 172.21.15.33:0/3511099681 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fe71406b500 msgr2=0x7fe71406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:19.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.218+0000 7fe72e8df640 1 --2- 172.21.15.33:0/3511099681 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fe71406b500 0x7fe71406d9c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe718000c00 tx=0x7fe718009040 comp rx=0 tx=0).stop 2024-05-08T10:55:19.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.218+0000 7fe72e8df640 1 -- 172.21.15.33:0/3511099681 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe72809c4c0 msgr2=0x7fe72809c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:19.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.218+0000 7fe72e8df640 1 --2- 172.21.15.33:0/3511099681 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe72809c4c0 0x7fe72809c940 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe720007d80 tx=0x7fe7200115a0 comp rx=0 tx=0).stop 2024-05-08T10:55:19.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.218+0000 7fe72e8df640 1 -- 172.21.15.33:0/3511099681 shutdown_connections 2024-05-08T10:55:19.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.218+0000 7fe72e8df640 1 --2- 172.21.15.33:0/3511099681 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fe71406b500 0x7fe71406d9c0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:19.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.218+0000 7fe72e8df640 1 --2- 172.21.15.33:0/3511099681 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe72809c4c0 0x7fe72809c940 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:19.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.218+0000 7fe72e8df640 1 --2- 172.21.15.33:0/3511099681 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe7281f4950 0x7fe7281f3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:19.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.218+0000 7fe72e8df640 1 --2- 172.21.15.33:0/3511099681 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe710004800 0x7fe72815a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:19.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.218+0000 7fe72e8df640 1 -- 172.21.15.33:0/3511099681 >> 172.21.15.33:0/3511099681 conn(0x7fe7280711d0 msgr2=0x7fe72809db80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:19.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.218+0000 7fe72e8df640 1 -- 172.21.15.33:0/3511099681 shutdown_connections 2024-05-08T10:55:19.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.218+0000 7fe72e8df640 1 -- 172.21.15.33:0/3511099681 wait complete. 2024-05-08T10:55:19.226 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-05-08T10:55:19.227 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:55:19.227 DEBUG:teuthology.orchestra.run.smithi174:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-05-08T10:55:19.259 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi174.front.sepia.ceph.com 2024-05-08T10:55:19.259 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:55:19.259 DEBUG:teuthology.orchestra.run.smithi174:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-05-08T10:55:19.319 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-05-08T10:55:19.319 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T10:55:19.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.427+0000 7fc512a07640 1 Processor -- start 2024-05-08T10:55:19.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.427+0000 7fc512a07640 1 -- start start 2024-05-08T10:55:19.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.428+0000 7fc512a07640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc50c06b2b0 0x7fc50c0d13a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:19.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.428+0000 7fc512a07640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc50c071730 con 0x7fc50c15dfb0 2024-05-08T10:55:19.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.428+0000 7fc512a07640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc50c071a10 con 0x7fc50c071f80 2024-05-08T10:55:19.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.428+0000 7fc512a07640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc50c071cf0 con 0x7fc50c06b2b0 2024-05-08T10:55:19.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.428+0000 7fc50bfff640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fc50c15dfb0 0x7fc50c06aba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:53118/0 (socket says 172.21.15.33:53118) 2024-05-08T10:55:19.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.428+0000 7fc50bfff640 1 -- 172.21.15.33:0/1310325336 learned_addr learned my addr 172.21.15.33:0/1310325336 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-05-08T10:55:19.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.428+0000 7fc503fff640 1 --2- 172.21.15.33:0/1310325336 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc50c06b2b0 0x7fc50c0d13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:19.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.429+0000 7fc50b7fe640 1 -- 172.21.15.33:0/1310325336 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1848323919 0 0) 0x7fc50c071730 con 0x7fc50c15dfb0 2024-05-08T10:55:19.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.429+0000 7fc50b7fe640 1 -- 172.21.15.33:0/1310325336 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4f8003520 con 0x7fc50c15dfb0 2024-05-08T10:55:19.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.429+0000 7fc503fff640 1 -- 172.21.15.33:0/1310325336 >> v1:172.21.15.174:6789/0 conn(0x7fc50c071f80 legacy=0x7fc50c06dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:19.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.429+0000 7fc503fff640 1 -- 172.21.15.33:0/1310325336 >> v1:172.21.15.33:6789/0 conn(0x7fc50c15dfb0 legacy=0x7fc50c06aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:19.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.429+0000 7fc50b7fe640 1 -- 172.21.15.33:0/1310325336 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1616273224 0 0) 0x7fc50c071a10 con 0x7fc50c071f80 2024-05-08T10:55:19.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.429+0000 7fc503fff640 1 -- 172.21.15.33:0/1310325336 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc50c0ce850 con 0x7fc50c06b2b0 2024-05-08T10:55:19.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.430+0000 7fc503fff640 1 --2- 172.21.15.33:0/1310325336 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc50c06b2b0 0x7fc50c0d13a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc4f40097d0 tx=0x7fc4f402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c6517669032e7f7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:19.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.430+0000 7fc50b7fe640 1 -- 172.21.15.33:0/1310325336 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f4037070 con 0x7fc50c06b2b0 2024-05-08T10:55:19.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.430+0000 7fc50b7fe640 1 -- 172.21.15.33:0/1310325336 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4f4032440 con 0x7fc50c06b2b0 2024-05-08T10:55:19.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.430+0000 7fc50b7fe640 1 -- 172.21.15.33:0/1310325336 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f40327f0 con 0x7fc50c06b2b0 2024-05-08T10:55:19.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.430+0000 7fc512a07640 1 -- 172.21.15.33:0/1310325336 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc50c06b2b0 msgr2=0x7fc50c0d13a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:19.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.430+0000 7fc512a07640 1 --2- 172.21.15.33:0/1310325336 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc50c06b2b0 0x7fc50c0d13a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc4f40097d0 tx=0x7fc4f402a180 comp rx=0 tx=0).stop 2024-05-08T10:55:19.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.430+0000 7fc512a07640 1 -- 172.21.15.33:0/1310325336 shutdown_connections 2024-05-08T10:55:19.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.430+0000 7fc512a07640 1 --2- 172.21.15.33:0/1310325336 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc50c06b2b0 0x7fc50c0d13a0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:19.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.430+0000 7fc512a07640 1 -- 172.21.15.33:0/1310325336 >> 172.21.15.33:0/1310325336 conn(0x7fc50c0d08b0 msgr2=0x7fc50c0d0c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:19.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.430+0000 7fc512a07640 1 -- 172.21.15.33:0/1310325336 shutdown_connections 2024-05-08T10:55:19.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.430+0000 7fc512a07640 1 -- 172.21.15.33:0/1310325336 wait complete. 2024-05-08T10:55:19.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.432+0000 7fc512a07640 1 Processor -- start 2024-05-08T10:55:19.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.432+0000 7fc512a07640 1 -- start start 2024-05-08T10:55:19.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.432+0000 7fc512a07640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc50c06b2b0 0x7fc50c1f4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:19.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.432+0000 7fc512a07640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc50c071f80 0x7fc50c156750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:19.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.432+0000 7fc512a07640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc50c15dfb0 0x7fc50c0b4a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:19.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.432+0000 7fc512a07640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc50c0cf050 con 0x7fc50c15dfb0 2024-05-08T10:55:19.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.432+0000 7fc512a07640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc50c072700 con 0x7fc50c071f80 2024-05-08T10:55:19.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.432+0000 7fc512a07640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc50c0cf1d0 con 0x7fc50c06b2b0 2024-05-08T10:55:19.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.433+0000 7fc510fa4640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc50c15dfb0 0x7fc50c0b4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:19.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.433+0000 7fc510fa4640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc50c15dfb0 0x7fc50c0b4a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58188/0 (socket says 172.21.15.33:58188) 2024-05-08T10:55:19.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.433+0000 7fc510fa4640 1 -- 172.21.15.33:0/2383965978 learned_addr learned my addr 172.21.15.33:0/2383965978 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:19.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.433+0000 7fc503fff640 1 --2- 172.21.15.33:0/2383965978 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc50c071f80 0x7fc50c156750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:19.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.433+0000 7fc50bfff640 1 --2- 172.21.15.33:0/2383965978 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc50c06b2b0 0x7fc50c1f4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:19.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.433+0000 7fc510fa4640 1 -- 172.21.15.33:0/2383965978 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc50c06b2b0 msgr2=0x7fc50c1f4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:19.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.433+0000 7fc510fa4640 1 --2- 172.21.15.33:0/2383965978 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc50c06b2b0 0x7fc50c1f4710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:19.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.433+0000 7fc510fa4640 1 -- 172.21.15.33:0/2383965978 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc50c071f80 msgr2=0x7fc50c156750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:19.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.433+0000 7fc510fa4640 1 --2- 172.21.15.33:0/2383965978 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc50c071f80 0x7fc50c156750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:19.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.433+0000 7fc510fa4640 1 -- 172.21.15.33:0/2383965978 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc50c0b54b0 con 0x7fc50c15dfb0 2024-05-08T10:55:19.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.433+0000 7fc510fa4640 1 --2- 172.21.15.33:0/2383965978 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc50c15dfb0 0x7fc50c0b4a10 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc50400c760 tx=0x7fc50400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:19.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.433+0000 7fc5097fa640 1 -- 172.21.15.33:0/2383965978 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc504003da0 con 0x7fc50c15dfb0 2024-05-08T10:55:19.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.433+0000 7fc5097fa640 1 -- 172.21.15.33:0/2383965978 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc504005070 con 0x7fc50c15dfb0 2024-05-08T10:55:19.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.433+0000 7fc512a07640 1 -- 172.21.15.33:0/2383965978 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc50c1f3c30 con 0x7fc50c15dfb0 2024-05-08T10:55:19.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.433+0000 7fc5097fa640 1 -- 172.21.15.33:0/2383965978 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc504005460 con 0x7fc50c15dfb0 2024-05-08T10:55:19.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.433+0000 7fc512a07640 1 -- 172.21.15.33:0/2383965978 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc50c1f41f0 con 0x7fc50c15dfb0 2024-05-08T10:55:19.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.434+0000 7fc512a07640 1 -- 172.21.15.33:0/2383965978 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc50c069d20 con 0x7fc50c15dfb0 2024-05-08T10:55:19.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.435+0000 7fc5097fa640 1 -- 172.21.15.33:0/2383965978 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc504005600 con 0x7fc50c15dfb0 2024-05-08T10:55:19.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.435+0000 7fc5097fa640 1 --2- 172.21.15.33:0/2383965978 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fc4ec06b500 0x7fc4ec06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:19.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.435+0000 7fc5097fa640 1 -- 172.21.15.33:0/2383965978 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc504089fc0 con 0x7fc50c15dfb0 2024-05-08T10:55:19.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.436+0000 7fc50bfff640 1 --2- 172.21.15.33:0/2383965978 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fc4ec06b500 0x7fc4ec06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:19.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.436+0000 7fc50bfff640 1 --2- 172.21.15.33:0/2383965978 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fc4ec06b500 0x7fc4ec06d9c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc4fc005880 tx=0x7fc4fc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:19.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.439+0000 7fc5097fa640 1 -- 172.21.15.33:0/2383965978 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc5040587e0 con 0x7fc50c15dfb0 2024-05-08T10:55:19.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.657+0000 7fc512a07640 1 -- 172.21.15.33:0/2383965978 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc50c158ae0 con 0x7fc50c15dfb0 2024-05-08T10:55:19.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.657+0000 7fc5097fa640 1 -- 172.21.15.33:0/2383965978 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4935 (secure 0 0 0) 0x7fc50405c880 con 0x7fc50c15dfb0 2024-05-08T10:55:19.655 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:55:19.655 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4262,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6837/974626320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6835","nonce":974626320},{"type":"v1","addr":"172.21.15.174:6837","nonce":974626320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6834/3541391922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":3541391922},{"type":"v1","addr":"172.21.15.33:6834","nonce":3541391922}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/1492311153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6833","nonce":1492311153},{"type":"v1","addr":"172.21.15.33:6835","nonce":1492311153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T10:54:49.885783+0000","modified":"2024-05-08T10:54:52.897089+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.174:6836/2139245090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2139245090},{"type":"v1","addr":"172.21.15.174:6836","nonce":2139245090}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T10:55:19.657 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 7 2024-05-08T10:55:19.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.659+0000 7fc512a07640 1 -- 172.21.15.33:0/2383965978 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fc4ec06b500 msgr2=0x7fc4ec06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:19.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.659+0000 7fc512a07640 1 --2- 172.21.15.33:0/2383965978 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fc4ec06b500 0x7fc4ec06d9c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc4fc005880 tx=0x7fc4fc009040 comp rx=0 tx=0).stop 2024-05-08T10:55:19.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.659+0000 7fc512a07640 1 -- 172.21.15.33:0/2383965978 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc50c15dfb0 msgr2=0x7fc50c0b4a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:19.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.659+0000 7fc512a07640 1 --2- 172.21.15.33:0/2383965978 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc50c15dfb0 0x7fc50c0b4a10 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc50400c760 tx=0x7fc50400cc20 comp rx=0 tx=0).stop 2024-05-08T10:55:19.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.659+0000 7fc512a07640 1 -- 172.21.15.33:0/2383965978 shutdown_connections 2024-05-08T10:55:19.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.659+0000 7fc512a07640 1 --2- 172.21.15.33:0/2383965978 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fc4ec06b500 0x7fc4ec06d9c0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:19.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.659+0000 7fc512a07640 1 --2- 172.21.15.33:0/2383965978 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc50c15dfb0 0x7fc50c0b4a10 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:19.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.659+0000 7fc512a07640 1 --2- 172.21.15.33:0/2383965978 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc50c071f80 0x7fc50c156750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:19.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.659+0000 7fc512a07640 1 --2- 172.21.15.33:0/2383965978 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc50c06b2b0 0x7fc50c1f4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:19.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.659+0000 7fc512a07640 1 -- 172.21.15.33:0/2383965978 >> 172.21.15.33:0/2383965978 conn(0x7fc50c0d08b0 msgr2=0x7fc50c06aba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:19.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.659+0000 7fc512a07640 1 -- 172.21.15.33:0/2383965978 shutdown_connections 2024-05-08T10:55:19.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.659+0000 7fc512a07640 1 -- 172.21.15.33:0/2383965978 wait complete. 2024-05-08T10:55:19.668 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T10:55:19.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.777+0000 7fa10c0b6640 1 Processor -- start 2024-05-08T10:55:19.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.778+0000 7fa10c0b6640 1 -- start start 2024-05-08T10:55:19.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.778+0000 7fa10c0b6640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa1040d03c0 0x7fa1040d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:19.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.779+0000 7fa10c0b6640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fa1040d07a0 0x7fa1040b6990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:19.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.779+0000 7fa10c0b6640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1040ce650 con 0x7fa1040b6ed0 2024-05-08T10:55:19.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.779+0000 7fa10c0b6640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1040d1e60 con 0x7fa1040d07a0 2024-05-08T10:55:19.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.779+0000 7fa10c0b6640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1040d4250 con 0x7fa1040d03c0 2024-05-08T10:55:19.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.779+0000 7fa109651640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fa1040d07a0 0x7fa1040b6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:19.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.779+0000 7fa109651640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fa1040d07a0 0x7fa1040b6990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58198/0 (socket says 172.21.15.33:58198) 2024-05-08T10:55:19.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.779+0000 7fa109651640 1 -- 172.21.15.33:0/2458334297 learned_addr learned my addr 172.21.15.33:0/2458334297 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:19.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.779+0000 7fa109e52640 1 --2- 172.21.15.33:0/2458334297 >> v2:172.21.15.174:3300/0 conn(0x7fa1040d03c0 0x7fa1040d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:19.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.779+0000 7fa109651640 1 -- 172.21.15.33:0/2458334297 >> v2:172.21.15.174:3300/0 conn(0x7fa1040d03c0 msgr2=0x7fa1040d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:19.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.779+0000 7fa109651640 1 --2- 172.21.15.33:0/2458334297 >> v2:172.21.15.174:3300/0 conn(0x7fa1040d03c0 0x7fa1040d1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:19.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.779+0000 7fa109651640 1 -- 172.21.15.33:0/2458334297 >> v1:172.21.15.174:6789/0 conn(0x7fa1040b6ed0 legacy=0x7fa1040cf0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:19.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.779+0000 7fa109651640 1 -- 172.21.15.33:0/2458334297 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1040d4530 con 0x7fa1040d07a0 2024-05-08T10:55:19.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.780+0000 7fa109651640 1 --2- 172.21.15.33:0/2458334297 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1040d07a0 0x7fa1040b6990 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa10408e160 tx=0x7fa0f802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19fc608ca85c6c11 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:19.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.780+0000 7fa108e50640 1 -- 172.21.15.33:0/2458334297 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f8037070 con 0x7fa1040d07a0 2024-05-08T10:55:19.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.780+0000 7fa108e50640 1 -- 172.21.15.33:0/2458334297 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0f8032440 con 0x7fa1040d07a0 2024-05-08T10:55:19.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.780+0000 7fa108e50640 1 -- 172.21.15.33:0/2458334297 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f8032810 con 0x7fa1040d07a0 2024-05-08T10:55:19.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.780+0000 7fa10c0b6640 1 -- 172.21.15.33:0/2458334297 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1040d07a0 msgr2=0x7fa1040b6990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:19.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.780+0000 7fa10c0b6640 1 --2- 172.21.15.33:0/2458334297 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1040d07a0 0x7fa1040b6990 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa10408e160 tx=0x7fa0f802a210 comp rx=0 tx=0).stop 2024-05-08T10:55:19.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.781+0000 7fa10c0b6640 1 -- 172.21.15.33:0/2458334297 shutdown_connections 2024-05-08T10:55:19.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.781+0000 7fa10c0b6640 1 --2- 172.21.15.33:0/2458334297 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1040d07a0 0x7fa1040b6990 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:19.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.781+0000 7fa10c0b6640 1 --2- 172.21.15.33:0/2458334297 >> v2:172.21.15.174:3300/0 conn(0x7fa1040d03c0 0x7fa1040d1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:19.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.781+0000 7fa10c0b6640 1 -- 172.21.15.33:0/2458334297 >> 172.21.15.33:0/2458334297 conn(0x7fa10409ce90 msgr2=0x7fa1040d3b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:19.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.781+0000 7fa10c0b6640 1 -- 172.21.15.33:0/2458334297 shutdown_connections 2024-05-08T10:55:19.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.781+0000 7fa10c0b6640 1 -- 172.21.15.33:0/2458334297 wait complete. 2024-05-08T10:55:19.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.782+0000 7fa10c0b6640 1 Processor -- start 2024-05-08T10:55:19.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.782+0000 7fa10c0b6640 1 -- start start 2024-05-08T10:55:19.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.782+0000 7fa10c0b6640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1040d03c0 0x7fa10414cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:19.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.782+0000 7fa10c0b6640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa1040d07a0 0x7fa1040cbc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:19.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.783+0000 7fa10c0b6640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa1040cc1a0 0x7fa104158440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:19.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.783+0000 7fa10c0b6640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1040cebd0 con 0x7fa1040d03c0 2024-05-08T10:55:19.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.783+0000 7fa10c0b6640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1040ce8f0 con 0x7fa1040cc1a0 2024-05-08T10:55:19.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.783+0000 7fa10c0b6640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1040b4db0 con 0x7fa1040d07a0 2024-05-08T10:55:19.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.783+0000 7fa109e52640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1040d03c0 0x7fa10414cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:19.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.783+0000 7fa109e52640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1040d03c0 0x7fa10414cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58212/0 (socket says 172.21.15.33:58212) 2024-05-08T10:55:19.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.783+0000 7fa109e52640 1 -- 172.21.15.33:0/2129728867 learned_addr learned my addr 172.21.15.33:0/2129728867 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:19.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.783+0000 7fa109651640 1 --2- 172.21.15.33:0/2129728867 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa1040d07a0 0x7fa1040cbc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:19.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.783+0000 7fa10a653640 1 --2- 172.21.15.33:0/2129728867 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa1040cc1a0 0x7fa104158440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:19.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.783+0000 7fa109e52640 1 -- 172.21.15.33:0/2129728867 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa1040d07a0 msgr2=0x7fa1040cbc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:19.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.783+0000 7fa109e52640 1 --2- 172.21.15.33:0/2129728867 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa1040d07a0 0x7fa1040cbc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:19.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.783+0000 7fa109e52640 1 -- 172.21.15.33:0/2129728867 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa1040cc1a0 msgr2=0x7fa104158440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:19.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.783+0000 7fa109e52640 1 --2- 172.21.15.33:0/2129728867 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa1040cc1a0 0x7fa104158440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:19.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.783+0000 7fa109e52640 1 -- 172.21.15.33:0/2129728867 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1040cd750 con 0x7fa1040d03c0 2024-05-08T10:55:19.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.783+0000 7fa109e52640 1 --2- 172.21.15.33:0/2129728867 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1040d03c0 0x7fa10414cec0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc00c7f0 tx=0x7fa0fc00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:19.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.783+0000 7fa1027fc640 1 -- 172.21.15.33:0/2129728867 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0fc015070 con 0x7fa1040d03c0 2024-05-08T10:55:19.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.783+0000 7fa1027fc640 1 -- 172.21.15.33:0/2129728867 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0fc004240 con 0x7fa1040d03c0 2024-05-08T10:55:19.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.783+0000 7fa10c0b6640 1 -- 172.21.15.33:0/2129728867 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1040cc6b0 con 0x7fa1040d03c0 2024-05-08T10:55:19.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.783+0000 7fa1027fc640 1 -- 172.21.15.33:0/2129728867 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0fc007620 con 0x7fa1040d03c0 2024-05-08T10:55:19.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.783+0000 7fa10c0b6640 1 -- 172.21.15.33:0/2129728867 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1040ccc70 con 0x7fa1040d03c0 2024-05-08T10:55:19.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.784+0000 7fa10c0b6640 1 -- 172.21.15.33:0/2129728867 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa104069d20 con 0x7fa1040d03c0 2024-05-08T10:55:19.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.785+0000 7fa1027fc640 1 -- 172.21.15.33:0/2129728867 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa0fc0079d0 con 0x7fa1040d03c0 2024-05-08T10:55:19.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.785+0000 7fa1027fc640 1 --2- 172.21.15.33:0/2129728867 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fa0f006b4d0 0x7fa0f006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:19.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.785+0000 7fa1027fc640 1 -- 172.21.15.33:0/2129728867 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa0fc08a300 con 0x7fa1040d03c0 2024-05-08T10:55:19.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.786+0000 7fa109651640 1 --2- 172.21.15.33:0/2129728867 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fa0f006b4d0 0x7fa0f006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:19.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.786+0000 7fa109651640 1 --2- 172.21.15.33:0/2129728867 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fa0f006b4d0 0x7fa0f006d990 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa0f8034000 tx=0x7fa0f802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:19.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:19.789+0000 7fa1027fc640 1 -- 172.21.15.33:0/2129728867 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa0fc0590e0 con 0x7fa1040d03c0 2024-05-08T10:55:20.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.007+0000 7fa10c0b6640 1 -- 172.21.15.33:0/2129728867 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa1040d10f0 con 0x7fa1040d03c0 2024-05-08T10:55:20.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.008+0000 7fa1027fc640 1 -- 172.21.15.33:0/2129728867 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4935 (secure 0 0 0) 0x7fa0fc0589e0 con 0x7fa1040d03c0 2024-05-08T10:55:20.005 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:55:20.005 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4262,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6837/974626320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6835","nonce":974626320},{"type":"v1","addr":"172.21.15.174:6837","nonce":974626320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6834/3541391922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":3541391922},{"type":"v1","addr":"172.21.15.33:6834","nonce":3541391922}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/1492311153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6833","nonce":1492311153},{"type":"v1","addr":"172.21.15.33:6835","nonce":1492311153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T10:54:49.885783+0000","modified":"2024-05-08T10:54:52.897089+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.174:6836/2139245090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2139245090},{"type":"v1","addr":"172.21.15.174:6836","nonce":2139245090}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T10:55:20.006 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 7 2024-05-08T10:55:20.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.010+0000 7fa10c0b6640 1 -- 172.21.15.33:0/2129728867 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fa0f006b4d0 msgr2=0x7fa0f006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:20.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.010+0000 7fa10c0b6640 1 --2- 172.21.15.33:0/2129728867 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fa0f006b4d0 0x7fa0f006d990 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa0f8034000 tx=0x7fa0f802e000 comp rx=0 tx=0).stop 2024-05-08T10:55:20.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.010+0000 7fa10c0b6640 1 -- 172.21.15.33:0/2129728867 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1040d03c0 msgr2=0x7fa10414cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:20.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.010+0000 7fa10c0b6640 1 --2- 172.21.15.33:0/2129728867 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1040d03c0 0x7fa10414cec0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc00c7f0 tx=0x7fa0fc00ccb0 comp rx=0 tx=0).stop 2024-05-08T10:55:20.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.010+0000 7fa10c0b6640 1 -- 172.21.15.33:0/2129728867 shutdown_connections 2024-05-08T10:55:20.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.010+0000 7fa10c0b6640 1 --2- 172.21.15.33:0/2129728867 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fa0f006b4d0 0x7fa0f006d990 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:20.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.010+0000 7fa10c0b6640 1 --2- 172.21.15.33:0/2129728867 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa1040cc1a0 0x7fa104158440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:20.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.010+0000 7fa10c0b6640 1 --2- 172.21.15.33:0/2129728867 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa1040d07a0 0x7fa1040cbc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:20.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.010+0000 7fa10c0b6640 1 --2- 172.21.15.33:0/2129728867 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1040d03c0 0x7fa10414cec0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:20.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.010+0000 7fa10c0b6640 1 -- 172.21.15.33:0/2129728867 >> 172.21.15.33:0/2129728867 conn(0x7fa10409ce90 msgr2=0x7fa10415c6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:20.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.010+0000 7fa10c0b6640 1 -- 172.21.15.33:0/2129728867 shutdown_connections 2024-05-08T10:55:20.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.010+0000 7fa10c0b6640 1 -- 172.21.15.33:0/2129728867 wait complete. 2024-05-08T10:55:20.018 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T10:55:20.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.124+0000 7f476b760640 1 Processor -- start 2024-05-08T10:55:20.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.124+0000 7f476b760640 1 -- start start 2024-05-08T10:55:20.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.125+0000 7f476b760640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f47640cdc70 0x7f47640b43e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:20.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.125+0000 7f476b760640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f47640b4920 0x7f47640b2d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:20.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.125+0000 7f476b760640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47640cfbd0 con 0x7f47641455b0 2024-05-08T10:55:20.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.125+0000 7f476b760640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47640b4d90 con 0x7f47640b4920 2024-05-08T10:55:20.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.125+0000 7f476b760640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4764145990 con 0x7f47640cdc70 2024-05-08T10:55:20.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.125+0000 7f47694fc640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f47641455b0 0x7f476415cb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:53132/0 (socket says 172.21.15.33:53132) 2024-05-08T10:55:20.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.125+0000 7f47694fc640 1 -- 172.21.15.33:0/4067445652 learned_addr learned my addr 172.21.15.33:0/4067445652 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-05-08T10:55:20.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.126+0000 7f4768cfb640 1 --2- 172.21.15.33:0/4067445652 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f47640cdc70 0x7f47640b43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:20.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.126+0000 7f4763fff640 1 -- 172.21.15.33:0/4067445652 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1968658290 0 0) 0x7f47640cfbd0 con 0x7f47641455b0 2024-05-08T10:55:20.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.126+0000 7f4769cfd640 1 --2- 172.21.15.33:0/4067445652 >> v2:172.21.15.174:3300/0 conn(0x7f47640b4920 0x7f47640b2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:20.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.126+0000 7f4763fff640 1 -- 172.21.15.33:0/4067445652 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f474c003520 con 0x7f47641455b0 2024-05-08T10:55:20.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.126+0000 7f4763fff640 1 -- 172.21.15.33:0/4067445652 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2421087460 0 0) 0x7f474c003520 con 0x7f47641455b0 2024-05-08T10:55:20.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.126+0000 7f4763fff640 1 -- 172.21.15.33:0/4067445652 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f47640cdc70 msgr2=0x7f47640b43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:20.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.126+0000 7f4763fff640 1 --2- 172.21.15.33:0/4067445652 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f47640cdc70 0x7f47640b43e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:20.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.126+0000 7f4763fff640 1 -- 172.21.15.33:0/4067445652 >> v2:172.21.15.174:3300/0 conn(0x7f47640b4920 msgr2=0x7f47640b2d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:20.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.126+0000 7f4763fff640 1 --2- 172.21.15.33:0/4067445652 >> v2:172.21.15.174:3300/0 conn(0x7f47640b4920 0x7f47640b2d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:20.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.126+0000 7f4763fff640 1 -- 172.21.15.33:0/4067445652 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f476406cb10 con 0x7f47641455b0 2024-05-08T10:55:20.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.126+0000 7f4763fff640 1 -- 172.21.15.33:0/4067445652 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2948294915 0 0) 0x7f475c001670 con 0x7f47641455b0 2024-05-08T10:55:20.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.126+0000 7f4763fff640 1 -- 172.21.15.33:0/4067445652 >> v1:172.21.15.33:6789/0 conn(0x7f47641455b0 legacy=0x7f476415cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:20.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.126+0000 7f4763fff640 1 --2- 172.21.15.33:0/4067445652 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f47640cdc70 0x7f474c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:20.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.126+0000 7f4763fff640 1 --2- 172.21.15.33:0/4067445652 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f474c003f30 0x7f474c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:20.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.126+0000 7f4763fff640 1 --2- 172.21.15.33:0/4067445652 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f474c004d40 0x7f474c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:20.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.126+0000 7f4763fff640 1 -- 172.21.15.33:0/4067445652 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47640b4d90 con 0x7f474c004d40 2024-05-08T10:55:20.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.126+0000 7f4763fff640 1 -- 172.21.15.33:0/4067445652 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4764145990 con 0x7f474c003f30 2024-05-08T10:55:20.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.126+0000 7f4763fff640 1 -- 172.21.15.33:0/4067445652 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f474c00ba10 con 0x7f47640cdc70 2024-05-08T10:55:20.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.126+0000 7f4769cfd640 1 --2- 172.21.15.33:0/4067445652 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f474c004d40 0x7f474c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:20.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.126+0000 7f47694fc640 1 --2- 172.21.15.33:0/4067445652 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f47640cdc70 0x7f474c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:20.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.126+0000 7f4768cfb640 1 --2- 172.21.15.33:0/4067445652 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f474c003f30 0x7f474c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:20.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.126+0000 7f4769cfd640 1 -- 172.21.15.33:0/4067445652 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f47640cdc70 msgr2=0x7f474c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:20.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.126+0000 7f4769cfd640 1 --2- 172.21.15.33:0/4067445652 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f47640cdc70 0x7f474c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:20.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.126+0000 7f4769cfd640 1 -- 172.21.15.33:0/4067445652 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f474c003f30 msgr2=0x7f474c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:20.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.126+0000 7f4769cfd640 1 --2- 172.21.15.33:0/4067445652 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f474c003f30 0x7f474c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:20.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.126+0000 7f4769cfd640 1 -- 172.21.15.33:0/4067445652 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f474c003520 con 0x7f474c004d40 2024-05-08T10:55:20.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.127+0000 7f4769cfd640 1 --2- 172.21.15.33:0/4067445652 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f474c004d40 0x7f474c0051c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f475400e170 tx=0x7f474c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=921eec901002c1f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:20.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.127+0000 7f4763fff640 1 -- 172.21.15.33:0/4067445652 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4754034020 con 0x7f474c004d40 2024-05-08T10:55:20.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.127+0000 7f4763fff640 1 -- 172.21.15.33:0/4067445652 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4754030430 con 0x7f474c004d40 2024-05-08T10:55:20.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.127+0000 7f4763fff640 1 -- 172.21.15.33:0/4067445652 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4754009c10 con 0x7f474c004d40 2024-05-08T10:55:20.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.128+0000 7f476b760640 1 -- 172.21.15.33:0/4067445652 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f474c004d40 msgr2=0x7f474c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:20.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.128+0000 7f476b760640 1 --2- 172.21.15.33:0/4067445652 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f474c004d40 0x7f474c0051c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f475400e170 tx=0x7f474c005830 comp rx=0 tx=0).stop 2024-05-08T10:55:20.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.128+0000 7f4769cfd640 1 -- 172.21.15.33:0/4067445652 reap_dead start 2024-05-08T10:55:20.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.128+0000 7f476b760640 1 -- 172.21.15.33:0/4067445652 shutdown_connections 2024-05-08T10:55:20.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.128+0000 7f476b760640 1 -- 172.21.15.33:0/4067445652 >> 172.21.15.33:0/4067445652 conn(0x7f476406aba0 msgr2=0x7f476406afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:20.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.128+0000 7f476b760640 1 -- 172.21.15.33:0/4067445652 shutdown_connections 2024-05-08T10:55:20.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.128+0000 7f476b760640 1 -- 172.21.15.33:0/4067445652 wait complete. 2024-05-08T10:55:20.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.129+0000 7f476b760640 1 Processor -- start 2024-05-08T10:55:20.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.129+0000 7f476b760640 1 -- start start 2024-05-08T10:55:20.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.130+0000 7f476b760640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f474c004d40 0x7f476413e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:20.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.130+0000 7f476b760640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4764139600 0x7f4764140130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:20.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.130+0000 7f476b760640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4764140670 0x7f4764152230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:20.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.130+0000 7f476b760640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f476406d3b0 con 0x7f4764140670 2024-05-08T10:55:20.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.130+0000 7f476b760640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f476406d0d0 con 0x7f474c004d40 2024-05-08T10:55:20.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.130+0000 7f476b760640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f476406c6c0 con 0x7f4764139600 2024-05-08T10:55:20.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.130+0000 7f4769cfd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4764140670 0x7f4764152230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:20.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.130+0000 7f4769cfd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4764140670 0x7f4764152230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58230/0 (socket says 172.21.15.33:58230) 2024-05-08T10:55:20.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.130+0000 7f4769cfd640 1 -- 172.21.15.33:0/2268101714 learned_addr learned my addr 172.21.15.33:0/2268101714 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:20.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.130+0000 7f4768cfb640 1 --2- 172.21.15.33:0/2268101714 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4764139600 0x7f4764140130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:20.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.130+0000 7f47694fc640 1 --2- 172.21.15.33:0/2268101714 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f474c004d40 0x7f476413e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:20.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.130+0000 7f4769cfd640 1 -- 172.21.15.33:0/2268101714 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4764139600 msgr2=0x7f4764140130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:20.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.130+0000 7f4769cfd640 1 --2- 172.21.15.33:0/2268101714 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4764139600 0x7f4764140130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:20.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.130+0000 7f4769cfd640 1 -- 172.21.15.33:0/2268101714 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f474c004d40 msgr2=0x7f476413e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:20.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.130+0000 7f4769cfd640 1 --2- 172.21.15.33:0/2268101714 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f474c004d40 0x7f476413e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:20.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.130+0000 7f4769cfd640 1 -- 172.21.15.33:0/2268101714 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f476413b480 con 0x7f4764140670 2024-05-08T10:55:20.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.131+0000 7f4769cfd640 1 --2- 172.21.15.33:0/2268101714 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4764140670 0x7f4764152230 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f475400e170 tx=0x7f4754009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:20.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.131+0000 7f4761ffb640 1 -- 172.21.15.33:0/2268101714 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4754034050 con 0x7f4764140670 2024-05-08T10:55:20.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.131+0000 7f4761ffb640 1 -- 172.21.15.33:0/2268101714 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4754003b90 con 0x7f4764140670 2024-05-08T10:55:20.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.131+0000 7f4761ffb640 1 -- 172.21.15.33:0/2268101714 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4754009c10 con 0x7f4764140670 2024-05-08T10:55:20.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.131+0000 7f476b760640 1 -- 172.21.15.33:0/2268101714 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f476413b760 con 0x7f4764140670 2024-05-08T10:55:20.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.131+0000 7f476b760640 1 -- 172.21.15.33:0/2268101714 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f476413bd20 con 0x7f4764140670 2024-05-08T10:55:20.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.132+0000 7f476b760640 1 -- 172.21.15.33:0/2268101714 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f476413bf20 con 0x7f4764140670 2024-05-08T10:55:20.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.132+0000 7f4761ffb640 1 -- 172.21.15.33:0/2268101714 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4754037020 con 0x7f4764140670 2024-05-08T10:55:20.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.133+0000 7f4761ffb640 1 --2- 172.21.15.33:0/2268101714 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f475006b4d0 0x7f475006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:20.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.133+0000 7f4761ffb640 1 -- 172.21.15.33:0/2268101714 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f47540aa4b0 con 0x7f4764140670 2024-05-08T10:55:20.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.133+0000 7f47694fc640 1 --2- 172.21.15.33:0/2268101714 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f475006b4d0 0x7f475006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:20.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.134+0000 7f47694fc640 1 --2- 172.21.15.33:0/2268101714 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f475006b4d0 0x7f475006d990 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f475c001050 tx=0x7f475c007970 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:20.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.137+0000 7f4761ffb640 1 -- 172.21.15.33:0/2268101714 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f476413bf20 con 0x7f4764140670 2024-05-08T10:55:20.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.318+0000 7f476b760640 1 -- 172.21.15.33:0/2268101714 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4764140b30 con 0x7f4764140670 2024-05-08T10:55:20.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.319+0000 7f4761ffb640 1 -- 172.21.15.33:0/2268101714 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16617 (secure 0 0 0) 0x7f4754079330 con 0x7f4764140670 2024-05-08T10:55:20.317 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:55:20.317 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":20,"fsid":"963217b2-c375-4f5a-95cf-88e199dd38ff","created":"2024-05-08T10:54:26.711528+0000","modified":"2024-05-08T10:54:51.528856+0000","last_up_change":"2024-05-08T10:54:37.987478+0000","last_in_change":"2024-05-08T10:54:28.834106+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T10:54:38.989228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T10:54:47.774236+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T10:54:48.869679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c5da4fb5-d4f2-4982-a804-2aa92fe77731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3990629207},{"type":"v1","addr":"172.21.15.33:6817","nonce":3990629207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3990629207},{"type":"v1","addr":"172.21.15.33:6819","nonce":3990629207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3990629207},{"type":"v1","addr":"172.21.15.33:6823","nonce":3990629207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3990629207},{"type":"v1","addr":"172.21.15.33:6821","nonce":3990629207}]},"public_addr":"172.21.15.33:6817/3990629207","cluster_addr":"172.21.15.33:6819/3990629207","heartbeat_back_addr":"172.21.15.33:6823/3990629207","heartbeat_front_addr":"172.21.15.33:6821/3990629207","state":["exists","up"]},{"osd":1,"uuid":"f8fdd8db-c2a3-4d28-81f3-b30f44bea7c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":1758076090},{"type":"v1","addr":"172.21.15.33:6825","nonce":1758076090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":1758076090},{"type":"v1","addr":"172.21.15.33:6827","nonce":1758076090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":1758076090},{"type":"v1","addr":"172.21.15.33:6831","nonce":1758076090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":1758076090},{"type":"v1","addr":"172.21.15.33:6829","nonce":1758076090}]},"public_addr":"172.21.15.33:6825/1758076090","cluster_addr":"172.21.15.33:6827/1758076090","heartbeat_back_addr":"172.21.15.33:6831/1758076090","heartbeat_front_addr":"172.21.15.33:6829/1758076090","state":["exists","up"]},{"osd":2,"uuid":"87d465f3-b40f-48dd-bae2-4c67904d4828","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":2940853479},{"type":"v1","addr":"172.21.15.33:6801","nonce":2940853479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6803","nonce":2940853479},{"type":"v1","addr":"172.21.15.33:6805","nonce":2940853479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6811","nonce":2940853479},{"type":"v1","addr":"172.21.15.33:6813","nonce":2940853479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6807","nonce":2940853479},{"type":"v1","addr":"172.21.15.33:6809","nonce":2940853479}]},"public_addr":"172.21.15.33:6801/2940853479","cluster_addr":"172.21.15.33:6805/2940853479","heartbeat_back_addr":"172.21.15.33:6813/2940853479","heartbeat_front_addr":"172.21.15.33:6809/2940853479","state":["exists","up"]},{"osd":3,"uuid":"79450edf-9637-4181-9372-e1cd5e91e73e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":4029047077},{"type":"v1","addr":"172.21.15.33:6804","nonce":4029047077}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":4029047077},{"type":"v1","addr":"172.21.15.33:6808","nonce":4029047077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":4029047077},{"type":"v1","addr":"172.21.15.33:6815","nonce":4029047077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":4029047077},{"type":"v1","addr":"172.21.15.33:6812","nonce":4029047077}]},"public_addr":"172.21.15.33:6804/4029047077","cluster_addr":"172.21.15.33:6808/4029047077","heartbeat_back_addr":"172.21.15.33:6815/4029047077","heartbeat_front_addr":"172.21.15.33:6812/4029047077","state":["exists","up"]},{"osd":4,"uuid":"bd0debfa-e559-4b1e-920d-6b2639c7085e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":1697399220},{"type":"v1","addr":"172.21.15.174:6801","nonce":1697399220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":1697399220},{"type":"v1","addr":"172.21.15.174:6803","nonce":1697399220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":1697399220},{"type":"v1","addr":"172.21.15.174:6807","nonce":1697399220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":1697399220},{"type":"v1","addr":"172.21.15.174:6805","nonce":1697399220}]},"public_addr":"172.21.15.174:6801/1697399220","cluster_addr":"172.21.15.174:6803/1697399220","heartbeat_back_addr":"172.21.15.174:6807/1697399220","heartbeat_front_addr":"172.21.15.174:6805/1697399220","state":["exists","up"]},{"osd":5,"uuid":"ff0f51c0-672b-448f-9de1-b9305ce8c00d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":1511860729},{"type":"v1","addr":"172.21.15.174:6825","nonce":1511860729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":1511860729},{"type":"v1","addr":"172.21.15.174:6827","nonce":1511860729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":1511860729},{"type":"v1","addr":"172.21.15.174:6831","nonce":1511860729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":1511860729},{"type":"v1","addr":"172.21.15.174:6829","nonce":1511860729}]},"public_addr":"172.21.15.174:6825/1511860729","cluster_addr":"172.21.15.174:6827/1511860729","heartbeat_back_addr":"172.21.15.174:6831/1511860729","heartbeat_front_addr":"172.21.15.174:6829/1511860729","state":["exists","up"]},{"osd":6,"uuid":"93061f6c-c0ce-47e9-88a0-1151c5ccb4e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":2326407945},{"type":"v1","addr":"172.21.15.174:6817","nonce":2326407945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":2326407945},{"type":"v1","addr":"172.21.15.174:6819","nonce":2326407945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":2326407945},{"type":"v1","addr":"172.21.15.174:6823","nonce":2326407945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":2326407945},{"type":"v1","addr":"172.21.15.174:6821","nonce":2326407945}]},"public_addr":"172.21.15.174:6817/2326407945","cluster_addr":"172.21.15.174:6819/2326407945","heartbeat_back_addr":"172.21.15.174:6823/2326407945","heartbeat_front_addr":"172.21.15.174:6821/2326407945","state":["exists","up"]},{"osd":7,"uuid":"7be1dcf3-1957-4ec3-bacf-f5f9fff580a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":1637570253},{"type":"v1","addr":"172.21.15.174:6809","nonce":1637570253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":1637570253},{"type":"v1","addr":"172.21.15.174:6811","nonce":1637570253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":1637570253},{"type":"v1","addr":"172.21.15.174:6815","nonce":1637570253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":1637570253},{"type":"v1","addr":"172.21.15.174:6813","nonce":1637570253}]},"public_addr":"172.21.15.174:6809/1637570253","cluster_addr":"172.21.15.174:6811/1637570253","heartbeat_back_addr":"172.21.15.174:6815/1637570253","heartbeat_front_addr":"172.21.15.174:6813/1637570253","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:33.997709+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:34.016568+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:33.990484+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:33.980666+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:33.920609+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:34.005069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:34.018345+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:34.061646+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T10:55:20.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.321+0000 7f476b760640 1 -- 172.21.15.33:0/2268101714 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f475006b4d0 msgr2=0x7f475006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:20.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.321+0000 7f476b760640 1 --2- 172.21.15.33:0/2268101714 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f475006b4d0 0x7f475006d990 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f475c001050 tx=0x7f475c007970 comp rx=0 tx=0).stop 2024-05-08T10:55:20.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.321+0000 7f476b760640 1 -- 172.21.15.33:0/2268101714 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4764140670 msgr2=0x7f4764152230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:20.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.321+0000 7f476b760640 1 --2- 172.21.15.33:0/2268101714 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4764140670 0x7f4764152230 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f475400e170 tx=0x7f4754009750 comp rx=0 tx=0).stop 2024-05-08T10:55:20.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.321+0000 7f476b760640 1 -- 172.21.15.33:0/2268101714 shutdown_connections 2024-05-08T10:55:20.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.321+0000 7f476b760640 1 --2- 172.21.15.33:0/2268101714 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f475006b4d0 0x7f475006d990 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:20.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.321+0000 7f476b760640 1 --2- 172.21.15.33:0/2268101714 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4764140670 0x7f4764152230 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:20.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.321+0000 7f476b760640 1 --2- 172.21.15.33:0/2268101714 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4764139600 0x7f4764140130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:20.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.321+0000 7f476b760640 1 --2- 172.21.15.33:0/2268101714 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f474c004d40 0x7f476413e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:20.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.321+0000 7f476b760640 1 -- 172.21.15.33:0/2268101714 >> 172.21.15.33:0/2268101714 conn(0x7f476406aba0 msgr2=0x7f476415a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:20.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.321+0000 7f476b760640 1 -- 172.21.15.33:0/2268101714 shutdown_connections 2024-05-08T10:55:20.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.321+0000 7f476b760640 1 -- 172.21.15.33:0/2268101714 wait complete. 2024-05-08T10:55:20.330 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-08T10:55:20.330 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T10:55:20.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.436+0000 7f47c5c6b640 1 Processor -- start 2024-05-08T10:55:20.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.436+0000 7f47c5c6b640 1 -- start start 2024-05-08T10:55:20.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.437+0000 7f47c5c6b640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f47c00d03c0 0x7f47c00d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:20.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.437+0000 7f47c5c6b640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47c00ce650 con 0x7f47c00d07a0 2024-05-08T10:55:20.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.437+0000 7f47c5c6b640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47c00d1e60 con 0x7f47c00cf0f0 2024-05-08T10:55:20.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.437+0000 7f47c5c6b640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47c00b70a0 con 0x7f47c00d03c0 2024-05-08T10:55:20.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.437+0000 7f47bf7fe640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f47c00d03c0 0x7f47c00d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:20.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.437+0000 7f47beffd640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f47c00d07a0 0x7f47c00b6990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:53142/0 (socket says 172.21.15.33:53142) 2024-05-08T10:55:20.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.437+0000 7f47beffd640 1 -- 172.21.15.33:0/1719687307 learned_addr learned my addr 172.21.15.33:0/1719687307 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-05-08T10:55:20.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.437+0000 7f47bf7fe640 1 -- 172.21.15.33:0/1719687307 >> v1:172.21.15.174:6789/0 conn(0x7f47c00cf0f0 legacy=0x7f47c00cf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:20.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.437+0000 7f47bf7fe640 1 -- 172.21.15.33:0/1719687307 >> v1:172.21.15.33:6789/0 conn(0x7f47c00d07a0 legacy=0x7f47c00b6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:20.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.437+0000 7f47bf7fe640 1 -- 172.21.15.33:0/1719687307 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47c00d4250 con 0x7f47c00d03c0 2024-05-08T10:55:20.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.437+0000 7f47be7fc640 1 -- 172.21.15.33:0/1719687307 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3513320883 0 0) 0x7f47c00ce650 con 0x7f47c00d07a0 2024-05-08T10:55:20.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.438+0000 7f47bf7fe640 1 --2- 172.21.15.33:0/1719687307 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47c00d03c0 0x7f47c00d1920 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f47b00097a0 tx=0x7f47b002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecbab701f9a2b18a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:20.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.438+0000 7f47be7fc640 1 -- 172.21.15.33:0/1719687307 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b0037070 con 0x7f47c00d03c0 2024-05-08T10:55:20.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.438+0000 7f47be7fc640 1 -- 172.21.15.33:0/1719687307 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47b0032440 con 0x7f47c00d03c0 2024-05-08T10:55:20.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.438+0000 7f47be7fc640 1 -- 172.21.15.33:0/1719687307 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b0032810 con 0x7f47c00d03c0 2024-05-08T10:55:20.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.439+0000 7f47c5c6b640 1 -- 172.21.15.33:0/1719687307 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47c00d03c0 msgr2=0x7f47c00d1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:20.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.439+0000 7f47c5c6b640 1 --2- 172.21.15.33:0/1719687307 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47c00d03c0 0x7f47c00d1920 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f47b00097a0 tx=0x7f47b002a1e0 comp rx=0 tx=0).stop 2024-05-08T10:55:20.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.439+0000 7f47c5c6b640 1 -- 172.21.15.33:0/1719687307 shutdown_connections 2024-05-08T10:55:20.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.439+0000 7f47c5c6b640 1 --2- 172.21.15.33:0/1719687307 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47c00d03c0 0x7f47c00d1920 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:20.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.439+0000 7f47c5c6b640 1 -- 172.21.15.33:0/1719687307 >> 172.21.15.33:0/1719687307 conn(0x7f47c009ce90 msgr2=0x7f47c00d3b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:20.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.439+0000 7f47c5c6b640 1 -- 172.21.15.33:0/1719687307 shutdown_connections 2024-05-08T10:55:20.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.439+0000 7f47c5c6b640 1 -- 172.21.15.33:0/1719687307 wait complete. 2024-05-08T10:55:20.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.440+0000 7f47c5c6b640 1 Processor -- start 2024-05-08T10:55:20.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.440+0000 7f47c5c6b640 1 -- start start 2024-05-08T10:55:20.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.441+0000 7f47c5c6b640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f47c00cf0f0 0x7f47c01f3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:20.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.441+0000 7f47c5c6b640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f47c00d03c0 0x7f47c015cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:20.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.441+0000 7f47c5c6b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47c00d07a0 0x7f47c015fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:20.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.441+0000 7f47c5c6b640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47c00ce8f0 con 0x7f47c00d07a0 2024-05-08T10:55:20.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.441+0000 7f47c5c6b640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47c00d4810 con 0x7f47c00cf0f0 2024-05-08T10:55:20.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.441+0000 7f47c5c6b640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47c00cebd0 con 0x7f47c00d03c0 2024-05-08T10:55:20.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.441+0000 7f47bffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47c00d07a0 0x7f47c015fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:20.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.441+0000 7f47bffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47c00d07a0 0x7f47c015fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58240/0 (socket says 172.21.15.33:58240) 2024-05-08T10:55:20.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.441+0000 7f47bffff640 1 -- 172.21.15.33:0/2801224083 learned_addr learned my addr 172.21.15.33:0/2801224083 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:20.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.441+0000 7f47bf7fe640 1 --2- 172.21.15.33:0/2801224083 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f47c00cf0f0 0x7f47c01f3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:20.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.441+0000 7f47beffd640 1 --2- 172.21.15.33:0/2801224083 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f47c00d03c0 0x7f47c015cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:20.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.442+0000 7f47bffff640 1 -- 172.21.15.33:0/2801224083 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f47c00d03c0 msgr2=0x7f47c015cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:20.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.442+0000 7f47bffff640 1 --2- 172.21.15.33:0/2801224083 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f47c00d03c0 0x7f47c015cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:20.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.442+0000 7f47bffff640 1 -- 172.21.15.33:0/2801224083 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f47c00cf0f0 msgr2=0x7f47c01f3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:20.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.442+0000 7f47bffff640 1 --2- 172.21.15.33:0/2801224083 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f47c00cf0f0 0x7f47c01f3f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:20.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.442+0000 7f47bffff640 1 -- 172.21.15.33:0/2801224083 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47c00b0890 con 0x7f47c00d07a0 2024-05-08T10:55:20.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.442+0000 7f47bffff640 1 --2- 172.21.15.33:0/2801224083 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47c00d07a0 0x7f47c015fba0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f47b800c780 tx=0x7f47b800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:20.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.442+0000 7f47a7fff640 1 -- 172.21.15.33:0/2801224083 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b8004b60 con 0x7f47c00d07a0 2024-05-08T10:55:20.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.442+0000 7f47a7fff640 1 -- 172.21.15.33:0/2801224083 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47b8004d00 con 0x7f47c00d07a0 2024-05-08T10:55:20.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.442+0000 7f47c5c6b640 1 -- 172.21.15.33:0/2801224083 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47c00b0b00 con 0x7f47c00d07a0 2024-05-08T10:55:20.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.442+0000 7f47a7fff640 1 -- 172.21.15.33:0/2801224083 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b800aa90 con 0x7f47c00d07a0 2024-05-08T10:55:20.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.442+0000 7f47c5c6b640 1 -- 172.21.15.33:0/2801224083 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47c00b10c0 con 0x7f47c00d07a0 2024-05-08T10:55:20.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.443+0000 7f47c5c6b640 1 -- 172.21.15.33:0/2801224083 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47c0069d20 con 0x7f47c00d07a0 2024-05-08T10:55:20.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.444+0000 7f47a7fff640 1 -- 172.21.15.33:0/2801224083 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f47b800ac30 con 0x7f47c00d07a0 2024-05-08T10:55:20.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.444+0000 7f47a7fff640 1 --2- 172.21.15.33:0/2801224083 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f47ac06b4d0 0x7f47ac06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:20.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.444+0000 7f47a7fff640 1 -- 172.21.15.33:0/2801224083 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f47b808a260 con 0x7f47c00d07a0 2024-05-08T10:55:20.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.444+0000 7f47bf7fe640 1 --2- 172.21.15.33:0/2801224083 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f47ac06b4d0 0x7f47ac06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:20.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.445+0000 7f47bf7fe640 1 --2- 172.21.15.33:0/2801224083 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f47ac06b4d0 0x7f47ac06d990 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f47b0034000 tx=0x7f47b002e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:20.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.448+0000 7f47a7fff640 1 -- 172.21.15.33:0/2801224083 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f47b8020070 con 0x7f47c00d07a0 2024-05-08T10:55:20.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.666+0000 7f47c5c6b640 1 -- 172.21.15.33:0/2801224083 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f47c006cf10 con 0x7f47c00d07a0 2024-05-08T10:55:20.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.666+0000 7f47a7fff640 1 -- 172.21.15.33:0/2801224083 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4935 (secure 0 0 0) 0x7f47b8058b20 con 0x7f47c00d07a0 2024-05-08T10:55:20.664 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:55:20.664 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4262,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6837/974626320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6835","nonce":974626320},{"type":"v1","addr":"172.21.15.174:6837","nonce":974626320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6834/3541391922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":3541391922},{"type":"v1","addr":"172.21.15.33:6834","nonce":3541391922}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/1492311153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6833","nonce":1492311153},{"type":"v1","addr":"172.21.15.33:6835","nonce":1492311153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T10:54:49.885783+0000","modified":"2024-05-08T10:54:52.897089+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.174:6836/2139245090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2139245090},{"type":"v1","addr":"172.21.15.174:6836","nonce":2139245090}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T10:55:20.664 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 7 2024-05-08T10:55:20.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.668+0000 7f47c5c6b640 1 -- 172.21.15.33:0/2801224083 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f47ac06b4d0 msgr2=0x7f47ac06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:20.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.668+0000 7f47c5c6b640 1 --2- 172.21.15.33:0/2801224083 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f47ac06b4d0 0x7f47ac06d990 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f47b0034000 tx=0x7f47b002e000 comp rx=0 tx=0).stop 2024-05-08T10:55:20.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.668+0000 7f47c5c6b640 1 -- 172.21.15.33:0/2801224083 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47c00d07a0 msgr2=0x7f47c015fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:20.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.668+0000 7f47c5c6b640 1 --2- 172.21.15.33:0/2801224083 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47c00d07a0 0x7f47c015fba0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f47b800c780 tx=0x7f47b800cc40 comp rx=0 tx=0).stop 2024-05-08T10:55:20.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.668+0000 7f47c5c6b640 1 -- 172.21.15.33:0/2801224083 shutdown_connections 2024-05-08T10:55:20.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.668+0000 7f47c5c6b640 1 --2- 172.21.15.33:0/2801224083 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f47ac06b4d0 0x7f47ac06d990 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:20.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.668+0000 7f47c5c6b640 1 --2- 172.21.15.33:0/2801224083 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47c00d07a0 0x7f47c015fba0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:20.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.668+0000 7f47c5c6b640 1 --2- 172.21.15.33:0/2801224083 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f47c00d03c0 0x7f47c015cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:20.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.668+0000 7f47c5c6b640 1 --2- 172.21.15.33:0/2801224083 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f47c00cf0f0 0x7f47c01f3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:20.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.668+0000 7f47c5c6b640 1 -- 172.21.15.33:0/2801224083 >> 172.21.15.33:0/2801224083 conn(0x7f47c009ce90 msgr2=0x7f47c00b93e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:20.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.668+0000 7f47c5c6b640 1 -- 172.21.15.33:0/2801224083 shutdown_connections 2024-05-08T10:55:20.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.669+0000 7f47c5c6b640 1 -- 172.21.15.33:0/2801224083 wait complete. 2024-05-08T10:55:20.667 DEBUG:teuthology.orchestra.run.smithi033:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T10:55:20.669 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T10:55:20.677 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T10:55:20.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.860+0000 7f4a2fed8640 1 Processor -- start 2024-05-08T10:55:20.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.860+0000 7f4a2fed8640 1 -- start start 2024-05-08T10:55:20.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.861+0000 7f4a2fed8640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f4a2815ba30 0x7f4a280d2460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:20.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.861+0000 7f4a2fed8640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4a2815be10 0x7f4a280cc450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:20.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.861+0000 7f4a2fed8640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a280cc990 con 0x7f4a280ce180 2024-05-08T10:55:20.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.861+0000 7f4a2fed8640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a280cd840 con 0x7f4a2815ba30 2024-05-08T10:55:20.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.861+0000 7f4a2fed8640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a280ccc30 con 0x7f4a2815be10 2024-05-08T10:55:20.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.861+0000 7f4a2dc74640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f4a2815ba30 0x7f4a280d2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:20.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.861+0000 7f4a2dc74640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f4a2815ba30 0x7f4a280d2460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58254/0 (socket says 172.21.15.33:58254) 2024-05-08T10:55:20.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.861+0000 7f4a2dc74640 1 -- 172.21.15.33:0/806260675 learned_addr learned my addr 172.21.15.33:0/806260675 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:20.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.861+0000 7f4a2d473640 1 --2- 172.21.15.33:0/806260675 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4a2815be10 0x7f4a280cc450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:20.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.862+0000 7f4a2dc74640 1 -- 172.21.15.33:0/806260675 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4a2815be10 msgr2=0x7f4a280cc450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:20.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.862+0000 7f4a2dc74640 1 --2- 172.21.15.33:0/806260675 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4a2815be10 0x7f4a280cc450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:20.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.862+0000 7f4a2dc74640 1 -- 172.21.15.33:0/806260675 >> v1:172.21.15.174:6789/0 conn(0x7f4a280ce180 legacy=0x7f4a2815f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:20.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.862+0000 7f4a2dc74640 1 -- 172.21.15.33:0/806260675 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a280ccf10 con 0x7f4a2815ba30 2024-05-08T10:55:20.861 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.862+0000 7f4a2dc74640 1 --2- 172.21.15.33:0/806260675 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a2815ba30 0x7f4a280d2460 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4a24009870 tx=0x7f4a2402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ebe037a3eb6291a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:20.861 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.862+0000 7f4a2cc72640 1 -- 172.21.15.33:0/806260675 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a24037070 con 0x7f4a2815ba30 2024-05-08T10:55:20.861 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.862+0000 7f4a2cc72640 1 -- 172.21.15.33:0/806260675 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a24032440 con 0x7f4a2815ba30 2024-05-08T10:55:20.861 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.862+0000 7f4a2cc72640 1 -- 172.21.15.33:0/806260675 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a24032810 con 0x7f4a2815ba30 2024-05-08T10:55:20.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.863+0000 7f4a2fed8640 1 -- 172.21.15.33:0/806260675 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a2815ba30 msgr2=0x7f4a280d2460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:20.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.863+0000 7f4a2fed8640 1 --2- 172.21.15.33:0/806260675 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a2815ba30 0x7f4a280d2460 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4a24009870 tx=0x7f4a2402a270 comp rx=0 tx=0).stop 2024-05-08T10:55:20.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.863+0000 7f4a2fed8640 1 -- 172.21.15.33:0/806260675 shutdown_connections 2024-05-08T10:55:20.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.863+0000 7f4a2fed8640 1 --2- 172.21.15.33:0/806260675 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4a2815be10 0x7f4a280cc450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:20.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.863+0000 7f4a2fed8640 1 --2- 172.21.15.33:0/806260675 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a2815ba30 0x7f4a280d2460 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:20.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.863+0000 7f4a2fed8640 1 -- 172.21.15.33:0/806260675 >> 172.21.15.33:0/806260675 conn(0x7f4a280d1940 msgr2=0x7f4a280d1d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:20.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.863+0000 7f4a2fed8640 1 -- 172.21.15.33:0/806260675 shutdown_connections 2024-05-08T10:55:20.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.863+0000 7f4a2fed8640 1 -- 172.21.15.33:0/806260675 wait complete. 2024-05-08T10:55:20.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.864+0000 7f4a2fed8640 1 Processor -- start 2024-05-08T10:55:20.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.864+0000 7f4a2fed8640 1 -- start start 2024-05-08T10:55:20.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.865+0000 7f4a2fed8640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4a280ce180 0x7f4a280c4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:20.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.865+0000 7f4a2fed8640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a2815ba30 0x7f4a2814edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:20.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.865+0000 7f4a2fed8640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4a2815be10 0x7f4a280c68c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:20.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.865+0000 7f4a2fed8640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a2806e6e0 con 0x7f4a2815ba30 2024-05-08T10:55:20.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.865+0000 7f4a2fed8640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a280cd4d0 con 0x7f4a2815be10 2024-05-08T10:55:20.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.865+0000 7f4a2fed8640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a280d0800 con 0x7f4a280ce180 2024-05-08T10:55:20.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.865+0000 7f4a2d473640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a2815ba30 0x7f4a2814edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:20.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.865+0000 7f4a2d473640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a2815ba30 0x7f4a2814edb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58266/0 (socket says 172.21.15.33:58266) 2024-05-08T10:55:20.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.865+0000 7f4a2d473640 1 -- 172.21.15.33:0/1134054905 learned_addr learned my addr 172.21.15.33:0/1134054905 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:20.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.865+0000 7f4a2dc74640 1 --2- 172.21.15.33:0/1134054905 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4a280ce180 0x7f4a280c4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:20.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.865+0000 7f4a2e475640 1 --2- 172.21.15.33:0/1134054905 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4a2815be10 0x7f4a280c68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:20.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.865+0000 7f4a2d473640 1 -- 172.21.15.33:0/1134054905 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4a280ce180 msgr2=0x7f4a280c4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:20.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.865+0000 7f4a2d473640 1 --2- 172.21.15.33:0/1134054905 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4a280ce180 0x7f4a280c4fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:20.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.865+0000 7f4a2d473640 1 -- 172.21.15.33:0/1134054905 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4a2815be10 msgr2=0x7f4a280c68c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:20.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.865+0000 7f4a2d473640 1 --2- 172.21.15.33:0/1134054905 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4a2815be10 0x7f4a280c68c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:20.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.865+0000 7f4a2d473640 1 -- 172.21.15.33:0/1134054905 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a280c5820 con 0x7f4a2815ba30 2024-05-08T10:55:20.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.866+0000 7f4a2d473640 1 --2- 172.21.15.33:0/1134054905 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a2815ba30 0x7f4a2814edb0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4a1800e870 tx=0x7f4a1800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:20.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.866+0000 7f4a1e7fc640 1 -- 172.21.15.33:0/1134054905 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a18017070 con 0x7f4a2815ba30 2024-05-08T10:55:20.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.866+0000 7f4a1e7fc640 1 -- 172.21.15.33:0/1134054905 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a1800c940 con 0x7f4a2815ba30 2024-05-08T10:55:20.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.866+0000 7f4a2fed8640 1 -- 172.21.15.33:0/1134054905 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a280c5b00 con 0x7f4a2815ba30 2024-05-08T10:55:20.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.866+0000 7f4a1e7fc640 1 -- 172.21.15.33:0/1134054905 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a1800cd30 con 0x7f4a2815ba30 2024-05-08T10:55:20.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.866+0000 7f4a2fed8640 1 -- 172.21.15.33:0/1134054905 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a280c60c0 con 0x7f4a2815ba30 2024-05-08T10:55:20.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.867+0000 7f4a2fed8640 1 -- 172.21.15.33:0/1134054905 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a28069d20 con 0x7f4a2815ba30 2024-05-08T10:55:20.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.868+0000 7f4a1e7fc640 1 -- 172.21.15.33:0/1134054905 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4a1801a070 con 0x7f4a2815ba30 2024-05-08T10:55:20.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.868+0000 7f4a1e7fc640 1 --2- 172.21.15.33:0/1134054905 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f4a0c06b4d0 0x7f4a0c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:20.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.868+0000 7f4a1e7fc640 1 -- 172.21.15.33:0/1134054905 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4a1808a480 con 0x7f4a2815ba30 2024-05-08T10:55:20.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.868+0000 7f4a2dc74640 1 --2- 172.21.15.33:0/1134054905 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f4a0c06b4d0 0x7f4a0c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:20.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.869+0000 7f4a2dc74640 1 --2- 172.21.15.33:0/1134054905 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f4a0c06b4d0 0x7f4a0c06d990 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4a24034000 tx=0x7f4a2402e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:20.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:20.872+0000 7f4a1e7fc640 1 -- 172.21.15.33:0/1134054905 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4a18059300 con 0x7f4a2815ba30 2024-05-08T10:55:21.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.089+0000 7f4a2fed8640 1 -- 172.21.15.33:0/1134054905 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4a280c64c0 con 0x7f4a2815ba30 2024-05-08T10:55:21.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.090+0000 7f4a1e7fc640 1 -- 172.21.15.33:0/1134054905 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4935 (secure 0 0 0) 0x7f4a18058c00 con 0x7f4a2815ba30 2024-05-08T10:55:21.087 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:55:21.087 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4262,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6837/974626320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6835","nonce":974626320},{"type":"v1","addr":"172.21.15.174:6837","nonce":974626320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6834/3541391922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":3541391922},{"type":"v1","addr":"172.21.15.33:6834","nonce":3541391922}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/1492311153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6833","nonce":1492311153},{"type":"v1","addr":"172.21.15.33:6835","nonce":1492311153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T10:54:49.885783+0000","modified":"2024-05-08T10:54:52.897089+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.174:6836/2139245090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2139245090},{"type":"v1","addr":"172.21.15.174:6836","nonce":2139245090}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T10:55:21.087 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 7 2024-05-08T10:55:21.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.092+0000 7f4a2fed8640 1 -- 172.21.15.33:0/1134054905 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f4a0c06b4d0 msgr2=0x7f4a0c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:21.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.092+0000 7f4a2fed8640 1 --2- 172.21.15.33:0/1134054905 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f4a0c06b4d0 0x7f4a0c06d990 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4a24034000 tx=0x7f4a2402e000 comp rx=0 tx=0).stop 2024-05-08T10:55:21.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.092+0000 7f4a2fed8640 1 -- 172.21.15.33:0/1134054905 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a2815ba30 msgr2=0x7f4a2814edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:21.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.092+0000 7f4a2fed8640 1 --2- 172.21.15.33:0/1134054905 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a2815ba30 0x7f4a2814edb0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4a1800e870 tx=0x7f4a1800ed30 comp rx=0 tx=0).stop 2024-05-08T10:55:21.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.092+0000 7f4a2fed8640 1 -- 172.21.15.33:0/1134054905 shutdown_connections 2024-05-08T10:55:21.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.092+0000 7f4a2fed8640 1 --2- 172.21.15.33:0/1134054905 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f4a0c06b4d0 0x7f4a0c06d990 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:21.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.092+0000 7f4a2fed8640 1 --2- 172.21.15.33:0/1134054905 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4a2815be10 0x7f4a280c68c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:21.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.092+0000 7f4a2fed8640 1 --2- 172.21.15.33:0/1134054905 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a2815ba30 0x7f4a2814edb0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:21.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.092+0000 7f4a2fed8640 1 --2- 172.21.15.33:0/1134054905 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4a280ce180 0x7f4a280c4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:21.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.092+0000 7f4a2fed8640 1 -- 172.21.15.33:0/1134054905 >> 172.21.15.33:0/1134054905 conn(0x7f4a280d1940 msgr2=0x7f4a28159880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:21.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.092+0000 7f4a2fed8640 1 -- 172.21.15.33:0/1134054905 shutdown_connections 2024-05-08T10:55:21.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.092+0000 7f4a2fed8640 1 -- 172.21.15.33:0/1134054905 wait complete. 2024-05-08T10:55:21.100 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T10:55:21.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.206+0000 7f691964d640 1 Processor -- start 2024-05-08T10:55:21.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.207+0000 7f691964d640 1 -- start start 2024-05-08T10:55:21.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.207+0000 7f691964d640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f691406b2b0 0x7f69140d13a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:21.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.207+0000 7f691964d640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f6914071f80 0x7f691406dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:21.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.207+0000 7f691964d640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6914071730 con 0x7f691415dfb0 2024-05-08T10:55:21.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.207+0000 7f691964d640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6914071a10 con 0x7f6914071f80 2024-05-08T10:55:21.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.207+0000 7f691964d640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6914071cf0 con 0x7f691406b2b0 2024-05-08T10:55:21.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.208+0000 7f69137fe640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f6914071f80 0x7f691406dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:21.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.208+0000 7f69137fe640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f6914071f80 0x7f691406dce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58278/0 (socket says 172.21.15.33:58278) 2024-05-08T10:55:21.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.208+0000 7f69137fe640 1 -- 172.21.15.33:0/1327092940 learned_addr learned my addr 172.21.15.33:0/1327092940 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:21.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.208+0000 7f69137fe640 1 -- 172.21.15.33:0/1327092940 >> v2:172.21.15.174:3300/0 conn(0x7f691406b2b0 msgr2=0x7f69140d13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:21.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.208+0000 7f69137fe640 1 --2- 172.21.15.33:0/1327092940 >> v2:172.21.15.174:3300/0 conn(0x7f691406b2b0 0x7f69140d13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:21.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.208+0000 7f69137fe640 1 -- 172.21.15.33:0/1327092940 >> v1:172.21.15.174:6789/0 conn(0x7f691415dfb0 legacy=0x7f691406aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:21.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.208+0000 7f69137fe640 1 -- 172.21.15.33:0/1327092940 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69140ce850 con 0x7f6914071f80 2024-05-08T10:55:21.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.209+0000 7f69137fe640 1 --2- 172.21.15.33:0/1327092940 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6914071f80 0x7f691406dce0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f69140700b0 tx=0x7f690402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2690f7ab54cdcb1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:21.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.209+0000 7f6911ffb640 1 -- 172.21.15.33:0/1327092940 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6904037070 con 0x7f6914071f80 2024-05-08T10:55:21.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.209+0000 7f6911ffb640 1 -- 172.21.15.33:0/1327092940 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6904032440 con 0x7f6914071f80 2024-05-08T10:55:21.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.209+0000 7f6911ffb640 1 -- 172.21.15.33:0/1327092940 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6904032810 con 0x7f6914071f80 2024-05-08T10:55:21.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.209+0000 7f691964d640 1 -- 172.21.15.33:0/1327092940 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6914071f80 msgr2=0x7f691406dce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:21.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.209+0000 7f691964d640 1 --2- 172.21.15.33:0/1327092940 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6914071f80 0x7f691406dce0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f69140700b0 tx=0x7f690402a230 comp rx=0 tx=0).stop 2024-05-08T10:55:21.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.209+0000 7f691964d640 1 -- 172.21.15.33:0/1327092940 shutdown_connections 2024-05-08T10:55:21.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.209+0000 7f691964d640 1 --2- 172.21.15.33:0/1327092940 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6914071f80 0x7f691406dce0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:21.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.209+0000 7f691964d640 1 --2- 172.21.15.33:0/1327092940 >> v2:172.21.15.174:3300/0 conn(0x7f691406b2b0 0x7f69140d13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:21.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.209+0000 7f691964d640 1 -- 172.21.15.33:0/1327092940 >> 172.21.15.33:0/1327092940 conn(0x7f69140d08b0 msgr2=0x7f69140d0c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:21.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.209+0000 7f691964d640 1 -- 172.21.15.33:0/1327092940 shutdown_connections 2024-05-08T10:55:21.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.209+0000 7f691964d640 1 -- 172.21.15.33:0/1327092940 wait complete. 2024-05-08T10:55:21.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.211+0000 7f691964d640 1 Processor -- start 2024-05-08T10:55:21.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.211+0000 7f691964d640 1 -- start start 2024-05-08T10:55:21.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.211+0000 7f691964d640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f691406b2b0 0x7f69141507f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:21.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.211+0000 7f691964d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6914071f80 0x7f69140b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:21.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.211+0000 7f691964d640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f691415dfb0 0x7f69140b4be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:21.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.211+0000 7f691964d640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69140cf050 con 0x7f6914071f80 2024-05-08T10:55:21.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.211+0000 7f691964d640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6914072700 con 0x7f691415dfb0 2024-05-08T10:55:21.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.211+0000 7f691964d640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69140cf1d0 con 0x7f691406b2b0 2024-05-08T10:55:21.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.212+0000 7f69127fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6914071f80 0x7f69140b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:21.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.212+0000 7f69127fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6914071f80 0x7f69140b46a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58282/0 (socket says 172.21.15.33:58282) 2024-05-08T10:55:21.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.212+0000 7f69127fc640 1 -- 172.21.15.33:0/3626208055 learned_addr learned my addr 172.21.15.33:0/3626208055 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:21.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.212+0000 7f69137fe640 1 --2- 172.21.15.33:0/3626208055 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f691415dfb0 0x7f69140b4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:21.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.212+0000 7f6912ffd640 1 --2- 172.21.15.33:0/3626208055 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f691406b2b0 0x7f69141507f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:21.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.212+0000 7f69127fc640 1 -- 172.21.15.33:0/3626208055 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f691406b2b0 msgr2=0x7f69141507f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:21.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.212+0000 7f69127fc640 1 --2- 172.21.15.33:0/3626208055 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f691406b2b0 0x7f69141507f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:21.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.212+0000 7f69127fc640 1 -- 172.21.15.33:0/3626208055 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f691415dfb0 msgr2=0x7f69140b4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:21.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.212+0000 7f69127fc640 1 --2- 172.21.15.33:0/3626208055 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f691415dfb0 0x7f69140b4be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:21.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.212+0000 7f69127fc640 1 -- 172.21.15.33:0/3626208055 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6914151150 con 0x7f6914071f80 2024-05-08T10:55:21.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.212+0000 7f69127fc640 1 --2- 172.21.15.33:0/3626208055 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6914071f80 0x7f69140b46a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f68fc00b4a0 tx=0x7f68fc00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:21.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.212+0000 7f690b7fe640 1 -- 172.21.15.33:0/3626208055 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68fc014070 con 0x7f6914071f80 2024-05-08T10:55:21.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.212+0000 7f690b7fe640 1 -- 172.21.15.33:0/3626208055 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68fc010610 con 0x7f6914071f80 2024-05-08T10:55:21.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.212+0000 7f691964d640 1 -- 172.21.15.33:0/3626208055 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6914151430 con 0x7f6914071f80 2024-05-08T10:55:21.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.212+0000 7f690b7fe640 1 -- 172.21.15.33:0/3626208055 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68fc010a00 con 0x7f6914071f80 2024-05-08T10:55:21.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.212+0000 7f691964d640 1 -- 172.21.15.33:0/3626208055 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69141519f0 con 0x7f6914071f80 2024-05-08T10:55:21.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.213+0000 7f691964d640 1 -- 172.21.15.33:0/3626208055 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6914069d20 con 0x7f6914071f80 2024-05-08T10:55:21.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.214+0000 7f690b7fe640 1 -- 172.21.15.33:0/3626208055 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f68fc017070 con 0x7f6914071f80 2024-05-08T10:55:21.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.214+0000 7f690b7fe640 1 --2- 172.21.15.33:0/3626208055 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f68f406b4d0 0x7f68f406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:21.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.215+0000 7f690b7fe640 1 -- 172.21.15.33:0/3626208055 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f68fc089ac0 con 0x7f6914071f80 2024-05-08T10:55:21.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.215+0000 7f6912ffd640 1 --2- 172.21.15.33:0/3626208055 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f68f406b4d0 0x7f68f406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:21.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.215+0000 7f6912ffd640 1 --2- 172.21.15.33:0/3626208055 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f68f406b4d0 0x7f68f406d990 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f690c009fd0 tx=0x7f690c00d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:21.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.218+0000 7f690b7fe640 1 -- 172.21.15.33:0/3626208055 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f68fc058380 con 0x7f6914071f80 2024-05-08T10:55:21.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.399+0000 7f691964d640 1 -- 172.21.15.33:0/3626208055 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6914151bc0 con 0x7f6914071f80 2024-05-08T10:55:21.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.400+0000 7f690b7fe640 1 -- 172.21.15.33:0/3626208055 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16617 (secure 0 0 0) 0x7f68fc05c420 con 0x7f6914071f80 2024-05-08T10:55:21.398 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:55:21.398 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":20,"fsid":"963217b2-c375-4f5a-95cf-88e199dd38ff","created":"2024-05-08T10:54:26.711528+0000","modified":"2024-05-08T10:54:51.528856+0000","last_up_change":"2024-05-08T10:54:37.987478+0000","last_in_change":"2024-05-08T10:54:28.834106+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T10:54:38.989228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T10:54:47.774236+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T10:54:48.869679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c5da4fb5-d4f2-4982-a804-2aa92fe77731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3990629207},{"type":"v1","addr":"172.21.15.33:6817","nonce":3990629207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3990629207},{"type":"v1","addr":"172.21.15.33:6819","nonce":3990629207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3990629207},{"type":"v1","addr":"172.21.15.33:6823","nonce":3990629207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3990629207},{"type":"v1","addr":"172.21.15.33:6821","nonce":3990629207}]},"public_addr":"172.21.15.33:6817/3990629207","cluster_addr":"172.21.15.33:6819/3990629207","heartbeat_back_addr":"172.21.15.33:6823/3990629207","heartbeat_front_addr":"172.21.15.33:6821/3990629207","state":["exists","up"]},{"osd":1,"uuid":"f8fdd8db-c2a3-4d28-81f3-b30f44bea7c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":1758076090},{"type":"v1","addr":"172.21.15.33:6825","nonce":1758076090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":1758076090},{"type":"v1","addr":"172.21.15.33:6827","nonce":1758076090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":1758076090},{"type":"v1","addr":"172.21.15.33:6831","nonce":1758076090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":1758076090},{"type":"v1","addr":"172.21.15.33:6829","nonce":1758076090}]},"public_addr":"172.21.15.33:6825/1758076090","cluster_addr":"172.21.15.33:6827/1758076090","heartbeat_back_addr":"172.21.15.33:6831/1758076090","heartbeat_front_addr":"172.21.15.33:6829/1758076090","state":["exists","up"]},{"osd":2,"uuid":"87d465f3-b40f-48dd-bae2-4c67904d4828","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":2940853479},{"type":"v1","addr":"172.21.15.33:6801","nonce":2940853479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6803","nonce":2940853479},{"type":"v1","addr":"172.21.15.33:6805","nonce":2940853479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6811","nonce":2940853479},{"type":"v1","addr":"172.21.15.33:6813","nonce":2940853479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6807","nonce":2940853479},{"type":"v1","addr":"172.21.15.33:6809","nonce":2940853479}]},"public_addr":"172.21.15.33:6801/2940853479","cluster_addr":"172.21.15.33:6805/2940853479","heartbeat_back_addr":"172.21.15.33:6813/2940853479","heartbeat_front_addr":"172.21.15.33:6809/2940853479","state":["exists","up"]},{"osd":3,"uuid":"79450edf-9637-4181-9372-e1cd5e91e73e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":4029047077},{"type":"v1","addr":"172.21.15.33:6804","nonce":4029047077}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":4029047077},{"type":"v1","addr":"172.21.15.33:6808","nonce":4029047077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":4029047077},{"type":"v1","addr":"172.21.15.33:6815","nonce":4029047077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":4029047077},{"type":"v1","addr":"172.21.15.33:6812","nonce":4029047077}]},"public_addr":"172.21.15.33:6804/4029047077","cluster_addr":"172.21.15.33:6808/4029047077","heartbeat_back_addr":"172.21.15.33:6815/4029047077","heartbeat_front_addr":"172.21.15.33:6812/4029047077","state":["exists","up"]},{"osd":4,"uuid":"bd0debfa-e559-4b1e-920d-6b2639c7085e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":1697399220},{"type":"v1","addr":"172.21.15.174:6801","nonce":1697399220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":1697399220},{"type":"v1","addr":"172.21.15.174:6803","nonce":1697399220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":1697399220},{"type":"v1","addr":"172.21.15.174:6807","nonce":1697399220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":1697399220},{"type":"v1","addr":"172.21.15.174:6805","nonce":1697399220}]},"public_addr":"172.21.15.174:6801/1697399220","cluster_addr":"172.21.15.174:6803/1697399220","heartbeat_back_addr":"172.21.15.174:6807/1697399220","heartbeat_front_addr":"172.21.15.174:6805/1697399220","state":["exists","up"]},{"osd":5,"uuid":"ff0f51c0-672b-448f-9de1-b9305ce8c00d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":1511860729},{"type":"v1","addr":"172.21.15.174:6825","nonce":1511860729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":1511860729},{"type":"v1","addr":"172.21.15.174:6827","nonce":1511860729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":1511860729},{"type":"v1","addr":"172.21.15.174:6831","nonce":1511860729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":1511860729},{"type":"v1","addr":"172.21.15.174:6829","nonce":1511860729}]},"public_addr":"172.21.15.174:6825/1511860729","cluster_addr":"172.21.15.174:6827/1511860729","heartbeat_back_addr":"172.21.15.174:6831/1511860729","heartbeat_front_addr":"172.21.15.174:6829/1511860729","state":["exists","up"]},{"osd":6,"uuid":"93061f6c-c0ce-47e9-88a0-1151c5ccb4e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":2326407945},{"type":"v1","addr":"172.21.15.174:6817","nonce":2326407945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":2326407945},{"type":"v1","addr":"172.21.15.174:6819","nonce":2326407945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":2326407945},{"type":"v1","addr":"172.21.15.174:6823","nonce":2326407945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":2326407945},{"type":"v1","addr":"172.21.15.174:6821","nonce":2326407945}]},"public_addr":"172.21.15.174:6817/2326407945","cluster_addr":"172.21.15.174:6819/2326407945","heartbeat_back_addr":"172.21.15.174:6823/2326407945","heartbeat_front_addr":"172.21.15.174:6821/2326407945","state":["exists","up"]},{"osd":7,"uuid":"7be1dcf3-1957-4ec3-bacf-f5f9fff580a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":1637570253},{"type":"v1","addr":"172.21.15.174:6809","nonce":1637570253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":1637570253},{"type":"v1","addr":"172.21.15.174:6811","nonce":1637570253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":1637570253},{"type":"v1","addr":"172.21.15.174:6815","nonce":1637570253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":1637570253},{"type":"v1","addr":"172.21.15.174:6813","nonce":1637570253}]},"public_addr":"172.21.15.174:6809/1637570253","cluster_addr":"172.21.15.174:6811/1637570253","heartbeat_back_addr":"172.21.15.174:6815/1637570253","heartbeat_front_addr":"172.21.15.174:6813/1637570253","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:33.997709+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:34.016568+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:33.990484+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:33.980666+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:33.920609+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:34.005069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:34.018345+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:34.061646+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T10:55:21.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.402+0000 7f691964d640 1 -- 172.21.15.33:0/3626208055 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f68f406b4d0 msgr2=0x7f68f406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:21.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.402+0000 7f691964d640 1 --2- 172.21.15.33:0/3626208055 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f68f406b4d0 0x7f68f406d990 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f690c009fd0 tx=0x7f690c00d040 comp rx=0 tx=0).stop 2024-05-08T10:55:21.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.402+0000 7f691964d640 1 -- 172.21.15.33:0/3626208055 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6914071f80 msgr2=0x7f69140b46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:21.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.402+0000 7f691964d640 1 --2- 172.21.15.33:0/3626208055 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6914071f80 0x7f69140b46a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f68fc00b4a0 tx=0x7f68fc00b960 comp rx=0 tx=0).stop 2024-05-08T10:55:21.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.402+0000 7f691964d640 1 -- 172.21.15.33:0/3626208055 shutdown_connections 2024-05-08T10:55:21.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.402+0000 7f691964d640 1 --2- 172.21.15.33:0/3626208055 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f68f406b4d0 0x7f68f406d990 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:21.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.402+0000 7f691964d640 1 --2- 172.21.15.33:0/3626208055 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f691415dfb0 0x7f69140b4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:21.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.402+0000 7f691964d640 1 --2- 172.21.15.33:0/3626208055 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6914071f80 0x7f69140b46a0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:21.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.402+0000 7f691964d640 1 --2- 172.21.15.33:0/3626208055 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f691406b2b0 0x7f69141507f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:21.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.402+0000 7f691964d640 1 -- 172.21.15.33:0/3626208055 >> 172.21.15.33:0/3626208055 conn(0x7f69140d08b0 msgr2=0x7f691406aba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:21.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.402+0000 7f691964d640 1 -- 172.21.15.33:0/3626208055 shutdown_connections 2024-05-08T10:55:21.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.402+0000 7f691964d640 1 -- 172.21.15.33:0/3626208055 wait complete. 2024-05-08T10:55:21.411 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-08T10:55:21.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.518+0000 7f4b3184a640 1 Processor -- start 2024-05-08T10:55:21.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.518+0000 7f4b3184a640 1 -- start start 2024-05-08T10:55:21.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.519+0000 7f4b3184a640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f4b2c15e020 0x7f4b2c0b4770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:21.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.519+0000 7f4b3184a640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4b2c15e400 0x7f4b2c0d0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:21.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.519+0000 7f4b3184a640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f4b2c0d09a0 0x7f4b2c0d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:21.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.519+0000 7f4b3184a640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b2c0d4730 con 0x7f4b2c0d09a0 2024-05-08T10:55:21.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.519+0000 7f4b3184a640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b2c0d1d20 con 0x7f4b2c15e020 2024-05-08T10:55:21.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.519+0000 7f4b3184a640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2c0ceac0 con 0x7f4b2c15e400 2024-05-08T10:55:21.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.519+0000 7f4b2b7fe640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f4b2c0d09a0 0x7f4b2c0d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:21.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.519+0000 7f4b2b7fe640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f4b2c0d09a0 0x7f4b2c0d0df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58288/0 (socket says 172.21.15.33:58288) 2024-05-08T10:55:21.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.519+0000 7f4b2b7fe640 1 -- 172.21.15.33:0/747489078 learned_addr learned my addr 172.21.15.33:0/747489078 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:21.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.520+0000 7f4b2a7fc640 1 --2- 172.21.15.33:0/747489078 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4b2c15e400 0x7f4b2c0d0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:21.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.520+0000 7f4b2affd640 1 --2- 172.21.15.33:0/747489078 >> v2:172.21.15.174:3300/0 conn(0x7f4b2c15e020 0x7f4b2c0b4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:21.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.520+0000 7f4b2b7fe640 1 -- 172.21.15.33:0/747489078 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4b2c15e400 msgr2=0x7f4b2c0d0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:21.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.520+0000 7f4b2b7fe640 1 --2- 172.21.15.33:0/747489078 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4b2c15e400 0x7f4b2c0d0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:21.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.520+0000 7f4b2b7fe640 1 -- 172.21.15.33:0/747489078 >> v2:172.21.15.174:3300/0 conn(0x7f4b2c15e020 msgr2=0x7f4b2c0b4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:21.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.520+0000 7f4b2b7fe640 1 --2- 172.21.15.33:0/747489078 >> v2:172.21.15.174:3300/0 conn(0x7f4b2c15e020 0x7f4b2c0b4770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:21.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.520+0000 7f4b2b7fe640 1 -- 172.21.15.33:0/747489078 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b2c0d2000 con 0x7f4b2c0d09a0 2024-05-08T10:55:21.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.520+0000 7f4b2b7fe640 1 --2- 172.21.15.33:0/747489078 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b2c0d09a0 0x7f4b2c0d0df0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c08c780 tx=0x7f4b2402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=991c217e2747d2aa server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:21.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.521+0000 7f4b29ffb640 1 -- 172.21.15.33:0/747489078 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b24036070 con 0x7f4b2c0d09a0 2024-05-08T10:55:21.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.521+0000 7f4b29ffb640 1 -- 172.21.15.33:0/747489078 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b24031600 con 0x7f4b2c0d09a0 2024-05-08T10:55:21.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.521+0000 7f4b29ffb640 1 -- 172.21.15.33:0/747489078 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b240319d0 con 0x7f4b2c0d09a0 2024-05-08T10:55:21.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.521+0000 7f4b3184a640 1 -- 172.21.15.33:0/747489078 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b2c0d09a0 msgr2=0x7f4b2c0d0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:21.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.521+0000 7f4b3184a640 1 --2- 172.21.15.33:0/747489078 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b2c0d09a0 0x7f4b2c0d0df0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c08c780 tx=0x7f4b2402a6a0 comp rx=0 tx=0).stop 2024-05-08T10:55:21.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.521+0000 7f4b3184a640 1 -- 172.21.15.33:0/747489078 shutdown_connections 2024-05-08T10:55:21.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.521+0000 7f4b3184a640 1 --2- 172.21.15.33:0/747489078 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b2c0d09a0 0x7f4b2c0d0df0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:21.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.521+0000 7f4b3184a640 1 --2- 172.21.15.33:0/747489078 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4b2c15e400 0x7f4b2c0d0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:21.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.521+0000 7f4b3184a640 1 --2- 172.21.15.33:0/747489078 >> v2:172.21.15.174:3300/0 conn(0x7f4b2c15e020 0x7f4b2c0b4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:21.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.521+0000 7f4b3184a640 1 -- 172.21.15.33:0/747489078 >> 172.21.15.33:0/747489078 conn(0x7f4b2c0d3b70 msgr2=0x7f4b2c0d3f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:21.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.521+0000 7f4b3184a640 1 -- 172.21.15.33:0/747489078 shutdown_connections 2024-05-08T10:55:21.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.521+0000 7f4b3184a640 1 -- 172.21.15.33:0/747489078 wait complete. 2024-05-08T10:55:21.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.522+0000 7f4b3184a640 1 Processor -- start 2024-05-08T10:55:21.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.523+0000 7f4b3184a640 1 -- start start 2024-05-08T10:55:21.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.523+0000 7f4b3184a640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4b2c0d09a0 0x7f4b2c14ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:21.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.523+0000 7f4b3184a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b2c15e020 0x7f4b2c0b89f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:21.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.523+0000 7f4b3184a640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4b2c15e400 0x7f4b2c0b8f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:21.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.523+0000 7f4b3184a640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2c161d40 con 0x7f4b2c15e020 2024-05-08T10:55:21.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.523+0000 7f4b3184a640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2c0d49d0 con 0x7f4b2c15e400 2024-05-08T10:55:21.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.523+0000 7f4b3184a640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2c161ec0 con 0x7f4b2c0d09a0 2024-05-08T10:55:21.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.523+0000 7f4b2a7fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b2c15e020 0x7f4b2c0b89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:21.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.523+0000 7f4b2a7fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b2c15e020 0x7f4b2c0b89f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58296/0 (socket says 172.21.15.33:58296) 2024-05-08T10:55:21.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.523+0000 7f4b2a7fc640 1 -- 172.21.15.33:0/2283645076 learned_addr learned my addr 172.21.15.33:0/2283645076 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:21.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.523+0000 7f4b2affd640 1 --2- 172.21.15.33:0/2283645076 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4b2c0d09a0 0x7f4b2c14ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:21.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.524+0000 7f4b2b7fe640 1 --2- 172.21.15.33:0/2283645076 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4b2c15e400 0x7f4b2c0b8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:21.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.524+0000 7f4b2a7fc640 1 -- 172.21.15.33:0/2283645076 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4b2c0d09a0 msgr2=0x7f4b2c14ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:21.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.524+0000 7f4b2a7fc640 1 --2- 172.21.15.33:0/2283645076 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4b2c0d09a0 0x7f4b2c14ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:21.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.524+0000 7f4b2a7fc640 1 -- 172.21.15.33:0/2283645076 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4b2c15e400 msgr2=0x7f4b2c0b8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:21.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.524+0000 7f4b2a7fc640 1 --2- 172.21.15.33:0/2283645076 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4b2c15e400 0x7f4b2c0b8f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:21.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.524+0000 7f4b2a7fc640 1 -- 172.21.15.33:0/2283645076 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b2c0cac40 con 0x7f4b2c15e020 2024-05-08T10:55:21.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.524+0000 7f4b2a7fc640 1 --2- 172.21.15.33:0/2283645076 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b2c15e020 0x7f4b2c0b89f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f4b1400d5f0 tx=0x7f4b1400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:21.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.524+0000 7f4b23fff640 1 -- 172.21.15.33:0/2283645076 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b140125f0 con 0x7f4b2c15e020 2024-05-08T10:55:21.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.524+0000 7f4b23fff640 1 -- 172.21.15.33:0/2283645076 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b14019070 con 0x7f4b2c15e020 2024-05-08T10:55:21.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.524+0000 7f4b3184a640 1 -- 172.21.15.33:0/2283645076 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b2c0caf20 con 0x7f4b2c15e020 2024-05-08T10:55:21.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.524+0000 7f4b23fff640 1 -- 172.21.15.33:0/2283645076 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b140129d0 con 0x7f4b2c15e020 2024-05-08T10:55:21.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.524+0000 7f4b3184a640 1 -- 172.21.15.33:0/2283645076 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b2c0cb4e0 con 0x7f4b2c15e020 2024-05-08T10:55:21.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.525+0000 7f4b3184a640 1 -- 172.21.15.33:0/2283645076 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b2c0b3dd0 con 0x7f4b2c15e020 2024-05-08T10:55:21.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.526+0000 7f4b23fff640 1 -- 172.21.15.33:0/2283645076 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4b14012b70 con 0x7f4b2c15e020 2024-05-08T10:55:21.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.526+0000 7f4b23fff640 1 --2- 172.21.15.33:0/2283645076 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f4b0c06b500 0x7f4b0c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:21.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.526+0000 7f4b23fff640 1 -- 172.21.15.33:0/2283645076 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4b1408a4b0 con 0x7f4b2c15e020 2024-05-08T10:55:21.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.526+0000 7f4b2affd640 1 --2- 172.21.15.33:0/2283645076 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f4b0c06b500 0x7f4b0c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:21.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.527+0000 7f4b2affd640 1 --2- 172.21.15.33:0/2283645076 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f4b0c06b500 0x7f4b0c06d9c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c006fd0 tx=0x7f4b1c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:21.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.531+0000 7f4b23fff640 1 -- 172.21.15.33:0/2283645076 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4b2c0b3dd0 con 0x7f4b2c15e020 2024-05-08T10:55:21.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.750+0000 7f4b3184a640 1 -- 172.21.15.33:0/2283645076 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f4b2c161850 con 0x7f4b2c15e020 2024-05-08T10:55:21.747 INFO:tasks.ceph.mon.a.smithi033.stderr:2024-05-08T10:55:21.750+0000 7fe618144640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-08T10:55:21.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.752+0000 7f4b23fff640 1 -- 172.21.15.33:0/2283645076 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v8) v1 ==== 161+0+0 (secure 0 0 0) 0x7f4b14058ce0 con 0x7f4b2c15e020 2024-05-08T10:55:21.749 INFO:teuthology.orchestra.run.smithi033.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-08T10:55:21.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.754+0000 7f4b3184a640 1 -- 172.21.15.33:0/2283645076 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f4b0c06b500 msgr2=0x7f4b0c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:21.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.754+0000 7f4b3184a640 1 --2- 172.21.15.33:0/2283645076 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f4b0c06b500 0x7f4b0c06d9c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c006fd0 tx=0x7f4b1c008040 comp rx=0 tx=0).stop 2024-05-08T10:55:21.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.754+0000 7f4b3184a640 1 -- 172.21.15.33:0/2283645076 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b2c15e020 msgr2=0x7f4b2c0b89f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:21.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.754+0000 7f4b3184a640 1 --2- 172.21.15.33:0/2283645076 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b2c15e020 0x7f4b2c0b89f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f4b1400d5f0 tx=0x7f4b1400dab0 comp rx=0 tx=0).stop 2024-05-08T10:55:21.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.754+0000 7f4b3184a640 1 -- 172.21.15.33:0/2283645076 shutdown_connections 2024-05-08T10:55:21.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.754+0000 7f4b3184a640 1 --2- 172.21.15.33:0/2283645076 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f4b0c06b500 0x7f4b0c06d9c0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:21.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.754+0000 7f4b3184a640 1 --2- 172.21.15.33:0/2283645076 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4b2c15e400 0x7f4b2c0b8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:21.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.754+0000 7f4b3184a640 1 --2- 172.21.15.33:0/2283645076 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b2c15e020 0x7f4b2c0b89f0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:21.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.754+0000 7f4b3184a640 1 --2- 172.21.15.33:0/2283645076 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4b2c0d09a0 0x7f4b2c14ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:21.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.754+0000 7f4b3184a640 1 -- 172.21.15.33:0/2283645076 >> 172.21.15.33:0/2283645076 conn(0x7f4b2c0d3b70 msgr2=0x7f4b2c0b5660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:21.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.754+0000 7f4b3184a640 1 -- 172.21.15.33:0/2283645076 shutdown_connections 2024-05-08T10:55:21.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.754+0000 7f4b3184a640 1 -- 172.21.15.33:0/2283645076 wait complete. 2024-05-08T10:55:21.755 INFO:tasks.ceph.mds.b.smithi174.stderr: -6441> 2024-05-08T10:54:56.499+0000 7f4bfdda5640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-08T10:55:21.763 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-08T10:55:21.787 INFO:tasks.ceph.mds.b.smithi174.stdout:starting mds.b at 2024-05-08T10:55:21.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.873+0000 7f622823f640 1 Processor -- start 2024-05-08T10:55:21.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.873+0000 7f622823f640 1 -- start start 2024-05-08T10:55:21.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.874+0000 7f622823f640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6220143e30 0x7f6220144400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:21.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.874+0000 7f622823f640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f62200b1f20 0x7f62200703c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:21.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.874+0000 7f622823f640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6220144210 con 0x7f62200ce820 2024-05-08T10:55:21.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.874+0000 7f622823f640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f622015c0d0 con 0x7f62200b1f20 2024-05-08T10:55:21.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.874+0000 7f622823f640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f622015b4c0 con 0x7f6220143e30 2024-05-08T10:55:21.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.874+0000 7f62257da640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f62200b1f20 0x7f62200703c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:21.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.874+0000 7f62267dc640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f62200ce820 0x7f622015e9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:53158/0 (socket says 172.21.15.33:53158) 2024-05-08T10:55:21.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.874+0000 7f62267dc640 1 -- 172.21.15.33:0/4175366231 learned_addr learned my addr 172.21.15.33:0/4175366231 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-05-08T10:55:21.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.874+0000 7f6225fdb640 1 --2- 172.21.15.33:0/4175366231 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6220143e30 0x7f6220144400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:21.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.874+0000 7f62257da640 1 -- 172.21.15.33:0/4175366231 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6220143e30 msgr2=0x7f6220144400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:21.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.874+0000 7f62257da640 1 --2- 172.21.15.33:0/4175366231 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6220143e30 0x7f6220144400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:21.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.874+0000 7f62257da640 1 -- 172.21.15.33:0/4175366231 >> v1:172.21.15.33:6789/0 conn(0x7f62200ce820 legacy=0x7f622015e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:21.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.874+0000 7f62257da640 1 -- 172.21.15.33:0/4175366231 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f622015b7a0 con 0x7f62200b1f20 2024-05-08T10:55:21.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.874+0000 7f6224fd9640 1 -- 172.21.15.33:0/4175366231 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 395784982 0 0) 0x7f6220144210 con 0x7f62200ce820 2024-05-08T10:55:21.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.874+0000 7f6225fdb640 1 --2- 172.21.15.33:0/4175366231 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6220143e30 0x7f6220144400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:55:21.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.875+0000 7f62257da640 1 --2- 172.21.15.33:0/4175366231 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62200b1f20 0x7f62200703c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f62100097a0 tx=0x7f621002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2901f991dd7d5b3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:21.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.875+0000 7f6224fd9640 1 -- 172.21.15.33:0/4175366231 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6210037070 con 0x7f62200b1f20 2024-05-08T10:55:21.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.875+0000 7f6224fd9640 1 -- 172.21.15.33:0/4175366231 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6210032440 con 0x7f62200b1f20 2024-05-08T10:55:21.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.875+0000 7f6224fd9640 1 -- 172.21.15.33:0/4175366231 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6210032810 con 0x7f62200b1f20 2024-05-08T10:55:21.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.876+0000 7f622823f640 1 -- 172.21.15.33:0/4175366231 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62200b1f20 msgr2=0x7f62200703c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:21.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.876+0000 7f622823f640 1 --2- 172.21.15.33:0/4175366231 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62200b1f20 0x7f62200703c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f62100097a0 tx=0x7f621002a180 comp rx=0 tx=0).stop 2024-05-08T10:55:21.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.876+0000 7f622823f640 1 -- 172.21.15.33:0/4175366231 shutdown_connections 2024-05-08T10:55:21.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.876+0000 7f622823f640 1 --2- 172.21.15.33:0/4175366231 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62200b1f20 0x7f62200703c0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:21.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.876+0000 7f622823f640 1 --2- 172.21.15.33:0/4175366231 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6220143e30 0x7f6220144400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:21.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.876+0000 7f622823f640 1 -- 172.21.15.33:0/4175366231 >> 172.21.15.33:0/4175366231 conn(0x7f62200b1400 msgr2=0x7f62200b1810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:21.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.876+0000 7f622823f640 1 -- 172.21.15.33:0/4175366231 shutdown_connections 2024-05-08T10:55:21.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.876+0000 7f622823f640 1 -- 172.21.15.33:0/4175366231 wait complete. 2024-05-08T10:55:21.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.877+0000 7f622823f640 1 Processor -- start 2024-05-08T10:55:21.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.877+0000 7f622823f640 1 -- start start 2024-05-08T10:55:21.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.878+0000 7f622823f640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62200b1f20 0x7f62201f2f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:21.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.878+0000 7f622823f640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f62200ce820 0x7f62200aa480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:21.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.878+0000 7f622823f640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6220143e30 0x7f62200aa9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:21.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.878+0000 7f622823f640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f622015b1b0 con 0x7f62200b1f20 2024-05-08T10:55:21.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.878+0000 7f622823f640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f622015bd60 con 0x7f62200ce820 2024-05-08T10:55:21.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.878+0000 7f622823f640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62200cec70 con 0x7f6220143e30 2024-05-08T10:55:21.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.878+0000 7f6225fdb640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62200b1f20 0x7f62201f2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:21.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.878+0000 7f6225fdb640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62200b1f20 0x7f62201f2f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58312/0 (socket says 172.21.15.33:58312) 2024-05-08T10:55:21.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.878+0000 7f6225fdb640 1 -- 172.21.15.33:0/458469681 learned_addr learned my addr 172.21.15.33:0/458469681 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:21.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.878+0000 7f62257da640 1 --2- 172.21.15.33:0/458469681 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f62200ce820 0x7f62200aa480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:21.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.878+0000 7f62267dc640 1 --2- 172.21.15.33:0/458469681 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6220143e30 0x7f62200aa9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:21.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.878+0000 7f6225fdb640 1 -- 172.21.15.33:0/458469681 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6220143e30 msgr2=0x7f62200aa9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:21.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.878+0000 7f6225fdb640 1 --2- 172.21.15.33:0/458469681 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6220143e30 0x7f62200aa9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:21.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.878+0000 7f6225fdb640 1 -- 172.21.15.33:0/458469681 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f62200ce820 msgr2=0x7f62200aa480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:21.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.878+0000 7f6225fdb640 1 --2- 172.21.15.33:0/458469681 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f62200ce820 0x7f62200aa480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:21.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.878+0000 7f6225fdb640 1 -- 172.21.15.33:0/458469681 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f622006d000 con 0x7f62200b1f20 2024-05-08T10:55:21.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.878+0000 7f62267dc640 1 --2- 172.21.15.33:0/458469681 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6220143e30 0x7f62200aa9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:55:21.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.879+0000 7f6225fdb640 1 --2- 172.21.15.33:0/458469681 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62200b1f20 0x7f62201f2f80 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f621c00d7d0 tx=0x7f621c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:21.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.879+0000 7f62167fc640 1 -- 172.21.15.33:0/458469681 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f621c004030 con 0x7f62200b1f20 2024-05-08T10:55:21.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.879+0000 7f62167fc640 1 -- 172.21.15.33:0/458469681 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f621c0041d0 con 0x7f62200b1f20 2024-05-08T10:55:21.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.879+0000 7f62167fc640 1 -- 172.21.15.33:0/458469681 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f621c0096a0 con 0x7f62200b1f20 2024-05-08T10:55:21.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.879+0000 7f622823f640 1 -- 172.21.15.33:0/458469681 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f622006d2e0 con 0x7f62200b1f20 2024-05-08T10:55:21.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.879+0000 7f622823f640 1 -- 172.21.15.33:0/458469681 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f622006d8a0 con 0x7f62200b1f20 2024-05-08T10:55:21.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.880+0000 7f622823f640 1 -- 172.21.15.33:0/458469681 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6220069d20 con 0x7f62200b1f20 2024-05-08T10:55:21.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.880+0000 7f62167fc640 1 -- 172.21.15.33:0/458469681 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f621c009840 con 0x7f62200b1f20 2024-05-08T10:55:21.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.881+0000 7f62167fc640 1 --2- 172.21.15.33:0/458469681 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f620406b4d0 0x7f620406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:21.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.881+0000 7f62167fc640 1 -- 172.21.15.33:0/458469681 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f621c08a420 con 0x7f62200b1f20 2024-05-08T10:55:21.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.881+0000 7f62257da640 1 --2- 172.21.15.33:0/458469681 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f620406b4d0 0x7f620406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:21.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.881+0000 7f62257da640 1 --2- 172.21.15.33:0/458469681 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f620406b4d0 0x7f620406d990 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6210034000 tx=0x7f621002e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:21.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:21.885+0000 7f62167fc640 1 -- 172.21.15.33:0/458469681 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f621c0592d0 con 0x7f62200b1f20 2024-05-08T10:55:22.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:22.104+0000 7f622823f640 1 -- 172.21.15.33:0/458469681 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f622006e540 con 0x7f62200b1f20 2024-05-08T10:55:22.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:22.753+0000 7f62167fc640 1 -- 172.21.15.33:0/458469681 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v9) v1 ==== 104+0+0 (secure 0 0 0) 0x7f621c058bd0 con 0x7f62200b1f20 2024-05-08T10:55:22.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:22.756+0000 7f622823f640 1 -- 172.21.15.33:0/458469681 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f620406b4d0 msgr2=0x7f620406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:22.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:22.756+0000 7f622823f640 1 --2- 172.21.15.33:0/458469681 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f620406b4d0 0x7f620406d990 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6210034000 tx=0x7f621002e000 comp rx=0 tx=0).stop 2024-05-08T10:55:22.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:22.756+0000 7f622823f640 1 -- 172.21.15.33:0/458469681 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62200b1f20 msgr2=0x7f62201f2f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:22.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:22.756+0000 7f622823f640 1 --2- 172.21.15.33:0/458469681 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62200b1f20 0x7f62201f2f80 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f621c00d7d0 tx=0x7f621c00dc90 comp rx=0 tx=0).stop 2024-05-08T10:55:22.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:22.756+0000 7f622823f640 1 -- 172.21.15.33:0/458469681 shutdown_connections 2024-05-08T10:55:22.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:22.756+0000 7f622823f640 1 --2- 172.21.15.33:0/458469681 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f620406b4d0 0x7f620406d990 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:22.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:22.756+0000 7f622823f640 1 --2- 172.21.15.33:0/458469681 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6220143e30 0x7f62200aa9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:22.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:22.756+0000 7f622823f640 1 --2- 172.21.15.33:0/458469681 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f62200ce820 0x7f62200aa480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:22.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:22.756+0000 7f622823f640 1 --2- 172.21.15.33:0/458469681 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62200b1f20 0x7f62201f2f80 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:22.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:22.756+0000 7f622823f640 1 -- 172.21.15.33:0/458469681 >> 172.21.15.33:0/458469681 conn(0x7f62200b1400 msgr2=0x7f62200b30f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:22.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:22.756+0000 7f622823f640 1 -- 172.21.15.33:0/458469681 shutdown_connections 2024-05-08T10:55:22.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:22.756+0000 7f622823f640 1 -- 172.21.15.33:0/458469681 wait complete. 2024-05-08T10:55:22.767 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-08T10:55:22.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:22.882+0000 7fe2b9858640 1 Processor -- start 2024-05-08T10:55:22.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:22.882+0000 7fe2b9858640 1 -- start start 2024-05-08T10:55:22.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:22.882+0000 7fe2b9858640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2b415de60 0x7fe2b40ce6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:22.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:22.882+0000 7fe2b9858640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2b40d1be0 con 0x7fe2b40d2840 2024-05-08T10:55:22.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:22.882+0000 7fe2b9858640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2b40ced40 con 0x7fe2b40d45f0 2024-05-08T10:55:22.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:22.882+0000 7fe2b9858640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b40cf020 con 0x7fe2b415de60 2024-05-08T10:55:22.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:22.883+0000 7fe2b37fe640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fe2b40d2840 0x7fe2b40d0310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:53168/0 (socket says 172.21.15.33:53168) 2024-05-08T10:55:22.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:22.883+0000 7fe2b37fe640 1 -- 172.21.15.33:0/647269403 learned_addr learned my addr 172.21.15.33:0/647269403 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-05-08T10:55:22.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:22.883+0000 7fe2b2ffd640 1 --2- 172.21.15.33:0/647269403 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2b415de60 0x7fe2b40ce6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:22.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:22.883+0000 7fe2b1ffb640 1 -- 172.21.15.33:0/647269403 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1601060270 0 0) 0x7fe2b40d1be0 con 0x7fe2b40d2840 2024-05-08T10:55:22.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:22.883+0000 7fe2b1ffb640 1 -- 172.21.15.33:0/647269403 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe29c003520 con 0x7fe2b40d2840 2024-05-08T10:55:22.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:22.883+0000 7fe2b1ffb640 1 -- 172.21.15.33:0/647269403 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 111092162 0 0) 0x7fe2b40ced40 con 0x7fe2b40d45f0 2024-05-08T10:55:22.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:22.883+0000 7fe2b1ffb640 1 -- 172.21.15.33:0/647269403 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2b40d1be0 con 0x7fe2b40d45f0 2024-05-08T10:55:22.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:22.883+0000 7fe2b1ffb640 1 -- 172.21.15.33:0/647269403 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 573272845 0 0) 0x7fe29c003520 con 0x7fe2b40d2840 2024-05-08T10:55:22.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:22.883+0000 7fe2b1ffb640 1 -- 172.21.15.33:0/647269403 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2b415de60 msgr2=0x7fe2b40ce6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:22.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:22.883+0000 7fe2b1ffb640 1 --2- 172.21.15.33:0/647269403 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2b415de60 0x7fe2b40ce6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:22.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:22.883+0000 7fe2b1ffb640 1 -- 172.21.15.33:0/647269403 >> v1:172.21.15.174:6789/0 conn(0x7fe2b40d45f0 legacy=0x7fe2b40d2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:22.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:22.883+0000 7fe2b1ffb640 1 -- 172.21.15.33:0/647269403 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2b40cf300 con 0x7fe2b40d2840 2024-05-08T10:55:22.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:22.883+0000 7fe2b1ffb640 1 -- 172.21.15.33:0/647269403 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2948294915 0 0) 0x7fe2ac0019f0 con 0x7fe2b40d2840 2024-05-08T10:55:22.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:22.883+0000 7fe2b1ffb640 1 -- 172.21.15.33:0/647269403 >> v1:172.21.15.33:6789/0 conn(0x7fe2b40d2840 legacy=0x7fe2b40d0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:22.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:22.883+0000 7fe2b1ffb640 1 --2- 172.21.15.33:0/647269403 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe29c003b70 0x7fe29c003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:22.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:22.883+0000 7fe2b1ffb640 1 --2- 172.21.15.33:0/647269403 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2b415de60 0x7fe29c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:22.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:22.883+0000 7fe2b1ffb640 1 --2- 172.21.15.33:0/647269403 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe29c004d40 0x7fe29c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:22.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:22.883+0000 7fe2b1ffb640 1 -- 172.21.15.33:0/647269403 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b40cf020 con 0x7fe29c004d40 2024-05-08T10:55:22.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:22.883+0000 7fe2b1ffb640 1 -- 172.21.15.33:0/647269403 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe29c00ba70 con 0x7fe29c003b70 2024-05-08T10:55:22.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:22.883+0000 7fe2b1ffb640 1 -- 172.21.15.33:0/647269403 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe29c00bc20 con 0x7fe2b415de60 2024-05-08T10:55:22.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:22.883+0000 7fe2b37fe640 1 --2- 172.21.15.33:0/647269403 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe29c004d40 0x7fe29c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:22.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:22.883+0000 7fe2b27fc640 1 --2- 172.21.15.33:0/647269403 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2b415de60 0x7fe29c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:22.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:22.883+0000 7fe2b2ffd640 1 --2- 172.21.15.33:0/647269403 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe29c003b70 0x7fe29c003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:22.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:22.884+0000 7fe2b37fe640 1 -- 172.21.15.33:0/647269403 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2b415de60 msgr2=0x7fe29c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:22.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:22.884+0000 7fe2b37fe640 1 --2- 172.21.15.33:0/647269403 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2b415de60 0x7fe29c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:22.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:22.884+0000 7fe2b37fe640 1 -- 172.21.15.33:0/647269403 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe29c003b70 msgr2=0x7fe29c003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:22.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:22.884+0000 7fe2b37fe640 1 --2- 172.21.15.33:0/647269403 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe29c003b70 0x7fe29c003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:22.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:22.884+0000 7fe2b37fe640 1 -- 172.21.15.33:0/647269403 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe29c003520 con 0x7fe29c004d40 2024-05-08T10:55:22.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:22.884+0000 7fe2b27fc640 1 --2- 172.21.15.33:0/647269403 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2b415de60 0x7fe29c004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T10:55:22.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:22.884+0000 7fe2b2ffd640 1 --2- 172.21.15.33:0/647269403 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe29c003b70 0x7fe29c003f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T10:55:22.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:22.885+0000 7fe2b37fe640 1 --2- 172.21.15.33:0/647269403 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe29c004d40 0x7fe29c0051c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac00a7c0 tx=0x7fe29c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20428381dc85ec52 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:22.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:22.885+0000 7fe2b1ffb640 1 -- 172.21.15.33:0/647269403 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2ac00a410 con 0x7fe29c004d40 2024-05-08T10:55:22.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:22.885+0000 7fe2b1ffb640 1 -- 172.21.15.33:0/647269403 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2ac02f070 con 0x7fe29c004d40 2024-05-08T10:55:22.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:22.885+0000 7fe2b1ffb640 1 -- 172.21.15.33:0/647269403 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2ac02bc20 con 0x7fe29c004d40 2024-05-08T10:55:22.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:22.885+0000 7fe2b9858640 1 -- 172.21.15.33:0/647269403 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe29c004d40 msgr2=0x7fe29c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:22.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:22.885+0000 7fe2b9858640 1 --2- 172.21.15.33:0/647269403 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe29c004d40 0x7fe29c0051c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac00a7c0 tx=0x7fe29c005830 comp rx=0 tx=0).stop 2024-05-08T10:55:22.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:22.885+0000 7fe2b37fe640 1 -- 172.21.15.33:0/647269403 reap_dead start 2024-05-08T10:55:22.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:22.885+0000 7fe2b9858640 1 -- 172.21.15.33:0/647269403 shutdown_connections 2024-05-08T10:55:22.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:22.885+0000 7fe2b9858640 1 -- 172.21.15.33:0/647269403 >> 172.21.15.33:0/647269403 conn(0x7fe2b409cea0 msgr2=0x7fe2b40d3b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:22.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:22.885+0000 7fe2b9858640 1 -- 172.21.15.33:0/647269403 shutdown_connections 2024-05-08T10:55:22.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:22.885+0000 7fe2b9858640 1 -- 172.21.15.33:0/647269403 wait complete. 2024-05-08T10:55:22.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:22.887+0000 7fe2b9858640 1 Processor -- start 2024-05-08T10:55:22.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:22.887+0000 7fe2b9858640 1 -- start start 2024-05-08T10:55:22.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:22.887+0000 7fe2b9858640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2b41f39f0 0x7fe2b4147bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:22.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:22.887+0000 7fe2b9858640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe2b4159400 0x7fe2b41461e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:22.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:22.887+0000 7fe2b9858640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe2b41f3dd0 0x7fe2b4148270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:22.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:22.887+0000 7fe2b9858640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b40d4a10 con 0x7fe2b41f3dd0 2024-05-08T10:55:22.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:22.887+0000 7fe2b9858640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b40cf8c0 con 0x7fe2b4159400 2024-05-08T10:55:22.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:22.887+0000 7fe2b9858640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b415e240 con 0x7fe2b41f39f0 2024-05-08T10:55:22.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:22.888+0000 7fe2b37fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe2b41f3dd0 0x7fe2b4148270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:22.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:22.888+0000 7fe2b37fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe2b41f3dd0 0x7fe2b4148270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58332/0 (socket says 172.21.15.33:58332) 2024-05-08T10:55:22.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:22.888+0000 7fe2b37fe640 1 -- 172.21.15.33:0/2624927890 learned_addr learned my addr 172.21.15.33:0/2624927890 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:22.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:22.888+0000 7fe2b2ffd640 1 --2- 172.21.15.33:0/2624927890 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2b41f39f0 0x7fe2b4147bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:22.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:22.888+0000 7fe2b27fc640 1 --2- 172.21.15.33:0/2624927890 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe2b4159400 0x7fe2b41461e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:22.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:22.888+0000 7fe2b37fe640 1 -- 172.21.15.33:0/2624927890 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2b41f39f0 msgr2=0x7fe2b4147bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:22.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:22.888+0000 7fe2b37fe640 1 --2- 172.21.15.33:0/2624927890 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2b41f39f0 0x7fe2b4147bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:22.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:22.888+0000 7fe2b37fe640 1 -- 172.21.15.33:0/2624927890 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe2b4159400 msgr2=0x7fe2b41461e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:22.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:22.888+0000 7fe2b37fe640 1 --2- 172.21.15.33:0/2624927890 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe2b4159400 0x7fe2b41461e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:22.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:22.888+0000 7fe2b37fe640 1 -- 172.21.15.33:0/2624927890 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2b4146b50 con 0x7fe2b41f3dd0 2024-05-08T10:55:22.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:22.888+0000 7fe2b27fc640 1 --2- 172.21.15.33:0/2624927890 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe2b4159400 0x7fe2b41461e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:55:22.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:22.888+0000 7fe2b37fe640 1 --2- 172.21.15.33:0/2624927890 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe2b41f3dd0 0x7fe2b4148270 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac02b470 tx=0x7fe2ac001d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:22.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:22.888+0000 7fe29bfff640 1 -- 172.21.15.33:0/2624927890 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2a4009690 con 0x7fe2b41f3dd0 2024-05-08T10:55:22.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:22.888+0000 7fe29bfff640 1 -- 172.21.15.33:0/2624927890 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2ac034470 con 0x7fe2b41f3dd0 2024-05-08T10:55:22.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:22.888+0000 7fe2b9858640 1 -- 172.21.15.33:0/2624927890 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2b4146e30 con 0x7fe2b41f3dd0 2024-05-08T10:55:22.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:22.888+0000 7fe29bfff640 1 -- 172.21.15.33:0/2624927890 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2a80014f0 con 0x7fe2b41f3dd0 2024-05-08T10:55:22.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:22.888+0000 7fe2b9858640 1 -- 172.21.15.33:0/2624927890 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2b41473f0 con 0x7fe2b41f3dd0 2024-05-08T10:55:22.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:22.889+0000 7fe2b9858640 1 -- 172.21.15.33:0/2624927890 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2b4069d20 con 0x7fe2b41f3dd0 2024-05-08T10:55:22.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:22.890+0000 7fe29bfff640 1 -- 172.21.15.33:0/2624927890 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe2ac034860 con 0x7fe2b41f3dd0 2024-05-08T10:55:22.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:22.890+0000 7fe29bfff640 1 --2- 172.21.15.33:0/2624927890 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fe2a006b4d0 0x7fe2a006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:22.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:22.890+0000 7fe29bfff640 1 -- 172.21.15.33:0/2624927890 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fe2ac0a9ec0 con 0x7fe2b41f3dd0 2024-05-08T10:55:22.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:22.890+0000 7fe2b2ffd640 1 --2- 172.21.15.33:0/2624927890 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fe2a006b4d0 0x7fe2a006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:22.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:22.891+0000 7fe2b2ffd640 1 --2- 172.21.15.33:0/2624927890 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fe2a006b4d0 0x7fe2a006d990 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe2a4009c00 tx=0x7fe2a4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:22.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:22.894+0000 7fe29bfff640 1 -- 172.21.15.33:0/2624927890 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe2ac046060 con 0x7fe2b41f3dd0 2024-05-08T10:55:23.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:23.075+0000 7fe2b9858640 1 -- 172.21.15.33:0/2624927890 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe2b40b5420 con 0x7fe2b41f3dd0 2024-05-08T10:55:23.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:23.758+0000 7fe29bfff640 1 -- 172.21.15.33:0/2624927890 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v22) v1 ==== 181+0+0 (secure 0 0 0) 0x7fe2ac078ce0 con 0x7fe2b41f3dd0 2024-05-08T10:55:23.755 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_metadata' removed 2024-05-08T10:55:23.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:23.760+0000 7fe2b9858640 1 -- 172.21.15.33:0/2624927890 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fe2a006b4d0 msgr2=0x7fe2a006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:23.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:23.761+0000 7fe2b9858640 1 --2- 172.21.15.33:0/2624927890 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fe2a006b4d0 0x7fe2a006d990 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe2a4009c00 tx=0x7fe2a4008040 comp rx=0 tx=0).stop 2024-05-08T10:55:23.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:23.761+0000 7fe2b9858640 1 -- 172.21.15.33:0/2624927890 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe2b41f3dd0 msgr2=0x7fe2b4148270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:23.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:23.761+0000 7fe2b9858640 1 --2- 172.21.15.33:0/2624927890 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe2b41f3dd0 0x7fe2b4148270 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac02b470 tx=0x7fe2ac001d40 comp rx=0 tx=0).stop 2024-05-08T10:55:23.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:23.761+0000 7fe2b9858640 1 -- 172.21.15.33:0/2624927890 shutdown_connections 2024-05-08T10:55:23.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:23.761+0000 7fe2b9858640 1 --2- 172.21.15.33:0/2624927890 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fe2a006b4d0 0x7fe2a006d990 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:23.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:23.761+0000 7fe2b9858640 1 --2- 172.21.15.33:0/2624927890 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe2b41f3dd0 0x7fe2b4148270 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:23.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:23.761+0000 7fe2b9858640 1 --2- 172.21.15.33:0/2624927890 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe2b4159400 0x7fe2b41461e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:23.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:23.761+0000 7fe2b9858640 1 --2- 172.21.15.33:0/2624927890 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2b41f39f0 0x7fe2b4147bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:23.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:23.761+0000 7fe2b9858640 1 -- 172.21.15.33:0/2624927890 >> 172.21.15.33:0/2624927890 conn(0x7fe2b409cea0 msgr2=0x7fe2b4160bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:23.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:23.761+0000 7fe2b9858640 1 -- 172.21.15.33:0/2624927890 shutdown_connections 2024-05-08T10:55:23.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:23.761+0000 7fe2b9858640 1 -- 172.21.15.33:0/2624927890 wait complete. 2024-05-08T10:55:23.772 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-08T10:55:23.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:23.887+0000 7f84d3245640 1 Processor -- start 2024-05-08T10:55:23.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:23.887+0000 7f84d3245640 1 -- start start 2024-05-08T10:55:23.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:23.888+0000 7f84d3245640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f84cc0aee50 0x7f84cc0b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:23.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:23.888+0000 7f84d3245640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f84cc15ae30 0x7f84cc06c570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:23.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:23.888+0000 7f84d3245640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84cc0aea50 con 0x7f84cc15aa50 2024-05-08T10:55:23.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:23.888+0000 7f84d3245640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84cc0b2be0 con 0x7f84cc0aee50 2024-05-08T10:55:23.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:23.888+0000 7f84d3245640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84cc0b2e30 con 0x7f84cc15ae30 2024-05-08T10:55:23.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:23.888+0000 7f84cbfff640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f84cc0aee50 0x7f84cc0b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:23.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:23.888+0000 7f84cbfff640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f84cc0aee50 0x7f84cc0b20e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58340/0 (socket says 172.21.15.33:58340) 2024-05-08T10:55:23.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:23.888+0000 7f84cbfff640 1 -- 172.21.15.33:0/2035011160 learned_addr learned my addr 172.21.15.33:0/2035011160 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:23.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:23.888+0000 7f84d17e2640 1 --2- 172.21.15.33:0/2035011160 >> v2:172.21.15.174:3300/0 conn(0x7f84cc15ae30 0x7f84cc06c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:23.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:23.888+0000 7f84cbfff640 1 -- 172.21.15.33:0/2035011160 >> v2:172.21.15.174:3300/0 conn(0x7f84cc15ae30 msgr2=0x7f84cc06c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:23.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:23.888+0000 7f84cbfff640 1 --2- 172.21.15.33:0/2035011160 >> v2:172.21.15.174:3300/0 conn(0x7f84cc15ae30 0x7f84cc06c570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:23.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:23.888+0000 7f84cbfff640 1 -- 172.21.15.33:0/2035011160 >> v1:172.21.15.174:6789/0 conn(0x7f84cc15aa50 legacy=0x7f84cc070510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:23.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:23.888+0000 7f84cbfff640 1 -- 172.21.15.33:0/2035011160 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84cc0b3110 con 0x7f84cc0aee50 2024-05-08T10:55:23.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:23.888+0000 7f84d17e2640 1 --2- 172.21.15.33:0/2035011160 >> v2:172.21.15.174:3300/0 conn(0x7f84cc15ae30 0x7f84cc06c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:55:23.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:23.889+0000 7f84cbfff640 1 --2- 172.21.15.33:0/2035011160 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84cc0aee50 0x7f84cc0b20e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f84cc0b2950 tx=0x7f84bc02c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c18e70cdd6fd5d3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:23.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:23.889+0000 7f84cb7fe640 1 -- 172.21.15.33:0/2035011160 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84bc038070 con 0x7f84cc0aee50 2024-05-08T10:55:23.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:23.889+0000 7f84cb7fe640 1 -- 172.21.15.33:0/2035011160 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84bc009600 con 0x7f84cc0aee50 2024-05-08T10:55:23.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:23.889+0000 7f84cb7fe640 1 -- 172.21.15.33:0/2035011160 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84bc0099d0 con 0x7f84cc0aee50 2024-05-08T10:55:23.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:23.890+0000 7f84d3245640 1 -- 172.21.15.33:0/2035011160 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84cc0aee50 msgr2=0x7f84cc0b20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:23.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:23.890+0000 7f84d3245640 1 --2- 172.21.15.33:0/2035011160 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84cc0aee50 0x7f84cc0b20e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f84cc0b2950 tx=0x7f84bc02c7e0 comp rx=0 tx=0).stop 2024-05-08T10:55:23.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:23.890+0000 7f84d3245640 1 -- 172.21.15.33:0/2035011160 shutdown_connections 2024-05-08T10:55:23.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:23.890+0000 7f84d3245640 1 --2- 172.21.15.33:0/2035011160 >> v2:172.21.15.174:3300/0 conn(0x7f84cc15ae30 0x7f84cc06c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:23.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:23.890+0000 7f84d3245640 1 --2- 172.21.15.33:0/2035011160 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84cc0aee50 0x7f84cc0b20e0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:23.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:23.890+0000 7f84d3245640 1 -- 172.21.15.33:0/2035011160 >> 172.21.15.33:0/2035011160 conn(0x7f84cc0b15c0 msgr2=0x7f84cc0b19d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:23.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:23.890+0000 7f84d3245640 1 -- 172.21.15.33:0/2035011160 shutdown_connections 2024-05-08T10:55:23.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:23.890+0000 7f84d3245640 1 -- 172.21.15.33:0/2035011160 wait complete. 2024-05-08T10:55:23.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:23.891+0000 7f84d3245640 1 Processor -- start 2024-05-08T10:55:23.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:23.891+0000 7f84d3245640 1 -- start start 2024-05-08T10:55:23.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:23.892+0000 7f84d3245640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f84cc0aee50 0x7f84cc1e5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:23.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:23.892+0000 7f84d3245640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84cc15aa50 0x7f84cc0b02f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:23.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:23.892+0000 7f84d3245640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f84cc15ae30 0x7f84cc0b0830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:23.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:23.892+0000 7f84d3245640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84cc06cc30 con 0x7f84cc15aa50 2024-05-08T10:55:23.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:23.892+0000 7f84d3245640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84cc06cab0 con 0x7f84cc0aee50 2024-05-08T10:55:23.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:23.892+0000 7f84d3245640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84cc06cdb0 con 0x7f84cc15ae30 2024-05-08T10:55:23.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:23.892+0000 7f84cbfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84cc15aa50 0x7f84cc0b02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:23.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:23.892+0000 7f84cbfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84cc15aa50 0x7f84cc0b02f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58354/0 (socket says 172.21.15.33:58354) 2024-05-08T10:55:23.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:23.892+0000 7f84cbfff640 1 -- 172.21.15.33:0/1955562554 learned_addr learned my addr 172.21.15.33:0/1955562554 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:23.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:23.892+0000 7f84d0fe1640 1 --2- 172.21.15.33:0/1955562554 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f84cc0aee50 0x7f84cc1e5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:23.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:23.892+0000 7f84d17e2640 1 --2- 172.21.15.33:0/1955562554 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f84cc15ae30 0x7f84cc0b0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:23.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:23.892+0000 7f84cbfff640 1 -- 172.21.15.33:0/1955562554 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f84cc15ae30 msgr2=0x7f84cc0b0830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:23.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:23.892+0000 7f84cbfff640 1 --2- 172.21.15.33:0/1955562554 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f84cc15ae30 0x7f84cc0b0830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:23.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:23.892+0000 7f84cbfff640 1 -- 172.21.15.33:0/1955562554 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f84cc0aee50 msgr2=0x7f84cc1e5180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:23.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:23.892+0000 7f84cbfff640 1 --2- 172.21.15.33:0/1955562554 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f84cc0aee50 0x7f84cc1e5180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:23.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:23.892+0000 7f84cbfff640 1 -- 172.21.15.33:0/1955562554 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84cc1e4460 con 0x7f84cc15aa50 2024-05-08T10:55:23.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:23.892+0000 7f84cbfff640 1 --2- 172.21.15.33:0/1955562554 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84cc15aa50 0x7f84cc0b02f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f84bc00d240 tx=0x7f84bc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:23.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:23.893+0000 7f84c97fa640 1 -- 172.21.15.33:0/1955562554 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84bc038050 con 0x7f84cc15aa50 2024-05-08T10:55:23.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:23.893+0000 7f84c97fa640 1 -- 172.21.15.33:0/1955562554 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84bc044070 con 0x7f84cc15aa50 2024-05-08T10:55:23.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:23.893+0000 7f84d3245640 1 -- 172.21.15.33:0/1955562554 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84cc1e4740 con 0x7f84cc15aa50 2024-05-08T10:55:23.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:23.893+0000 7f84c97fa640 1 -- 172.21.15.33:0/1955562554 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84bc03da50 con 0x7f84cc15aa50 2024-05-08T10:55:23.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:23.893+0000 7f84d3245640 1 -- 172.21.15.33:0/1955562554 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84cc153c70 con 0x7f84cc15aa50 2024-05-08T10:55:23.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:23.894+0000 7f84d3245640 1 -- 172.21.15.33:0/1955562554 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84cc069d20 con 0x7f84cc15aa50 2024-05-08T10:55:23.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:23.894+0000 7f84c97fa640 1 -- 172.21.15.33:0/1955562554 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f84bc03dbf0 con 0x7f84cc15aa50 2024-05-08T10:55:23.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:23.895+0000 7f84c97fa640 1 --2- 172.21.15.33:0/1955562554 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f84ac06b500 0x7f84ac06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:23.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:23.895+0000 7f84c97fa640 1 -- 172.21.15.33:0/1955562554 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5357+0+0 (secure 0 0 0) 0x7f84bc0ac8f0 con 0x7f84cc15aa50 2024-05-08T10:55:23.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:23.895+0000 7f84d0fe1640 1 --2- 172.21.15.33:0/1955562554 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f84ac06b500 0x7f84ac06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:23.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:23.895+0000 7f84d0fe1640 1 --2- 172.21.15.33:0/1955562554 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f84ac06b500 0x7f84ac06d9c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f84cc153430 tx=0x7f84c4009060 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:23.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:23.899+0000 7f84c97fa640 1 -- 172.21.15.33:0/1955562554 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f84bc04d020 con 0x7f84cc15aa50 2024-05-08T10:55:24.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:24.086+0000 7f84d3245640 1 -- 172.21.15.33:0/1955562554 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f84cc0b29c0 con 0x7f84cc15aa50 2024-05-08T10:55:24.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:24.761+0000 7f84c97fa640 1 -- 172.21.15.33:0/1955562554 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v23) v1 ==== 169+0+0 (secure 0 0 0) 0x7f84bc07b960 con 0x7f84cc15aa50 2024-05-08T10:55:24.759 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_data' removed 2024-05-08T10:55:24.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:24.764+0000 7f84d3245640 1 -- 172.21.15.33:0/1955562554 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f84ac06b500 msgr2=0x7f84ac06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:24.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:24.764+0000 7f84d3245640 1 --2- 172.21.15.33:0/1955562554 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f84ac06b500 0x7f84ac06d9c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f84cc153430 tx=0x7f84c4009060 comp rx=0 tx=0).stop 2024-05-08T10:55:24.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:24.764+0000 7f84d3245640 1 -- 172.21.15.33:0/1955562554 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84cc15aa50 msgr2=0x7f84cc0b02f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:24.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:24.764+0000 7f84d3245640 1 --2- 172.21.15.33:0/1955562554 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84cc15aa50 0x7f84cc0b02f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f84bc00d240 tx=0x7f84bc004a40 comp rx=0 tx=0).stop 2024-05-08T10:55:24.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:24.764+0000 7f84d3245640 1 -- 172.21.15.33:0/1955562554 shutdown_connections 2024-05-08T10:55:24.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:24.764+0000 7f84d3245640 1 --2- 172.21.15.33:0/1955562554 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f84ac06b500 0x7f84ac06d9c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:24.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:24.764+0000 7f84d3245640 1 --2- 172.21.15.33:0/1955562554 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f84cc15ae30 0x7f84cc0b0830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:24.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:24.764+0000 7f84d3245640 1 --2- 172.21.15.33:0/1955562554 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84cc15aa50 0x7f84cc0b02f0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:24.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:24.764+0000 7f84d3245640 1 --2- 172.21.15.33:0/1955562554 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f84cc0aee50 0x7f84cc1e5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:24.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:24.764+0000 7f84d3245640 1 -- 172.21.15.33:0/1955562554 >> 172.21.15.33:0/1955562554 conn(0x7f84cc0b15c0 msgr2=0x7f84cc070c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:24.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:24.764+0000 7f84d3245640 1 -- 172.21.15.33:0/1955562554 shutdown_connections 2024-05-08T10:55:24.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:24.764+0000 7f84d3245640 1 -- 172.21.15.33:0/1955562554 wait complete. 2024-05-08T10:55:24.783 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-08T10:55:24.783 INFO:tasks.ceph.mds.a:Stopping old one... 2024-05-08T10:55:24.783 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-08T10:55:24.783 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T10:55:24.783 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-08T10:55:24.784 INFO:tasks.ceph.mds.c:Stopping old one... 2024-05-08T10:55:24.784 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-08T10:55:24.784 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T10:55:24.784 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-08T10:55:24.784 INFO:tasks.ceph.mds.b:Stopping old one... 2024-05-08T10:55:24.784 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-08T10:55:24.784 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T10:55:24.785 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-08T10:55:24.785 INFO:tasks.ceph.mds.d:Stopping old one... 2024-05-08T10:55:24.785 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-08T10:55:24.785 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T10:55:24.797 INFO:tasks.ceph.mds.b:Stopped 2024-05-08T10:55:24.797 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-08T10:55:24.798 INFO:tasks.ceph.mds.d:Stopped 2024-05-08T10:55:24.798 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-08T10:55:24.800 INFO:tasks.ceph.mds.a:Stopped 2024-05-08T10:55:24.800 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-08T10:55:24.800 INFO:tasks.ceph.mds.c:Stopped 2024-05-08T10:55:24.801 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-08T10:55:24.839 INFO:tasks.ceph.mds.b:Started 2024-05-08T10:55:24.840 DEBUG:teuthology.parallel:result is None 2024-05-08T10:55:24.840 INFO:tasks.ceph.mds.d:Started 2024-05-08T10:55:24.841 DEBUG:teuthology.parallel:result is None 2024-05-08T10:55:24.843 INFO:tasks.ceph.mds.a:Started 2024-05-08T10:55:24.843 DEBUG:teuthology.parallel:result is None 2024-05-08T10:55:24.843 INFO:tasks.ceph.mds.c:Started 2024-05-08T10:55:24.844 DEBUG:teuthology.parallel:result is None 2024-05-08T10:55:24.844 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-05-08T10:55:24.923 INFO:tasks.ceph.mds.b.smithi174.stdout:starting mds.b at 2024-05-08T10:55:24.923 INFO:tasks.ceph.mds.d.smithi174.stdout:starting mds.d at 2024-05-08T10:55:24.927 INFO:tasks.ceph.mds.c.smithi033.stdout:starting mds.c at 2024-05-08T10:55:24.927 INFO:tasks.ceph.mds.a.smithi033.stdout:starting mds.a at 2024-05-08T10:55:24.928 INFO:tasks.ceph.mds.a.smithi033.stderr:2024-05-08T10:55:24.931+0000 7f1aed75f640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2024-05-08T10:55:24.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:24.959+0000 7fe151658640 1 Processor -- start 2024-05-08T10:55:24.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:24.959+0000 7fe151658640 1 -- start start 2024-05-08T10:55:24.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:24.960+0000 7fe151658640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fe14c1617c0 0x7fe14c0d4690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:24.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:24.960+0000 7fe151658640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe14c0d0750 0x7fe14c0b3680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:24.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:24.960+0000 7fe151658640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe14c0d0dc0 con 0x7fe14c0b2ad0 2024-05-08T10:55:24.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:24.960+0000 7fe151658640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe14c0b32d0 con 0x7fe14c1617c0 2024-05-08T10:55:24.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:24.960+0000 7fe151658640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe14c0cf250 con 0x7fe14c0d0750 2024-05-08T10:55:24.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:24.960+0000 7fe14affd640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fe14c1617c0 0x7fe14c0d4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:24.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:24.960+0000 7fe14affd640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fe14c1617c0 0x7fe14c0d4690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58380/0 (socket says 172.21.15.33:58380) 2024-05-08T10:55:24.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:24.960+0000 7fe14affd640 1 -- 172.21.15.33:0/1616415417 learned_addr learned my addr 172.21.15.33:0/1616415417 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:24.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:24.960+0000 7fe14b7fe640 1 --2- 172.21.15.33:0/1616415417 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe14c0d0750 0x7fe14c0b3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:24.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:24.960+0000 7fe14affd640 1 -- 172.21.15.33:0/1616415417 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe14c0d0750 msgr2=0x7fe14c0b3680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:24.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:24.960+0000 7fe14affd640 1 --2- 172.21.15.33:0/1616415417 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe14c0d0750 0x7fe14c0b3680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:24.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:24.960+0000 7fe14affd640 1 -- 172.21.15.33:0/1616415417 >> v1:172.21.15.174:6789/0 conn(0x7fe14c0b2ad0 legacy=0x7fe14c0d0040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:24.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:24.960+0000 7fe14affd640 1 -- 172.21.15.33:0/1616415417 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe14c0cf4a0 con 0x7fe14c1617c0 2024-05-08T10:55:24.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:24.961+0000 7fe14affd640 1 --2- 172.21.15.33:0/1616415417 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe14c1617c0 0x7fe14c0d4690 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fe13c009870 tx=0x7fe13c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6a7f2775da257a8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:24.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:24.961+0000 7fe149ffb640 1 -- 172.21.15.33:0/1616415417 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe13c037070 con 0x7fe14c1617c0 2024-05-08T10:55:24.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:24.961+0000 7fe149ffb640 1 -- 172.21.15.33:0/1616415417 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe13c032440 con 0x7fe14c1617c0 2024-05-08T10:55:24.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:24.961+0000 7fe149ffb640 1 -- 172.21.15.33:0/1616415417 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe13c032810 con 0x7fe14c1617c0 2024-05-08T10:55:24.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:24.962+0000 7fe151658640 1 -- 172.21.15.33:0/1616415417 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe14c1617c0 msgr2=0x7fe14c0d4690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:24.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:24.962+0000 7fe151658640 1 --2- 172.21.15.33:0/1616415417 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe14c1617c0 0x7fe14c0d4690 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fe13c009870 tx=0x7fe13c02a270 comp rx=0 tx=0).stop 2024-05-08T10:55:24.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:24.962+0000 7fe151658640 1 -- 172.21.15.33:0/1616415417 shutdown_connections 2024-05-08T10:55:24.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:24.962+0000 7fe151658640 1 --2- 172.21.15.33:0/1616415417 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe14c0d0750 0x7fe14c0b3680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:24.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:24.962+0000 7fe151658640 1 --2- 172.21.15.33:0/1616415417 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe14c1617c0 0x7fe14c0d4690 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:24.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:24.962+0000 7fe151658640 1 -- 172.21.15.33:0/1616415417 >> 172.21.15.33:0/1616415417 conn(0x7fe14c0d3b70 msgr2=0x7fe14c0d3f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:24.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:24.962+0000 7fe151658640 1 -- 172.21.15.33:0/1616415417 shutdown_connections 2024-05-08T10:55:24.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:24.962+0000 7fe151658640 1 -- 172.21.15.33:0/1616415417 wait complete. 2024-05-08T10:55:24.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:24.963+0000 7fe151658640 1 Processor -- start 2024-05-08T10:55:24.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:24.963+0000 7fe151658640 1 -- start start 2024-05-08T10:55:24.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:24.964+0000 7fe151658640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe14c0b2ad0 0x7fe14c1f43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:24.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:24.964+0000 7fe151658640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe14c0d0750 0x7fe14c158770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:24.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:24.964+0000 7fe151658640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe14c1617c0 0x7fe14c1f7650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:24.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:24.964+0000 7fe151658640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe14c0b3bc0 con 0x7fe14c0b2ad0 2024-05-08T10:55:24.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:24.964+0000 7fe151658640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe14c0cfa60 con 0x7fe14c0d0750 2024-05-08T10:55:24.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:24.964+0000 7fe151658640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe14c0b3d40 con 0x7fe14c1617c0 2024-05-08T10:55:24.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:24.964+0000 7fe14affd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe14c0b2ad0 0x7fe14c1f43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:24.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:24.964+0000 7fe14affd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe14c0b2ad0 0x7fe14c1f43d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58384/0 (socket says 172.21.15.33:58384) 2024-05-08T10:55:24.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:24.964+0000 7fe14affd640 1 -- 172.21.15.33:0/2497214443 learned_addr learned my addr 172.21.15.33:0/2497214443 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:24.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:24.964+0000 7fe14b7fe640 1 --2- 172.21.15.33:0/2497214443 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe14c1617c0 0x7fe14c1f7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:24.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:24.964+0000 7fe14a7fc640 1 --2- 172.21.15.33:0/2497214443 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe14c0d0750 0x7fe14c158770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:24.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:24.965+0000 7fe14affd640 1 -- 172.21.15.33:0/2497214443 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe14c1617c0 msgr2=0x7fe14c1f7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:24.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:24.965+0000 7fe14affd640 1 --2- 172.21.15.33:0/2497214443 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe14c1617c0 0x7fe14c1f7650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:24.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:24.965+0000 7fe14affd640 1 -- 172.21.15.33:0/2497214443 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe14c0d0750 msgr2=0x7fe14c158770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:24.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:24.965+0000 7fe14affd640 1 --2- 172.21.15.33:0/2497214443 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe14c0d0750 0x7fe14c158770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:24.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:24.965+0000 7fe14affd640 1 -- 172.21.15.33:0/2497214443 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe14c0cbe00 con 0x7fe14c0b2ad0 2024-05-08T10:55:24.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:24.965+0000 7fe14affd640 1 --2- 172.21.15.33:0/2497214443 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe14c0b2ad0 0x7fe14c1f43d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe13c000c00 tx=0x7fe13c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:24.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:24.965+0000 7fe1337fe640 1 -- 172.21.15.33:0/2497214443 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe13c041020 con 0x7fe14c0b2ad0 2024-05-08T10:55:24.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:24.965+0000 7fe1337fe640 1 -- 172.21.15.33:0/2497214443 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe13c03d620 con 0x7fe14c0b2ad0 2024-05-08T10:55:24.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:24.965+0000 7fe151658640 1 -- 172.21.15.33:0/2497214443 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe14c0cc0e0 con 0x7fe14c0b2ad0 2024-05-08T10:55:24.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:24.965+0000 7fe1337fe640 1 -- 172.21.15.33:0/2497214443 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe13c037040 con 0x7fe14c0b2ad0 2024-05-08T10:55:24.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:24.965+0000 7fe151658640 1 -- 172.21.15.33:0/2497214443 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe14c1f7130 con 0x7fe14c0b2ad0 2024-05-08T10:55:24.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:24.966+0000 7fe151658640 1 -- 172.21.15.33:0/2497214443 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe14c1f6f20 con 0x7fe14c0b2ad0 2024-05-08T10:55:24.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:24.967+0000 7fe1337fe640 1 -- 172.21.15.33:0/2497214443 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe13c044020 con 0x7fe14c0b2ad0 2024-05-08T10:55:24.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:24.967+0000 7fe1337fe640 1 --2- 172.21.15.33:0/2497214443 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fe13806b4d0 0x7fe13806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:24.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:24.967+0000 7fe1337fe640 1 -- 172.21.15.33:0/2497214443 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fe13c0aa4b0 con 0x7fe14c0b2ad0 2024-05-08T10:55:24.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:24.968+0000 7fe14a7fc640 1 --2- 172.21.15.33:0/2497214443 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fe13806b4d0 0x7fe13806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:24.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:24.968+0000 7fe14a7fc640 1 --2- 172.21.15.33:0/2497214443 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fe13806b4d0 0x7fe13806d990 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe14c0caf60 tx=0x7fe140009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:24.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:24.971+0000 7fe1337fe640 1 -- 172.21.15.33:0/2497214443 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe13c04b030 con 0x7fe14c0b2ad0 2024-05-08T10:55:25.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:25.165+0000 7fe151658640 1 -- 172.21.15.33:0/2497214443 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fe14c069d20 con 0x7fe14c0b2ad0 2024-05-08T10:55:25.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:25.774+0000 7fe1337fe640 1 -- 172.21.15.33:0/2497214443 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v25) v1 ==== 97+0+0 (secure 0 0 0) 0x7fe13c078ff0 con 0x7fe14c0b2ad0 2024-05-08T10:55:25.772 INFO:teuthology.orchestra.run.smithi033.stderr: removed all blocklist entries 2024-05-08T10:55:25.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:25.777+0000 7fe151658640 1 -- 172.21.15.33:0/2497214443 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fe13806b4d0 msgr2=0x7fe13806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:25.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:25.777+0000 7fe151658640 1 --2- 172.21.15.33:0/2497214443 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fe13806b4d0 0x7fe13806d990 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe14c0caf60 tx=0x7fe140009040 comp rx=0 tx=0).stop 2024-05-08T10:55:25.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:25.777+0000 7fe151658640 1 -- 172.21.15.33:0/2497214443 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe14c0b2ad0 msgr2=0x7fe14c1f43d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:25.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:25.777+0000 7fe151658640 1 --2- 172.21.15.33:0/2497214443 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe14c0b2ad0 0x7fe14c1f43d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe13c000c00 tx=0x7fe13c0046c0 comp rx=0 tx=0).stop 2024-05-08T10:55:25.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:25.777+0000 7fe151658640 1 -- 172.21.15.33:0/2497214443 shutdown_connections 2024-05-08T10:55:25.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:25.777+0000 7fe151658640 1 --2- 172.21.15.33:0/2497214443 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fe13806b4d0 0x7fe13806d990 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:25.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:25.777+0000 7fe151658640 1 --2- 172.21.15.33:0/2497214443 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe14c1617c0 0x7fe14c1f7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:25.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:25.777+0000 7fe151658640 1 --2- 172.21.15.33:0/2497214443 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe14c0d0750 0x7fe14c158770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:25.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:25.777+0000 7fe151658640 1 --2- 172.21.15.33:0/2497214443 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe14c0b2ad0 0x7fe14c1f43d0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:25.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:25.777+0000 7fe151658640 1 -- 172.21.15.33:0/2497214443 >> 172.21.15.33:0/2497214443 conn(0x7fe14c0d3b70 msgr2=0x7fe14c06c920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:25.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:25.777+0000 7fe151658640 1 -- 172.21.15.33:0/2497214443 shutdown_connections 2024-05-08T10:55:25.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:25.777+0000 7fe151658640 1 -- 172.21.15.33:0/2497214443 wait complete. 2024-05-08T10:55:25.790 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-05-08T10:55:25.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:25.898+0000 7fa1f9b22640 1 Processor -- start 2024-05-08T10:55:25.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:25.898+0000 7fa1f9b22640 1 -- start start 2024-05-08T10:55:25.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:25.899+0000 7fa1f9b22640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa1f406e960 0x7fa1f406f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:25.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:25.899+0000 7fa1f9b22640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fa1f415dfe0 0x7fa1f406f630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:25.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:25.899+0000 7fa1f9b22640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1f406bd30 con 0x7fa1f415dc00 2024-05-08T10:55:25.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:25.899+0000 7fa1f9b22640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1f40d0f90 con 0x7fa1f415dfe0 2024-05-08T10:55:25.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:25.899+0000 7fa1f9b22640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f406c010 con 0x7fa1f406e960 2024-05-08T10:55:25.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:25.899+0000 7fa1f37fe640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fa1f415dc00 0x7fa1f40d0690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:53888/0 (socket says 172.21.15.33:53888) 2024-05-08T10:55:25.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:25.899+0000 7fa1f37fe640 1 -- 172.21.15.33:0/596136955 learned_addr learned my addr 172.21.15.33:0/596136955 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-05-08T10:55:25.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:25.899+0000 7fa1f3fff640 1 --2- 172.21.15.33:0/596136955 >> v2:172.21.15.33:3300/0 conn(0x7fa1f415dfe0 0x7fa1f406f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:25.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:25.899+0000 7fa1f2ffd640 1 --2- 172.21.15.33:0/596136955 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa1f406e960 0x7fa1f406f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:25.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:25.899+0000 7fa1f3fff640 1 -- 172.21.15.33:0/596136955 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa1f406e960 msgr2=0x7fa1f406f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:25.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:25.899+0000 7fa1f3fff640 1 --2- 172.21.15.33:0/596136955 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa1f406e960 0x7fa1f406f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:25.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:25.899+0000 7fa1f3fff640 1 -- 172.21.15.33:0/596136955 >> v1:172.21.15.33:6789/0 conn(0x7fa1f415dc00 legacy=0x7fa1f40d0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:25.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:25.899+0000 7fa1f3fff640 1 -- 172.21.15.33:0/596136955 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1f406c2f0 con 0x7fa1f415dfe0 2024-05-08T10:55:25.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:25.899+0000 7fa1f27fc640 1 -- 172.21.15.33:0/596136955 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2770257409 0 0) 0x7fa1f406bd30 con 0x7fa1f415dc00 2024-05-08T10:55:25.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:25.900+0000 7fa1f3fff640 1 --2- 172.21.15.33:0/596136955 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1f415dfe0 0x7fa1f406f630 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec009d90 tx=0x7fa1ec02a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc8503ef4f7a246b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:25.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:25.900+0000 7fa1f27fc640 1 -- 172.21.15.33:0/596136955 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1ec031600 con 0x7fa1f415dfe0 2024-05-08T10:55:25.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:25.900+0000 7fa1f27fc640 1 -- 172.21.15.33:0/596136955 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1ec0317a0 con 0x7fa1f415dfe0 2024-05-08T10:55:25.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:25.900+0000 7fa1f27fc640 1 -- 172.21.15.33:0/596136955 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1ec031b70 con 0x7fa1f415dfe0 2024-05-08T10:55:25.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:25.901+0000 7fa1f9b22640 1 -- 172.21.15.33:0/596136955 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1f415dfe0 msgr2=0x7fa1f406f630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:25.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:25.901+0000 7fa1f9b22640 1 --2- 172.21.15.33:0/596136955 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1f415dfe0 0x7fa1f406f630 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec009d90 tx=0x7fa1ec02a5d0 comp rx=0 tx=0).stop 2024-05-08T10:55:25.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:25.901+0000 7fa1f9b22640 1 -- 172.21.15.33:0/596136955 shutdown_connections 2024-05-08T10:55:25.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:25.901+0000 7fa1f9b22640 1 --2- 172.21.15.33:0/596136955 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa1f406e960 0x7fa1f406f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:25.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:25.901+0000 7fa1f9b22640 1 --2- 172.21.15.33:0/596136955 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1f415dfe0 0x7fa1f406f630 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:25.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:25.901+0000 7fa1f9b22640 1 -- 172.21.15.33:0/596136955 >> 172.21.15.33:0/596136955 conn(0x7fa1f40d1940 msgr2=0x7fa1f40d1d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:25.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:25.901+0000 7fa1f9b22640 1 -- 172.21.15.33:0/596136955 shutdown_connections 2024-05-08T10:55:25.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:25.901+0000 7fa1f9b22640 1 -- 172.21.15.33:0/596136955 wait complete. 2024-05-08T10:55:25.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:25.902+0000 7fa1f9b22640 1 Processor -- start 2024-05-08T10:55:25.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:25.902+0000 7fa1f9b22640 1 -- start start 2024-05-08T10:55:25.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:25.903+0000 7fa1f9b22640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1f406e960 0x7fa1f40b2e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:25.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:25.903+0000 7fa1f9b22640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa1f415dc00 0x7fa1f414e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:25.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:25.903+0000 7fa1f9b22640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa1f415dfe0 0x7fa1f415a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:25.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:25.903+0000 7fa1f9b22640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f406cc70 con 0x7fa1f406e960 2024-05-08T10:55:25.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:25.903+0000 7fa1f9b22640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f406caf0 con 0x7fa1f415dc00 2024-05-08T10:55:25.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:25.903+0000 7fa1f9b22640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f406cdf0 con 0x7fa1f415dfe0 2024-05-08T10:55:25.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:25.903+0000 7fa1f37fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1f406e960 0x7fa1f40b2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:25.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:25.903+0000 7fa1f37fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1f406e960 0x7fa1f40b2e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33696/0 (socket says 172.21.15.33:33696) 2024-05-08T10:55:25.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:25.903+0000 7fa1f37fe640 1 -- 172.21.15.33:0/380350312 learned_addr learned my addr 172.21.15.33:0/380350312 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:25.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:25.904+0000 7fa1f37fe640 1 -- 172.21.15.33:0/380350312 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa1f415dfe0 msgr2=0x7fa1f415a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:25.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:25.904+0000 7fa1f37fe640 1 --2- 172.21.15.33:0/380350312 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa1f415dfe0 0x7fa1f415a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:25.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:25.904+0000 7fa1f37fe640 1 -- 172.21.15.33:0/380350312 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa1f415dc00 msgr2=0x7fa1f414e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:25.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:25.904+0000 7fa1f37fe640 1 --2- 172.21.15.33:0/380350312 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa1f415dc00 0x7fa1f414e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:25.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:25.904+0000 7fa1f37fe640 1 -- 172.21.15.33:0/380350312 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1f40c6980 con 0x7fa1f406e960 2024-05-08T10:55:25.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:25.904+0000 7fa1f37fe640 1 --2- 172.21.15.33:0/380350312 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1f406e960 0x7fa1f40b2e80 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fa1e400c4d0 tx=0x7fa1e400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:25.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:25.904+0000 7fa1dbfff640 1 -- 172.21.15.33:0/380350312 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1e4018070 con 0x7fa1f406e960 2024-05-08T10:55:25.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:25.904+0000 7fa1dbfff640 1 -- 172.21.15.33:0/380350312 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1e4007500 con 0x7fa1f406e960 2024-05-08T10:55:25.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:25.904+0000 7fa1dbfff640 1 -- 172.21.15.33:0/380350312 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1e4004a20 con 0x7fa1f406e960 2024-05-08T10:55:25.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:25.904+0000 7fa1f9b22640 1 -- 172.21.15.33:0/380350312 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1f40c6c60 con 0x7fa1f406e960 2024-05-08T10:55:25.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:25.904+0000 7fa1f9b22640 1 -- 172.21.15.33:0/380350312 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1f40c7220 con 0x7fa1f406e960 2024-05-08T10:55:25.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:25.905+0000 7fa1f9b22640 1 -- 172.21.15.33:0/380350312 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1f4069d20 con 0x7fa1f406e960 2024-05-08T10:55:25.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:25.906+0000 7fa1dbfff640 1 -- 172.21.15.33:0/380350312 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa1e4004bc0 con 0x7fa1f406e960 2024-05-08T10:55:25.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:25.906+0000 7fa1dbfff640 1 --2- 172.21.15.33:0/380350312 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fa1e006b4d0 0x7fa1e006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:25.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:25.906+0000 7fa1dbfff640 1 -- 172.21.15.33:0/380350312 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa1e40892b0 con 0x7fa1f406e960 2024-05-08T10:55:25.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:25.906+0000 7fa1f2ffd640 1 --2- 172.21.15.33:0/380350312 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fa1e006b4d0 0x7fa1e006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:25.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:25.907+0000 7fa1f2ffd640 1 --2- 172.21.15.33:0/380350312 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fa1e006b4d0 0x7fa1e006d990 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa1f40d2290 tx=0x7fa1e8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:25.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:25.910+0000 7fa1dbfff640 1 -- 172.21.15.33:0/380350312 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa1e4058400 con 0x7fa1f406e960 2024-05-08T10:55:26.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.161+0000 7fa1f9b22640 1 -- 172.21.15.33:0/380350312 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fa1f40b78c0 con 0x7fa1f406e960 2024-05-08T10:55:26.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.161+0000 7fa1dbfff640 1 -- 172.21.15.33:0/380350312 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v8) v1 ==== 80+0+6645 (secure 0 0 0) 0x7fa1e4057d00 con 0x7fa1f406e960 2024-05-08T10:55:26.159 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:55:26.159 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-05-08T10:55:26.159 INFO:teuthology.orchestra.run.smithi033.stdout: "auth_dump": [ 2024-05-08T10:55:26.159 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T10:55:26.159 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mds.a", 2024-05-08T10:55:26.159 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDBWTtmU0E6BRAAFsRsuDdZjjCxeaun9EpRlA==", 2024-05-08T10:55:26.159 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-05-08T10:55:26.159 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2024-05-08T10:55:26.160 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow *", 2024-05-08T10:55:26.160 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow *", 2024-05-08T10:55:26.160 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-05-08T10:55:26.160 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T10:55:26.160 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T10:55:26.160 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T10:55:26.160 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mds.b", 2024-05-08T10:55:26.160 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDBWTtmS2ocERAAwRKHaD6QSPDvBNJFhBf0YQ==", 2024-05-08T10:55:26.160 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-05-08T10:55:26.160 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2024-05-08T10:55:26.160 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow *", 2024-05-08T10:55:26.160 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow *", 2024-05-08T10:55:26.160 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-05-08T10:55:26.161 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T10:55:26.161 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T10:55:26.161 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T10:55:26.161 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mds.c", 2024-05-08T10:55:26.161 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDBWTtmsDBtDBAAP4Wz2KJ7fCd9WIFIk06UrA==", 2024-05-08T10:55:26.161 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-05-08T10:55:26.161 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2024-05-08T10:55:26.161 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow *", 2024-05-08T10:55:26.161 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow *", 2024-05-08T10:55:26.161 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-05-08T10:55:26.161 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T10:55:26.161 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T10:55:26.161 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T10:55:26.161 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mds.d", 2024-05-08T10:55:26.161 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDBWTtmk28gGBAAyBZ10bIoEErKJVeUHc04Lg==", 2024-05-08T10:55:26.162 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-05-08T10:55:26.162 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2024-05-08T10:55:26.162 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow *", 2024-05-08T10:55:26.162 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow *", 2024-05-08T10:55:26.162 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-05-08T10:55:26.162 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T10:55:26.162 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T10:55:26.162 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T10:55:26.162 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.0", 2024-05-08T10:55:26.162 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDEWTtmQPBSNxAAnmVcHPihLUOtOT4r8UqKqQ==", 2024-05-08T10:55:26.162 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-05-08T10:55:26.162 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2024-05-08T10:55:26.162 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2024-05-08T10:55:26.162 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-05-08T10:55:26.163 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T10:55:26.163 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T10:55:26.163 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T10:55:26.163 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.1", 2024-05-08T10:55:26.163 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDHWTtmIuDyNRAArrG1HNx+wlmRBYvOQx4vpw==", 2024-05-08T10:55:26.163 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-05-08T10:55:26.163 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2024-05-08T10:55:26.163 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2024-05-08T10:55:26.163 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-05-08T10:55:26.163 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T10:55:26.163 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T10:55:26.163 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T10:55:26.163 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.2", 2024-05-08T10:55:26.163 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDKWTtm4W30NBAAb95EzPGdgoesfgZpE9DJaw==", 2024-05-08T10:55:26.163 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-05-08T10:55:26.164 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2024-05-08T10:55:26.164 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2024-05-08T10:55:26.164 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-05-08T10:55:26.164 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T10:55:26.164 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T10:55:26.164 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T10:55:26.164 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.3", 2024-05-08T10:55:26.164 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDNWTtmjdAWMxAAbPC3I56lJhEDO9uxaS8+FA==", 2024-05-08T10:55:26.164 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-05-08T10:55:26.164 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2024-05-08T10:55:26.164 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2024-05-08T10:55:26.164 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-05-08T10:55:26.164 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T10:55:26.164 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T10:55:26.164 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T10:55:26.165 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.4", 2024-05-08T10:55:26.165 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDTWTtmTmYmORAA/ExqBl0CoJ6WdnNc0Jx0Ng==", 2024-05-08T10:55:26.165 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-05-08T10:55:26.165 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2024-05-08T10:55:26.165 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2024-05-08T10:55:26.165 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-05-08T10:55:26.165 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T10:55:26.165 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T10:55:26.165 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T10:55:26.165 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.5", 2024-05-08T10:55:26.165 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDWWTtmEFiKNxAAS3CQKAyy2rGPrA3+zamIFw==", 2024-05-08T10:55:26.165 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-05-08T10:55:26.165 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2024-05-08T10:55:26.165 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2024-05-08T10:55:26.166 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-05-08T10:55:26.166 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T10:55:26.166 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T10:55:26.166 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T10:55:26.166 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.6", 2024-05-08T10:55:26.166 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDZWTtm/pK8NRAAJ4+22Z9NloXMdCL+uE418g==", 2024-05-08T10:55:26.166 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-05-08T10:55:26.166 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2024-05-08T10:55:26.166 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2024-05-08T10:55:26.166 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-05-08T10:55:26.166 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T10:55:26.166 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T10:55:26.166 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T10:55:26.166 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.7", 2024-05-08T10:55:26.167 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDcWTtmnCE8NBAADmB7+kl6I4TxB5dpm7ufUQ==", 2024-05-08T10:55:26.167 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-05-08T10:55:26.167 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2024-05-08T10:55:26.167 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2024-05-08T10:55:26.167 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-05-08T10:55:26.167 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T10:55:26.167 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T10:55:26.167 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T10:55:26.167 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.0", 2024-05-08T10:55:26.167 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDBWTtmiYY5HBAAoTHjrWKd55wAZZl3OfJ2Zw==", 2024-05-08T10:55:26.167 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-05-08T10:55:26.167 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2024-05-08T10:55:26.167 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow r", 2024-05-08T10:55:26.167 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow rw", 2024-05-08T10:55:26.167 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow rwx" 2024-05-08T10:55:26.168 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T10:55:26.168 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T10:55:26.168 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T10:55:26.168 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.1", 2024-05-08T10:55:26.168 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDBWTtmsDgjJRAA8LxKf4N/ODeb/GIsspIKUA==", 2024-05-08T10:55:26.168 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-05-08T10:55:26.168 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2024-05-08T10:55:26.168 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow r", 2024-05-08T10:55:26.168 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow rw", 2024-05-08T10:55:26.168 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow rwx" 2024-05-08T10:55:26.168 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T10:55:26.168 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T10:55:26.168 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T10:55:26.168 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.2", 2024-05-08T10:55:26.168 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDBWTtmAOznIRAAwAfCUH9u7STb8gvz/wdX7Q==", 2024-05-08T10:55:26.168 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-05-08T10:55:26.169 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2024-05-08T10:55:26.169 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow r", 2024-05-08T10:55:26.169 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow rw", 2024-05-08T10:55:26.169 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow rwx" 2024-05-08T10:55:26.169 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T10:55:26.169 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T10:55:26.169 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T10:55:26.169 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.3", 2024-05-08T10:55:26.169 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDBWTtmZearKhAACOAvZn/Be+A7no4jW/jFvg==", 2024-05-08T10:55:26.169 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-05-08T10:55:26.169 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2024-05-08T10:55:26.169 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow r", 2024-05-08T10:55:26.169 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow rw", 2024-05-08T10:55:26.169 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow rwx" 2024-05-08T10:55:26.169 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T10:55:26.170 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T10:55:26.170 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T10:55:26.170 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.admin", 2024-05-08T10:55:26.170 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDAWTtmugjJJBAAhw1oeYdw3tfEJQhPjgCm3Q==", 2024-05-08T10:55:26.170 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-05-08T10:55:26.170 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow *", 2024-05-08T10:55:26.170 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow *", 2024-05-08T10:55:26.170 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow *", 2024-05-08T10:55:26.170 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-05-08T10:55:26.170 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T10:55:26.170 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T10:55:26.170 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T10:55:26.170 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.bootstrap-mds", 2024-05-08T10:55:26.170 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDiWTtmtHpvKhAAai5t3hiok+/DwUiRqQSsgw==", 2024-05-08T10:55:26.171 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-05-08T10:55:26.171 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile bootstrap-mds" 2024-05-08T10:55:26.171 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T10:55:26.171 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T10:55:26.171 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T10:55:26.171 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.bootstrap-mgr", 2024-05-08T10:55:26.171 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDiWTtmsoNvKhAA2/1p8BJZn57bqcSp7hJKug==", 2024-05-08T10:55:26.171 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-05-08T10:55:26.171 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile bootstrap-mgr" 2024-05-08T10:55:26.171 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T10:55:26.171 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T10:55:26.171 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T10:55:26.171 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.bootstrap-osd", 2024-05-08T10:55:26.171 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDiWTtmY4tvKhAAKRAuqitJIJ4sEyxbj8YJXw==", 2024-05-08T10:55:26.172 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-05-08T10:55:26.172 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile bootstrap-osd" 2024-05-08T10:55:26.172 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T10:55:26.172 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T10:55:26.172 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T10:55:26.172 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.bootstrap-rbd", 2024-05-08T10:55:26.172 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDiWTtmn5JvKhAAwxsEBzLlzsnrJG2Lrqj1ug==", 2024-05-08T10:55:26.172 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-05-08T10:55:26.172 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile bootstrap-rbd" 2024-05-08T10:55:26.172 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T10:55:26.172 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T10:55:26.172 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T10:55:26.172 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-05-08T10:55:26.172 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDiWTtm2JtvKhAAMsOzvkc1u91csCExBPSUaQ==", 2024-05-08T10:55:26.172 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-05-08T10:55:26.173 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-05-08T10:55:26.173 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T10:55:26.173 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T10:55:26.173 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T10:55:26.173 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.bootstrap-rgw", 2024-05-08T10:55:26.173 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDiWTtmnKNvKhAArreov8jryUg7WEmq5aIYjg==", 2024-05-08T10:55:26.173 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-05-08T10:55:26.173 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile bootstrap-rgw" 2024-05-08T10:55:26.173 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T10:55:26.173 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T10:55:26.173 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T10:55:26.173 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mgr.x", 2024-05-08T10:55:26.173 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDBWTtm5DToARAAvHm4BJV1uz8JEKIo7xoD0Q==", 2024-05-08T10:55:26.173 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-05-08T10:55:26.173 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow *", 2024-05-08T10:55:26.174 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile mgr", 2024-05-08T10:55:26.174 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-05-08T10:55:26.174 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T10:55:26.174 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T10:55:26.174 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T10:55:26.174 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mgr.y", 2024-05-08T10:55:26.174 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQDAWTtmc8PFORAA84kNwkvIcE5DmqOKvpGojg==", 2024-05-08T10:55:26.174 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2024-05-08T10:55:26.174 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow *", 2024-05-08T10:55:26.174 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile mgr", 2024-05-08T10:55:26.174 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2024-05-08T10:55:26.175 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T10:55:26.175 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T10:55:26.175 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2024-05-08T10:55:26.175 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-05-08T10:55:26.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.164+0000 7fa1f9b22640 1 -- 172.21.15.33:0/380350312 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fa1e006b4d0 msgr2=0x7fa1e006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:26.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.164+0000 7fa1f9b22640 1 --2- 172.21.15.33:0/380350312 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fa1e006b4d0 0x7fa1e006d990 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa1f40d2290 tx=0x7fa1e8008040 comp rx=0 tx=0).stop 2024-05-08T10:55:26.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.164+0000 7fa1f9b22640 1 -- 172.21.15.33:0/380350312 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1f406e960 msgr2=0x7fa1f40b2e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:26.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.164+0000 7fa1f9b22640 1 --2- 172.21.15.33:0/380350312 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1f406e960 0x7fa1f40b2e80 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fa1e400c4d0 tx=0x7fa1e400c990 comp rx=0 tx=0).stop 2024-05-08T10:55:26.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.164+0000 7fa1f9b22640 1 -- 172.21.15.33:0/380350312 shutdown_connections 2024-05-08T10:55:26.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.164+0000 7fa1f9b22640 1 --2- 172.21.15.33:0/380350312 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fa1e006b4d0 0x7fa1e006d990 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:26.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.164+0000 7fa1f9b22640 1 --2- 172.21.15.33:0/380350312 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa1f415dfe0 0x7fa1f415a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:26.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.164+0000 7fa1f9b22640 1 --2- 172.21.15.33:0/380350312 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa1f415dc00 0x7fa1f414e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:26.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.164+0000 7fa1f9b22640 1 --2- 172.21.15.33:0/380350312 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1f406e960 0x7fa1f40b2e80 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:26.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.164+0000 7fa1f9b22640 1 -- 172.21.15.33:0/380350312 >> 172.21.15.33:0/380350312 conn(0x7fa1f40d1940 msgr2=0x7fa1f40d11c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:26.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.164+0000 7fa1f9b22640 1 -- 172.21.15.33:0/380350312 shutdown_connections 2024-05-08T10:55:26.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.164+0000 7fa1f9b22640 1 -- 172.21.15.33:0/380350312 wait complete. 2024-05-08T10:55:26.178 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-05-08T10:55:26.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.292+0000 7f28263b0640 1 Processor -- start 2024-05-08T10:55:26.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.292+0000 7f28263b0640 1 -- start start 2024-05-08T10:55:26.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.293+0000 7f28263b0640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f282015b9b0 0x7f28200b48f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:26.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.293+0000 7f28263b0640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f28200b7520 0x7f28200aefb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:26.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.293+0000 7f28263b0640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28200b0f90 con 0x7f28200b3090 2024-05-08T10:55:26.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.293+0000 7f28263b0640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28200b1ff0 con 0x7f28200b7520 2024-05-08T10:55:26.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.293+0000 7f28263b0640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28200b22d0 con 0x7f282015b9b0 2024-05-08T10:55:26.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.293+0000 7f282494d640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f28200b7520 0x7f28200aefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:26.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.293+0000 7f282494d640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f28200b7520 0x7f28200aefb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33698/0 (socket says 172.21.15.33:33698) 2024-05-08T10:55:26.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.293+0000 7f282494d640 1 -- 172.21.15.33:0/3321880038 learned_addr learned my addr 172.21.15.33:0/3321880038 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:26.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.293+0000 7f281ffff640 1 --2- 172.21.15.33:0/3321880038 >> v2:172.21.15.174:3300/0 conn(0x7f282015b9b0 0x7f28200b48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:26.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.293+0000 7f282494d640 1 -- 172.21.15.33:0/3321880038 >> v2:172.21.15.174:3300/0 conn(0x7f282015b9b0 msgr2=0x7f28200b48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:26.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.293+0000 7f282494d640 1 --2- 172.21.15.33:0/3321880038 >> v2:172.21.15.174:3300/0 conn(0x7f282015b9b0 0x7f28200b48f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:26.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.293+0000 7f282494d640 1 -- 172.21.15.33:0/3321880038 >> v1:172.21.15.174:6789/0 conn(0x7f28200b3090 legacy=0x7f28200b6e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:26.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.293+0000 7f282494d640 1 -- 172.21.15.33:0/3321880038 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28200b25b0 con 0x7f28200b7520 2024-05-08T10:55:26.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.293+0000 7f281ffff640 1 --2- 172.21.15.33:0/3321880038 >> v2:172.21.15.174:3300/0 conn(0x7f282015b9b0 0x7f28200b48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:55:26.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.294+0000 7f282494d640 1 --2- 172.21.15.33:0/3321880038 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f28200b7520 0x7f28200aefb0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2820068850 tx=0x7f281802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=238c44358d73bfba server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:26.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.294+0000 7f281f7fe640 1 -- 172.21.15.33:0/3321880038 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2818036070 con 0x7f28200b7520 2024-05-08T10:55:26.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.294+0000 7f281f7fe640 1 -- 172.21.15.33:0/3321880038 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2818031600 con 0x7f28200b7520 2024-05-08T10:55:26.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.294+0000 7f281f7fe640 1 -- 172.21.15.33:0/3321880038 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28180319d0 con 0x7f28200b7520 2024-05-08T10:55:26.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.295+0000 7f28263b0640 1 -- 172.21.15.33:0/3321880038 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f28200b7520 msgr2=0x7f28200aefb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:26.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.295+0000 7f28263b0640 1 --2- 172.21.15.33:0/3321880038 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f28200b7520 0x7f28200aefb0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2820068850 tx=0x7f281802a660 comp rx=0 tx=0).stop 2024-05-08T10:55:26.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.295+0000 7f28263b0640 1 -- 172.21.15.33:0/3321880038 shutdown_connections 2024-05-08T10:55:26.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.295+0000 7f28263b0640 1 --2- 172.21.15.33:0/3321880038 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f28200b7520 0x7f28200aefb0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:26.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.295+0000 7f28263b0640 1 --2- 172.21.15.33:0/3321880038 >> v2:172.21.15.174:3300/0 conn(0x7f282015b9b0 0x7f28200b48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:26.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.295+0000 7f28263b0640 1 -- 172.21.15.33:0/3321880038 >> 172.21.15.33:0/3321880038 conn(0x7f282009a9d0 msgr2=0x7f282009ade0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:26.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.295+0000 7f28263b0640 1 -- 172.21.15.33:0/3321880038 shutdown_connections 2024-05-08T10:55:26.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.295+0000 7f28263b0640 1 -- 172.21.15.33:0/3321880038 wait complete. 2024-05-08T10:55:26.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.296+0000 7f28263b0640 1 Processor -- start 2024-05-08T10:55:26.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.296+0000 7f28263b0640 1 -- start start 2024-05-08T10:55:26.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.297+0000 7f28263b0640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f28200b3090 0x7f28200afb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:26.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.297+0000 7f28263b0640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f28200b7520 0x7f28200b0040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:26.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.297+0000 7f28263b0640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f282015b9b0 0x7f282014e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:26.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.297+0000 7f28263b0640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28200b4fb0 con 0x7f28200b7520 2024-05-08T10:55:26.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.297+0000 7f28263b0640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28200b4e30 con 0x7f282015b9b0 2024-05-08T10:55:26.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.297+0000 7f28263b0640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f282015bd90 con 0x7f28200b3090 2024-05-08T10:55:26.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.297+0000 7f2817fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f28200b7520 0x7f28200b0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:26.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.297+0000 7f2817fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f28200b7520 0x7f28200b0040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33704/0 (socket says 172.21.15.33:33704) 2024-05-08T10:55:26.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.297+0000 7f2817fff640 1 -- 172.21.15.33:0/203110464 learned_addr learned my addr 172.21.15.33:0/203110464 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:26.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.297+0000 7f282494d640 1 --2- 172.21.15.33:0/203110464 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f282015b9b0 0x7f282014e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:26.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.297+0000 7f281ffff640 1 --2- 172.21.15.33:0/203110464 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f28200b3090 0x7f28200afb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:26.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.297+0000 7f2817fff640 1 -- 172.21.15.33:0/203110464 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f28200b3090 msgr2=0x7f28200afb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:26.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.297+0000 7f2817fff640 1 --2- 172.21.15.33:0/203110464 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f28200b3090 0x7f28200afb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:26.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.297+0000 7f2817fff640 1 -- 172.21.15.33:0/203110464 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f282015b9b0 msgr2=0x7f282014e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:26.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.297+0000 7f2817fff640 1 --2- 172.21.15.33:0/203110464 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f282015b9b0 0x7f282014e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:26.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.297+0000 7f2817fff640 1 -- 172.21.15.33:0/203110464 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f282014ed90 con 0x7f28200b7520 2024-05-08T10:55:26.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.297+0000 7f281ffff640 1 --2- 172.21.15.33:0/203110464 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f28200b3090 0x7f28200afb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:55:26.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.297+0000 7f2817fff640 1 --2- 172.21.15.33:0/203110464 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f28200b7520 0x7f28200b0040 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f280800c430 tx=0x7f280800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:26.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.297+0000 7f281d7fa640 1 -- 172.21.15.33:0/203110464 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2808011790 con 0x7f28200b7520 2024-05-08T10:55:26.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.297+0000 7f281d7fa640 1 -- 172.21.15.33:0/203110464 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2808017070 con 0x7f28200b7520 2024-05-08T10:55:26.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.297+0000 7f281d7fa640 1 -- 172.21.15.33:0/203110464 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2808011bb0 con 0x7f28200b7520 2024-05-08T10:55:26.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.297+0000 7f28263b0640 1 -- 172.21.15.33:0/203110464 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f282014f070 con 0x7f28200b7520 2024-05-08T10:55:26.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.298+0000 7f28263b0640 1 -- 172.21.15.33:0/203110464 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f282014f630 con 0x7f28200b7520 2024-05-08T10:55:26.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.299+0000 7f28263b0640 1 -- 172.21.15.33:0/203110464 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2820069d20 con 0x7f28200b7520 2024-05-08T10:55:26.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.299+0000 7f281d7fa640 1 -- 172.21.15.33:0/203110464 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f280801c460 con 0x7f28200b7520 2024-05-08T10:55:26.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.300+0000 7f281d7fa640 1 --2- 172.21.15.33:0/203110464 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f280006b4d0 0x7f280006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:26.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.300+0000 7f281d7fa640 1 -- 172.21.15.33:0/203110464 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2808089c50 con 0x7f28200b7520 2024-05-08T10:55:26.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.300+0000 7f281ffff640 1 --2- 172.21.15.33:0/203110464 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f280006b4d0 0x7f280006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:26.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.300+0000 7f281ffff640 1 --2- 172.21.15.33:0/203110464 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f280006b4d0 0x7f280006d990 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f281000a990 tx=0x7f2810008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:26.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.304+0000 7f281d7fa640 1 -- 172.21.15.33:0/203110464 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f280808f020 con 0x7f28200b7520 2024-05-08T10:55:26.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.551+0000 7f28263b0640 1 -- 172.21.15.33:0/203110464 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f282015f0c0 con 0x7f28200b7520 2024-05-08T10:55:26.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.553+0000 7f281d7fa640 1 -- 172.21.15.33:0/203110464 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7f2808058eb0 con 0x7f28200b7520 2024-05-08T10:55:26.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.556+0000 7f28263b0640 1 -- 172.21.15.33:0/203110464 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f280006b4d0 msgr2=0x7f280006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:26.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.556+0000 7f28263b0640 1 --2- 172.21.15.33:0/203110464 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f280006b4d0 0x7f280006d990 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f281000a990 tx=0x7f2810008040 comp rx=0 tx=0).stop 2024-05-08T10:55:26.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.556+0000 7f28263b0640 1 -- 172.21.15.33:0/203110464 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f28200b7520 msgr2=0x7f28200b0040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:26.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.556+0000 7f28263b0640 1 --2- 172.21.15.33:0/203110464 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f28200b7520 0x7f28200b0040 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f280800c430 tx=0x7f280800c8f0 comp rx=0 tx=0).stop 2024-05-08T10:55:26.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.556+0000 7f28263b0640 1 -- 172.21.15.33:0/203110464 shutdown_connections 2024-05-08T10:55:26.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.556+0000 7f28263b0640 1 --2- 172.21.15.33:0/203110464 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f280006b4d0 0x7f280006d990 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:26.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.556+0000 7f28263b0640 1 --2- 172.21.15.33:0/203110464 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f282015b9b0 0x7f282014e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:26.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.556+0000 7f28263b0640 1 --2- 172.21.15.33:0/203110464 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f28200b7520 0x7f28200b0040 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:26.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.556+0000 7f28263b0640 1 --2- 172.21.15.33:0/203110464 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f28200b3090 0x7f28200afb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:26.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.556+0000 7f28263b0640 1 -- 172.21.15.33:0/203110464 >> 172.21.15.33:0/203110464 conn(0x7f282009a9d0 msgr2=0x7f2820159150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:26.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.556+0000 7f28263b0640 1 -- 172.21.15.33:0/203110464 shutdown_connections 2024-05-08T10:55:26.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.556+0000 7f28263b0640 1 -- 172.21.15.33:0/203110464 wait complete. 2024-05-08T10:55:26.564 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-05-08T10:55:26.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.672+0000 7fd1f763f640 1 Processor -- start 2024-05-08T10:55:26.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.672+0000 7fd1f763f640 1 -- start start 2024-05-08T10:55:26.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.673+0000 7fd1f763f640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd1f015e020 0x7fd1f00b4770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:26.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.673+0000 7fd1f763f640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1f00d0b70 0x7fd1f00cefe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:26.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.673+0000 7fd1f763f640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1f00d4730 con 0x7fd1f015e400 2024-05-08T10:55:26.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.673+0000 7fd1f763f640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1f00d1d20 con 0x7fd1f015e020 2024-05-08T10:55:26.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.673+0000 7fd1f763f640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f00ceac0 con 0x7fd1f00d0b70 2024-05-08T10:55:26.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.673+0000 7fd1f53db640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd1f015e020 0x7fd1f00b4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:26.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.674+0000 7fd1f4bda640 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fd1f015e400 0x7fd1f00d0460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.33:59254/0 (socket says 172.21.15.33:59254) 2024-05-08T10:55:26.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.674+0000 7fd1f4bda640 1 -- 172.21.15.33:0/408824699 learned_addr learned my addr 172.21.15.33:0/408824699 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-05-08T10:55:26.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.674+0000 7fd1f5bdc640 1 --2- 172.21.15.33:0/408824699 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1f00d0b70 0x7fd1f00cefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:26.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.674+0000 7fd1f53db640 1 -- 172.21.15.33:0/408824699 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1f00d0b70 msgr2=0x7fd1f00cefe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:26.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.674+0000 7fd1f53db640 1 --2- 172.21.15.33:0/408824699 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1f00d0b70 0x7fd1f00cefe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:26.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.674+0000 7fd1f53db640 1 -- 172.21.15.33:0/408824699 >> v1:172.21.15.174:6789/0 conn(0x7fd1f015e400 legacy=0x7fd1f00d0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:26.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.674+0000 7fd1f53db640 1 -- 172.21.15.33:0/408824699 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1f00d2000 con 0x7fd1f015e020 2024-05-08T10:55:26.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.675+0000 7fd1f53db640 1 --2- 172.21.15.33:0/408824699 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd1f015e020 0x7fd1f00b4770 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd1e80097a0 tx=0x7fd1e802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c8d24047a3d22ed server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:26.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.675+0000 7fd1effff640 1 -- 172.21.15.33:0/408824699 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1e8037070 con 0x7fd1f015e020 2024-05-08T10:55:26.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.675+0000 7fd1effff640 1 -- 172.21.15.33:0/408824699 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1e8032440 con 0x7fd1f015e020 2024-05-08T10:55:26.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.675+0000 7fd1effff640 1 -- 172.21.15.33:0/408824699 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1e8032810 con 0x7fd1f015e020 2024-05-08T10:55:26.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.675+0000 7fd1f763f640 1 -- 172.21.15.33:0/408824699 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd1f015e020 msgr2=0x7fd1f00b4770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:26.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.675+0000 7fd1f763f640 1 --2- 172.21.15.33:0/408824699 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd1f015e020 0x7fd1f00b4770 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd1e80097a0 tx=0x7fd1e802a180 comp rx=0 tx=0).stop 2024-05-08T10:55:26.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.675+0000 7fd1f763f640 1 -- 172.21.15.33:0/408824699 shutdown_connections 2024-05-08T10:55:26.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.675+0000 7fd1f763f640 1 --2- 172.21.15.33:0/408824699 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1f00d0b70 0x7fd1f00cefe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:26.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.675+0000 7fd1f763f640 1 --2- 172.21.15.33:0/408824699 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd1f015e020 0x7fd1f00b4770 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:26.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.675+0000 7fd1f763f640 1 -- 172.21.15.33:0/408824699 >> 172.21.15.33:0/408824699 conn(0x7fd1f00d3b70 msgr2=0x7fd1f00d3f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:26.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.676+0000 7fd1f763f640 1 -- 172.21.15.33:0/408824699 shutdown_connections 2024-05-08T10:55:26.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.676+0000 7fd1f763f640 1 -- 172.21.15.33:0/408824699 wait complete. 2024-05-08T10:55:26.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.677+0000 7fd1f763f640 1 Processor -- start 2024-05-08T10:55:26.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.677+0000 7fd1f763f640 1 -- start start 2024-05-08T10:55:26.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.677+0000 7fd1f763f640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd1f00d0b70 0x7fd1f014a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:26.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.677+0000 7fd1f763f640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1f015e020 0x7fd1f01f7560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:26.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.677+0000 7fd1f763f640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1f015e400 0x7fd1f01f7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:26.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.677+0000 7fd1f763f640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f00d0fa0 con 0x7fd1f015e020 2024-05-08T10:55:26.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.677+0000 7fd1f763f640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f00d49d0 con 0x7fd1f00d0b70 2024-05-08T10:55:26.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.677+0000 7fd1f763f640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f00d1120 con 0x7fd1f015e400 2024-05-08T10:55:26.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.678+0000 7fd1f4bda640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1f015e020 0x7fd1f01f7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:26.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.678+0000 7fd1f4bda640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1f015e020 0x7fd1f01f7560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33708/0 (socket says 172.21.15.33:33708) 2024-05-08T10:55:26.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.678+0000 7fd1f4bda640 1 -- 172.21.15.33:0/1928379835 learned_addr learned my addr 172.21.15.33:0/1928379835 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:26.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.678+0000 7fd1f5bdc640 1 --2- 172.21.15.33:0/1928379835 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1f015e400 0x7fd1f01f7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:26.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.678+0000 7fd1f53db640 1 --2- 172.21.15.33:0/1928379835 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd1f00d0b70 0x7fd1f014a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:26.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.678+0000 7fd1f4bda640 1 -- 172.21.15.33:0/1928379835 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1f015e400 msgr2=0x7fd1f01f7aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:26.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.678+0000 7fd1f4bda640 1 --2- 172.21.15.33:0/1928379835 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1f015e400 0x7fd1f01f7aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:26.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.678+0000 7fd1f4bda640 1 -- 172.21.15.33:0/1928379835 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd1f00d0b70 msgr2=0x7fd1f014a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:26.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.678+0000 7fd1f4bda640 1 --2- 172.21.15.33:0/1928379835 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd1f00d0b70 0x7fd1f014a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:26.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.678+0000 7fd1f4bda640 1 -- 172.21.15.33:0/1928379835 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1f014abd0 con 0x7fd1f015e020 2024-05-08T10:55:26.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.678+0000 7fd1f4bda640 1 --2- 172.21.15.33:0/1928379835 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1f015e020 0x7fd1f01f7560 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd1e400c430 tx=0x7fd1e400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:26.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.678+0000 7fd1edffb640 1 -- 172.21.15.33:0/1928379835 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1e4017070 con 0x7fd1f015e020 2024-05-08T10:55:26.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.678+0000 7fd1edffb640 1 -- 172.21.15.33:0/1928379835 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1e4005ce0 con 0x7fd1f015e020 2024-05-08T10:55:26.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.678+0000 7fd1f763f640 1 -- 172.21.15.33:0/1928379835 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1f00ca430 con 0x7fd1f015e020 2024-05-08T10:55:26.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.678+0000 7fd1edffb640 1 -- 172.21.15.33:0/1928379835 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1e4007310 con 0x7fd1f015e020 2024-05-08T10:55:26.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.679+0000 7fd1f763f640 1 -- 172.21.15.33:0/1928379835 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1f0160eb0 con 0x7fd1f015e020 2024-05-08T10:55:26.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.680+0000 7fd1f763f640 1 -- 172.21.15.33:0/1928379835 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1f0069d20 con 0x7fd1f015e020 2024-05-08T10:55:26.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.680+0000 7fd1edffb640 1 -- 172.21.15.33:0/1928379835 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd1e401a070 con 0x7fd1f015e020 2024-05-08T10:55:26.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.680+0000 7fd1edffb640 1 --2- 172.21.15.33:0/1928379835 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fd1dc06b4d0 0x7fd1dc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:26.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.681+0000 7fd1edffb640 1 -- 172.21.15.33:0/1928379835 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd1e40891f0 con 0x7fd1f015e020 2024-05-08T10:55:26.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.681+0000 7fd1f53db640 1 --2- 172.21.15.33:0/1928379835 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fd1dc06b4d0 0x7fd1dc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:26.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.681+0000 7fd1f53db640 1 --2- 172.21.15.33:0/1928379835 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fd1dc06b4d0 0x7fd1dc06d990 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd1e8034000 tx=0x7fd1e802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:26.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.685+0000 7fd1edffb640 1 -- 172.21.15.33:0/1928379835 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd1e4057d70 con 0x7fd1f015e020 2024-05-08T10:55:26.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.936+0000 7fd1f763f640 1 -- 172.21.15.33:0/1928379835 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7fd1f00d2260 con 0x7fd1f015e020 2024-05-08T10:55:26.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.938+0000 7fd1edffb640 1 -- 172.21.15.33:0/1928379835 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7fd1e405be10 con 0x7fd1f015e020 2024-05-08T10:55:26.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.940+0000 7fd1f763f640 1 -- 172.21.15.33:0/1928379835 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fd1dc06b4d0 msgr2=0x7fd1dc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:26.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.940+0000 7fd1f763f640 1 --2- 172.21.15.33:0/1928379835 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fd1dc06b4d0 0x7fd1dc06d990 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd1e8034000 tx=0x7fd1e802e000 comp rx=0 tx=0).stop 2024-05-08T10:55:26.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.940+0000 7fd1f763f640 1 -- 172.21.15.33:0/1928379835 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1f015e020 msgr2=0x7fd1f01f7560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:26.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.940+0000 7fd1f763f640 1 --2- 172.21.15.33:0/1928379835 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1f015e020 0x7fd1f01f7560 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd1e400c430 tx=0x7fd1e400c8f0 comp rx=0 tx=0).stop 2024-05-08T10:55:26.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.940+0000 7fd1f763f640 1 -- 172.21.15.33:0/1928379835 shutdown_connections 2024-05-08T10:55:26.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.940+0000 7fd1f763f640 1 --2- 172.21.15.33:0/1928379835 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fd1dc06b4d0 0x7fd1dc06d990 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:26.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.940+0000 7fd1f763f640 1 --2- 172.21.15.33:0/1928379835 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd1f015e400 0x7fd1f01f7aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:26.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.940+0000 7fd1f763f640 1 --2- 172.21.15.33:0/1928379835 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1f015e020 0x7fd1f01f7560 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:26.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.940+0000 7fd1f763f640 1 --2- 172.21.15.33:0/1928379835 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd1f00d0b70 0x7fd1f014a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:26.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.940+0000 7fd1f763f640 1 -- 172.21.15.33:0/1928379835 >> 172.21.15.33:0/1928379835 conn(0x7fd1f00d3b70 msgr2=0x7fd1f00cf770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:26.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.940+0000 7fd1f763f640 1 -- 172.21.15.33:0/1928379835 shutdown_connections 2024-05-08T10:55:26.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:26.940+0000 7fd1f763f640 1 -- 172.21.15.33:0/1928379835 wait complete. 2024-05-08T10:55:26.948 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-05-08T10:55:27.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.057+0000 7efe06514640 1 Processor -- start 2024-05-08T10:55:27.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.057+0000 7efe06514640 1 -- start start 2024-05-08T10:55:27.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.058+0000 7efe06514640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7efe0015e400 0x7efe000b4770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:27.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.058+0000 7efe06514640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efe000d0b70 0x7efe000cefe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:27.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.058+0000 7efe06514640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe000d4730 con 0x7efe0015e020 2024-05-08T10:55:27.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.058+0000 7efe06514640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe000d1d20 con 0x7efe0015e400 2024-05-08T10:55:27.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.058+0000 7efe06514640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe000ceac0 con 0x7efe000d0b70 2024-05-08T10:55:27.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.058+0000 7efdfffff640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7efe0015e020 0x7efe000d0460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:53900/0 (socket says 172.21.15.33:53900) 2024-05-08T10:55:27.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.058+0000 7efdfffff640 1 -- 172.21.15.33:0/561433287 learned_addr learned my addr 172.21.15.33:0/561433287 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-05-08T10:55:27.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.058+0000 7efdff7fe640 1 --2- 172.21.15.33:0/561433287 >> v2:172.21.15.174:3300/0 conn(0x7efe0015e400 0x7efe000b4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:27.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.058+0000 7efe04ab1640 1 --2- 172.21.15.33:0/561433287 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efe000d0b70 0x7efe000cefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:27.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.058+0000 7efdfeffd640 1 -- 172.21.15.33:0/561433287 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1680901873 0 0) 0x7efe000d4730 con 0x7efe0015e020 2024-05-08T10:55:27.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.058+0000 7efdfeffd640 1 -- 172.21.15.33:0/561433287 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efde8003520 con 0x7efe0015e020 2024-05-08T10:55:27.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.058+0000 7efe04ab1640 1 -- 172.21.15.33:0/561433287 >> v2:172.21.15.174:3300/0 conn(0x7efe0015e400 msgr2=0x7efe000b4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:27.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.058+0000 7efe04ab1640 1 --2- 172.21.15.33:0/561433287 >> v2:172.21.15.174:3300/0 conn(0x7efe0015e400 0x7efe000b4770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:27.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.058+0000 7efe04ab1640 1 -- 172.21.15.33:0/561433287 >> v1:172.21.15.33:6789/0 conn(0x7efe0015e020 legacy=0x7efe000d0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:27.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.058+0000 7efe04ab1640 1 -- 172.21.15.33:0/561433287 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe000d2000 con 0x7efe000d0b70 2024-05-08T10:55:27.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.058+0000 7efdff7fe640 1 --2- 172.21.15.33:0/561433287 >> v2:172.21.15.174:3300/0 conn(0x7efe0015e400 0x7efe000b4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T10:55:27.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.059+0000 7efe04ab1640 1 --2- 172.21.15.33:0/561433287 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efe000d0b70 0x7efe000cefe0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7efdf8009d90 tx=0x7efdf802a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3fc80ff6d000c71f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:27.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.059+0000 7efdfeffd640 1 -- 172.21.15.33:0/561433287 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf8007740 con 0x7efe000d0b70 2024-05-08T10:55:27.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.059+0000 7efdfeffd640 1 -- 172.21.15.33:0/561433287 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdf80078e0 con 0x7efe000d0b70 2024-05-08T10:55:27.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.059+0000 7efdfeffd640 1 -- 172.21.15.33:0/561433287 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf8007cb0 con 0x7efe000d0b70 2024-05-08T10:55:27.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.060+0000 7efe06514640 1 -- 172.21.15.33:0/561433287 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efe000d0b70 msgr2=0x7efe000cefe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:27.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.060+0000 7efe06514640 1 --2- 172.21.15.33:0/561433287 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efe000d0b70 0x7efe000cefe0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7efdf8009d90 tx=0x7efdf802a660 comp rx=0 tx=0).stop 2024-05-08T10:55:27.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.060+0000 7efe06514640 1 -- 172.21.15.33:0/561433287 shutdown_connections 2024-05-08T10:55:27.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.060+0000 7efe06514640 1 --2- 172.21.15.33:0/561433287 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efe000d0b70 0x7efe000cefe0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:27.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.060+0000 7efe06514640 1 --2- 172.21.15.33:0/561433287 >> v2:172.21.15.174:3300/0 conn(0x7efe0015e400 0x7efe000b4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:27.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.060+0000 7efe06514640 1 -- 172.21.15.33:0/561433287 >> 172.21.15.33:0/561433287 conn(0x7efe000d3b70 msgr2=0x7efe000d3f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:27.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.060+0000 7efe06514640 1 -- 172.21.15.33:0/561433287 shutdown_connections 2024-05-08T10:55:27.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.060+0000 7efe06514640 1 -- 172.21.15.33:0/561433287 wait complete. 2024-05-08T10:55:27.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.061+0000 7efe06514640 1 Processor -- start 2024-05-08T10:55:27.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.061+0000 7efe06514640 1 -- start start 2024-05-08T10:55:27.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.062+0000 7efe06514640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe000d0b70 0x7efe00161300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:27.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.062+0000 7efe06514640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efe0015e020 0x7efe0006c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:27.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.062+0000 7efe06514640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efe0015e400 0x7efe0006c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:27.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.062+0000 7efe06514640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe000d0fa0 con 0x7efe0015e400 2024-05-08T10:55:27.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.062+0000 7efe06514640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe000d49d0 con 0x7efe000d0b70 2024-05-08T10:55:27.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.062+0000 7efe06514640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe000d1120 con 0x7efe0015e020 2024-05-08T10:55:27.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.062+0000 7efe04ab1640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efe0015e400 0x7efe0006c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:27.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.062+0000 7efe04ab1640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efe0015e400 0x7efe0006c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33718/0 (socket says 172.21.15.33:33718) 2024-05-08T10:55:27.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.062+0000 7efe04ab1640 1 -- 172.21.15.33:0/2536220339 learned_addr learned my addr 172.21.15.33:0/2536220339 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:27.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.062+0000 7efdff7fe640 1 --2- 172.21.15.33:0/2536220339 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efe0015e020 0x7efe0006c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:27.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.062+0000 7efdfffff640 1 --2- 172.21.15.33:0/2536220339 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe000d0b70 0x7efe00161300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:27.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.062+0000 7efe04ab1640 1 -- 172.21.15.33:0/2536220339 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efe0015e020 msgr2=0x7efe0006c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:27.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.063+0000 7efe04ab1640 1 --2- 172.21.15.33:0/2536220339 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efe0015e020 0x7efe0006c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:27.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.063+0000 7efe04ab1640 1 -- 172.21.15.33:0/2536220339 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe000d0b70 msgr2=0x7efe00161300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:27.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.063+0000 7efe04ab1640 1 --2- 172.21.15.33:0/2536220339 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe000d0b70 0x7efe00161300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:27.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.063+0000 7efe04ab1640 1 -- 172.21.15.33:0/2536220339 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe000c8f30 con 0x7efe0015e400 2024-05-08T10:55:27.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.063+0000 7efdff7fe640 1 --2- 172.21.15.33:0/2536220339 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efe0015e020 0x7efe0006c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:55:27.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.063+0000 7efdfffff640 1 --2- 172.21.15.33:0/2536220339 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe000d0b70 0x7efe00161300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:55:27.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.063+0000 7efe04ab1640 1 --2- 172.21.15.33:0/2536220339 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efe0015e400 0x7efe0006c8c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7efdf8009eb0 tx=0x7efdf8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:27.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.063+0000 7efdfcff9640 1 -- 172.21.15.33:0/2536220339 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf803f070 con 0x7efe0015e400 2024-05-08T10:55:27.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.063+0000 7efdfcff9640 1 -- 172.21.15.33:0/2536220339 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdf8031bc0 con 0x7efe0015e400 2024-05-08T10:55:27.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.063+0000 7efe06514640 1 -- 172.21.15.33:0/2536220339 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe000c9210 con 0x7efe0015e400 2024-05-08T10:55:27.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.063+0000 7efdfcff9640 1 -- 172.21.15.33:0/2536220339 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf8009450 con 0x7efe0015e400 2024-05-08T10:55:27.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.063+0000 7efe06514640 1 -- 172.21.15.33:0/2536220339 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe000c97d0 con 0x7efe0015e400 2024-05-08T10:55:27.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.064+0000 7efe06514640 1 -- 172.21.15.33:0/2536220339 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe00069d20 con 0x7efe0015e400 2024-05-08T10:55:27.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.064+0000 7efdfcff9640 1 -- 172.21.15.33:0/2536220339 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7efdf803b410 con 0x7efe0015e400 2024-05-08T10:55:27.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.065+0000 7efdfcff9640 1 --2- 172.21.15.33:0/2536220339 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7efdec06b4d0 0x7efdec06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:27.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.065+0000 7efdfcff9640 1 -- 172.21.15.33:0/2536220339 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7efdf80ab4d0 con 0x7efe0015e400 2024-05-08T10:55:27.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.065+0000 7efdfffff640 1 --2- 172.21.15.33:0/2536220339 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7efdec06b4d0 0x7efdec06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:27.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.066+0000 7efdfffff640 1 --2- 172.21.15.33:0/2536220339 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7efdec06b4d0 0x7efdec06d990 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7efe001f74a0 tx=0x7efdf0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:27.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.069+0000 7efdfcff9640 1 -- 172.21.15.33:0/2536220339 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7efdf807a0e0 con 0x7efe0015e400 2024-05-08T10:55:27.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.326+0000 7efe06514640 1 -- 172.21.15.33:0/2536220339 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7efe0008d360 con 0x7efe0015e400 2024-05-08T10:55:27.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.328+0000 7efdfcff9640 1 -- 172.21.15.33:0/2536220339 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v11) v1 ==== 90+0+0 (secure 0 0 0) 0x7efdf807e180 con 0x7efe0015e400 2024-05-08T10:55:27.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.330+0000 7efe06514640 1 -- 172.21.15.33:0/2536220339 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7efdec06b4d0 msgr2=0x7efdec06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:27.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.330+0000 7efe06514640 1 --2- 172.21.15.33:0/2536220339 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7efdec06b4d0 0x7efdec06d990 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7efe001f74a0 tx=0x7efdf0009040 comp rx=0 tx=0).stop 2024-05-08T10:55:27.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.330+0000 7efe06514640 1 -- 172.21.15.33:0/2536220339 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efe0015e400 msgr2=0x7efe0006c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:27.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.330+0000 7efe06514640 1 --2- 172.21.15.33:0/2536220339 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efe0015e400 0x7efe0006c8c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7efdf8009eb0 tx=0x7efdf8004a40 comp rx=0 tx=0).stop 2024-05-08T10:55:27.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.330+0000 7efe06514640 1 -- 172.21.15.33:0/2536220339 shutdown_connections 2024-05-08T10:55:27.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.330+0000 7efe06514640 1 --2- 172.21.15.33:0/2536220339 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7efdec06b4d0 0x7efdec06d990 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:27.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.330+0000 7efe06514640 1 --2- 172.21.15.33:0/2536220339 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efe0015e400 0x7efe0006c8c0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:27.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.330+0000 7efe06514640 1 --2- 172.21.15.33:0/2536220339 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efe0015e020 0x7efe0006c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:27.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.330+0000 7efe06514640 1 --2- 172.21.15.33:0/2536220339 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe000d0b70 0x7efe00161300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:27.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.330+0000 7efe06514640 1 -- 172.21.15.33:0/2536220339 >> 172.21.15.33:0/2536220339 conn(0x7efe000d3b70 msgr2=0x7efe000d3f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:27.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.330+0000 7efe06514640 1 -- 172.21.15.33:0/2536220339 shutdown_connections 2024-05-08T10:55:27.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.330+0000 7efe06514640 1 -- 172.21.15.33:0/2536220339 wait complete. 2024-05-08T10:55:27.338 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-05-08T10:55:27.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.446+0000 7f770721b640 1 Processor -- start 2024-05-08T10:55:27.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.446+0000 7f770721b640 1 -- start start 2024-05-08T10:55:27.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.446+0000 7f770721b640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f770015f1a0 0x7f77000b4880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:27.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.446+0000 7f770721b640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f77000d04e0 0x7f77000ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:27.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.447+0000 7f770721b640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77000b4340 con 0x7f770015f580 2024-05-08T10:55:27.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.447+0000 7f770721b640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77000cd570 con 0x7f770015f1a0 2024-05-08T10:55:27.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.447+0000 7f770721b640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77000cd850 con 0x7f77000d04e0 2024-05-08T10:55:27.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.447+0000 7f7704fb7640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f770015f1a0 0x7f77000b4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:27.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.447+0000 7f76fffff640 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f770015f580 0x7f77000cfdd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.33:59266/0 (socket says 172.21.15.33:59266) 2024-05-08T10:55:27.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.447+0000 7f76fffff640 1 -- 172.21.15.33:0/4180484584 learned_addr learned my addr 172.21.15.33:0/4180484584 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-05-08T10:55:27.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.447+0000 7f77057b8640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f77000d04e0 0x7f77000ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:27.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.447+0000 7f7704fb7640 1 -- 172.21.15.33:0/4180484584 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f77000d04e0 msgr2=0x7f77000ccf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:27.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.447+0000 7f7704fb7640 1 --2- 172.21.15.33:0/4180484584 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f77000d04e0 0x7f77000ccf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:27.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.447+0000 7f7704fb7640 1 -- 172.21.15.33:0/4180484584 >> v1:172.21.15.174:6789/0 conn(0x7f770015f580 legacy=0x7f77000cfdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:27.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.447+0000 7f7704fb7640 1 -- 172.21.15.33:0/4180484584 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77000cdb30 con 0x7f770015f1a0 2024-05-08T10:55:27.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.447+0000 7f77057b8640 1 --2- 172.21.15.33:0/4180484584 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f77000d04e0 0x7f77000ccf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T10:55:27.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.448+0000 7f7704fb7640 1 --2- 172.21.15.33:0/4180484584 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f770015f1a0 0x7f77000b4880 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f76f40097a0 tx=0x7f76f402a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3cd12182189a38e8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:27.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.448+0000 7f76ff7fe640 1 -- 172.21.15.33:0/4180484584 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f4037070 con 0x7f770015f1a0 2024-05-08T10:55:27.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.448+0000 7f76ff7fe640 1 -- 172.21.15.33:0/4180484584 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76f402adb0 con 0x7f770015f1a0 2024-05-08T10:55:27.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.448+0000 7f76ff7fe640 1 -- 172.21.15.33:0/4180484584 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f4032660 con 0x7f770015f1a0 2024-05-08T10:55:27.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.449+0000 7f770721b640 1 -- 172.21.15.33:0/4180484584 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f770015f1a0 msgr2=0x7f77000b4880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:27.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.449+0000 7f770721b640 1 --2- 172.21.15.33:0/4180484584 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f770015f1a0 0x7f77000b4880 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f76f40097a0 tx=0x7f76f402a060 comp rx=0 tx=0).stop 2024-05-08T10:55:27.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.449+0000 7f770721b640 1 -- 172.21.15.33:0/4180484584 shutdown_connections 2024-05-08T10:55:27.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.449+0000 7f770721b640 1 --2- 172.21.15.33:0/4180484584 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f77000d04e0 0x7f77000ccf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:27.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.449+0000 7f770721b640 1 --2- 172.21.15.33:0/4180484584 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f770015f1a0 0x7f77000b4880 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:27.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.449+0000 7f770721b640 1 -- 172.21.15.33:0/4180484584 >> 172.21.15.33:0/4180484584 conn(0x7f77000b3580 msgr2=0x7f77000b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:27.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.449+0000 7f770721b640 1 -- 172.21.15.33:0/4180484584 shutdown_connections 2024-05-08T10:55:27.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.449+0000 7f770721b640 1 -- 172.21.15.33:0/4180484584 wait complete. 2024-05-08T10:55:27.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.450+0000 7f770721b640 1 Processor -- start 2024-05-08T10:55:27.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.450+0000 7f770721b640 1 -- start start 2024-05-08T10:55:27.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.451+0000 7f770721b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f77000d04e0 0x7f77000ca0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:27.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.451+0000 7f770721b640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f770015f1a0 0x7f770015a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:27.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.451+0000 7f770721b640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f770015f580 0x7f770015b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:27.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.451+0000 7f770721b640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77000b29c0 con 0x7f77000d04e0 2024-05-08T10:55:27.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.451+0000 7f770721b640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77000ce0f0 con 0x7f770015f580 2024-05-08T10:55:27.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.451+0000 7f770721b640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77000b2b40 con 0x7f770015f1a0 2024-05-08T10:55:27.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.451+0000 7f7704fb7640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f77000d04e0 0x7f77000ca0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:27.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.451+0000 7f7704fb7640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f77000d04e0 0x7f77000ca0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33724/0 (socket says 172.21.15.33:33724) 2024-05-08T10:55:27.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.451+0000 7f7704fb7640 1 -- 172.21.15.33:0/1579371559 learned_addr learned my addr 172.21.15.33:0/1579371559 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:27.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.452+0000 7f76fffff640 1 --2- 172.21.15.33:0/1579371559 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f770015f1a0 0x7f770015a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:27.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.452+0000 7f77057b8640 1 --2- 172.21.15.33:0/1579371559 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f770015f580 0x7f770015b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:27.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.452+0000 7f7704fb7640 1 -- 172.21.15.33:0/1579371559 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f770015f1a0 msgr2=0x7f770015a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:27.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.452+0000 7f7704fb7640 1 --2- 172.21.15.33:0/1579371559 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f770015f1a0 0x7f770015a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:27.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.452+0000 7f7704fb7640 1 -- 172.21.15.33:0/1579371559 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f770015f580 msgr2=0x7f770015b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:27.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.452+0000 7f7704fb7640 1 --2- 172.21.15.33:0/1579371559 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f770015f580 0x7f770015b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:27.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.452+0000 7f7704fb7640 1 -- 172.21.15.33:0/1579371559 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f770015ad50 con 0x7f77000d04e0 2024-05-08T10:55:27.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.452+0000 7f7704fb7640 1 --2- 172.21.15.33:0/1579371559 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f77000d04e0 0x7f77000ca0c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f76f40098c0 tx=0x7f76f40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:27.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.452+0000 7f76fd7fa640 1 -- 172.21.15.33:0/1579371559 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f4041030 con 0x7f77000d04e0 2024-05-08T10:55:27.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.452+0000 7f76fd7fa640 1 -- 172.21.15.33:0/1579371559 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76f402abb0 con 0x7f77000d04e0 2024-05-08T10:55:27.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.452+0000 7f76fd7fa640 1 -- 172.21.15.33:0/1579371559 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f4037040 con 0x7f77000d04e0 2024-05-08T10:55:27.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.452+0000 7f770721b640 1 -- 172.21.15.33:0/1579371559 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7700159770 con 0x7f77000d04e0 2024-05-08T10:55:27.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.452+0000 7f770721b640 1 -- 172.21.15.33:0/1579371559 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7700159d30 con 0x7f77000d04e0 2024-05-08T10:55:27.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.453+0000 7f770721b640 1 -- 172.21.15.33:0/1579371559 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7700069d20 con 0x7f77000d04e0 2024-05-08T10:55:27.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.454+0000 7f76fd7fa640 1 -- 172.21.15.33:0/1579371559 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f76f4044070 con 0x7f77000d04e0 2024-05-08T10:55:27.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.454+0000 7f76fd7fa640 1 --2- 172.21.15.33:0/1579371559 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f76e406b4d0 0x7f76e406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:27.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.454+0000 7f76fd7fa640 1 -- 172.21.15.33:0/1579371559 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f76f40aa440 con 0x7f77000d04e0 2024-05-08T10:55:27.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.454+0000 7f76fffff640 1 --2- 172.21.15.33:0/1579371559 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f76e406b4d0 0x7f76e406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:27.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.455+0000 7f76fffff640 1 --2- 172.21.15.33:0/1579371559 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f76e406b4d0 0x7f76e406d990 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f77001efb10 tx=0x7f76ec007e80 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:27.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.458+0000 7f76fd7fa640 1 -- 172.21.15.33:0/1579371559 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f76f4079730 con 0x7f77000d04e0 2024-05-08T10:55:27.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.707+0000 7f770721b640 1 -- 172.21.15.33:0/1579371559 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f77000cf9a0 con 0x7f77000d04e0 2024-05-08T10:55:27.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.709+0000 7f76fd7fa640 1 -- 172.21.15.33:0/1579371559 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7f76f4079030 con 0x7f77000d04e0 2024-05-08T10:55:27.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.711+0000 7f770721b640 1 -- 172.21.15.33:0/1579371559 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f76e406b4d0 msgr2=0x7f76e406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:27.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.711+0000 7f770721b640 1 --2- 172.21.15.33:0/1579371559 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f76e406b4d0 0x7f76e406d990 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f77001efb10 tx=0x7f76ec007e80 comp rx=0 tx=0).stop 2024-05-08T10:55:27.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.711+0000 7f770721b640 1 -- 172.21.15.33:0/1579371559 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f77000d04e0 msgr2=0x7f77000ca0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:27.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.711+0000 7f770721b640 1 --2- 172.21.15.33:0/1579371559 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f77000d04e0 0x7f77000ca0c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f76f40098c0 tx=0x7f76f40046c0 comp rx=0 tx=0).stop 2024-05-08T10:55:27.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.711+0000 7f770721b640 1 -- 172.21.15.33:0/1579371559 shutdown_connections 2024-05-08T10:55:27.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.711+0000 7f770721b640 1 --2- 172.21.15.33:0/1579371559 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f76e406b4d0 0x7f76e406d990 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:27.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.711+0000 7f770721b640 1 --2- 172.21.15.33:0/1579371559 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f770015f580 0x7f770015b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:27.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.711+0000 7f770721b640 1 --2- 172.21.15.33:0/1579371559 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f770015f1a0 0x7f770015a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:27.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.711+0000 7f770721b640 1 --2- 172.21.15.33:0/1579371559 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f77000d04e0 0x7f77000ca0c0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:27.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.711+0000 7f770721b640 1 -- 172.21.15.33:0/1579371559 >> 172.21.15.33:0/1579371559 conn(0x7f77000b3580 msgr2=0x7f77000b6840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:27.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.711+0000 7f770721b640 1 -- 172.21.15.33:0/1579371559 shutdown_connections 2024-05-08T10:55:27.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.711+0000 7f770721b640 1 -- 172.21.15.33:0/1579371559 wait complete. 2024-05-08T10:55:27.719 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-05-08T10:55:27.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.827+0000 7efe8fde2640 1 Processor -- start 2024-05-08T10:55:27.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.828+0000 7efe8fde2640 1 -- start start 2024-05-08T10:55:27.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.828+0000 7efe8fde2640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7efe8815df00 0x7efe880d0b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:27.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.828+0000 7efe8fde2640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe880d1160 con 0x7efe880d2070 2024-05-08T10:55:27.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.828+0000 7efe8fde2640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe880b30b0 con 0x7efe880d2570 2024-05-08T10:55:27.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.828+0000 7efe8fde2640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe880b3700 con 0x7efe8815df00 2024-05-08T10:55:27.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.828+0000 7efe8e37f640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7efe880d2070 0x7efe880b3b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:53912/0 (socket says 172.21.15.33:53912) 2024-05-08T10:55:27.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.828+0000 7efe8e37f640 1 -- 172.21.15.33:0/884512691 learned_addr learned my addr 172.21.15.33:0/884512691 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-05-08T10:55:27.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.829+0000 7efe8db7e640 1 --2- 172.21.15.33:0/884512691 >> v2:172.21.15.174:3300/0 conn(0x7efe8815df00 0x7efe880d0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:27.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.829+0000 7efe8cb7c640 1 -- 172.21.15.33:0/884512691 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2130969905 0 0) 0x7efe880d1160 con 0x7efe880d2070 2024-05-08T10:55:27.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.829+0000 7efe8cb7c640 1 -- 172.21.15.33:0/884512691 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe70003520 con 0x7efe880d2070 2024-05-08T10:55:27.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.829+0000 7efe8cb7c640 1 -- 172.21.15.33:0/884512691 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3850532111 0 0) 0x7efe70003520 con 0x7efe880d2070 2024-05-08T10:55:27.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.829+0000 7efe8cb7c640 1 -- 172.21.15.33:0/884512691 >> v2:172.21.15.174:3300/0 conn(0x7efe8815df00 msgr2=0x7efe880d0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:27.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.829+0000 7efe8cb7c640 1 --2- 172.21.15.33:0/884512691 >> v2:172.21.15.174:3300/0 conn(0x7efe8815df00 0x7efe880d0b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:27.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.829+0000 7efe8cb7c640 1 -- 172.21.15.33:0/884512691 >> v1:172.21.15.174:6789/0 conn(0x7efe880d2570 legacy=0x7efe880d1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:27.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.829+0000 7efe8cb7c640 1 -- 172.21.15.33:0/884512691 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe880b3390 con 0x7efe880d2070 2024-05-08T10:55:27.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.829+0000 7efe8cb7c640 1 -- 172.21.15.33:0/884512691 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2948294915 0 0) 0x7efe780019f0 con 0x7efe880d2070 2024-05-08T10:55:27.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.829+0000 7efe8cb7c640 1 -- 172.21.15.33:0/884512691 >> v1:172.21.15.33:6789/0 conn(0x7efe880d2070 legacy=0x7efe880b3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:27.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.829+0000 7efe8cb7c640 1 --2- 172.21.15.33:0/884512691 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe700039b0 0x7efe70003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:27.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.829+0000 7efe8cb7c640 1 --2- 172.21.15.33:0/884512691 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efe70004800 0x7efe70004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:27.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.829+0000 7efe8cb7c640 1 --2- 172.21.15.33:0/884512691 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efe700051c0 0x7efe7000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:27.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.829+0000 7efe8cb7c640 1 -- 172.21.15.33:0/884512691 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe880b3700 con 0x7efe70004800 2024-05-08T10:55:27.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.829+0000 7efe8cb7c640 1 -- 172.21.15.33:0/884512691 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe7000c060 con 0x7efe700039b0 2024-05-08T10:55:27.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.829+0000 7efe8cb7c640 1 -- 172.21.15.33:0/884512691 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe7000c260 con 0x7efe700051c0 2024-05-08T10:55:27.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.829+0000 7efe8d37d640 1 --2- 172.21.15.33:0/884512691 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efe70004800 0x7efe70004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:27.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.829+0000 7efe8db7e640 1 --2- 172.21.15.33:0/884512691 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe700039b0 0x7efe70003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:27.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.829+0000 7efe8e37f640 1 --2- 172.21.15.33:0/884512691 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efe700051c0 0x7efe7000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:27.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.830+0000 7efe8d37d640 1 -- 172.21.15.33:0/884512691 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efe700051c0 msgr2=0x7efe7000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:27.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.830+0000 7efe8d37d640 1 --2- 172.21.15.33:0/884512691 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efe700051c0 0x7efe7000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:27.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.830+0000 7efe8d37d640 1 -- 172.21.15.33:0/884512691 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe700039b0 msgr2=0x7efe70003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:27.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.830+0000 7efe8d37d640 1 --2- 172.21.15.33:0/884512691 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe700039b0 0x7efe70003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:27.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.830+0000 7efe8d37d640 1 -- 172.21.15.33:0/884512691 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe70003520 con 0x7efe70004800 2024-05-08T10:55:27.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.830+0000 7efe8e37f640 1 -- 172.21.15.33:0/884512691 reap_dead start 2024-05-08T10:55:27.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.830+0000 7efe8db7e640 1 --2- 172.21.15.33:0/884512691 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe700039b0 0x7efe70003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:55:27.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.830+0000 7efe8d37d640 1 --2- 172.21.15.33:0/884512691 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efe70004800 0x7efe70004c80 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7efe7c001750 tx=0x7efe70005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9b8c4393bd5f769 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:27.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.830+0000 7efe8cb7c640 1 -- 172.21.15.33:0/884512691 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe7c001370 con 0x7efe70004800 2024-05-08T10:55:27.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.830+0000 7efe8cb7c640 1 -- 172.21.15.33:0/884512691 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe7c0052d0 con 0x7efe70004800 2024-05-08T10:55:27.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.830+0000 7efe8cb7c640 1 -- 172.21.15.33:0/884512691 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe7c02abc0 con 0x7efe70004800 2024-05-08T10:55:27.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.831+0000 7efe8fde2640 1 -- 172.21.15.33:0/884512691 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efe70004800 msgr2=0x7efe70004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:27.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.831+0000 7efe8fde2640 1 --2- 172.21.15.33:0/884512691 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efe70004800 0x7efe70004c80 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7efe7c001750 tx=0x7efe70005830 comp rx=0 tx=0).stop 2024-05-08T10:55:27.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.831+0000 7efe8fde2640 1 -- 172.21.15.33:0/884512691 shutdown_connections 2024-05-08T10:55:27.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.831+0000 7efe8fde2640 1 --2- 172.21.15.33:0/884512691 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efe70004800 0x7efe70004c80 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:27.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.831+0000 7efe8fde2640 1 -- 172.21.15.33:0/884512691 >> 172.21.15.33:0/884512691 conn(0x7efe880d3b80 msgr2=0x7efe880d3f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:27.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.831+0000 7efe8fde2640 1 -- 172.21.15.33:0/884512691 shutdown_connections 2024-05-08T10:55:27.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.831+0000 7efe8fde2640 1 -- 172.21.15.33:0/884512691 wait complete. 2024-05-08T10:55:27.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.832+0000 7efe8fde2640 1 Processor -- start 2024-05-08T10:55:27.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.832+0000 7efe8fde2640 1 -- start start 2024-05-08T10:55:27.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.833+0000 7efe8fde2640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efe70004800 0x7efe881440f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:27.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.833+0000 7efe8fde2640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efe88144630 0x7efe881604c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:27.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.833+0000 7efe8fde2640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe88160a00 0x7efe88153af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:27.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.833+0000 7efe8fde2640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe8815e2e0 con 0x7efe70004800 2024-05-08T10:55:27.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.833+0000 7efe8fde2640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe880d1440 con 0x7efe88160a00 2024-05-08T10:55:27.835 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.833+0000 7efe8fde2640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe880d0b30 con 0x7efe88144630 2024-05-08T10:55:27.835 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.833+0000 7efe8db7e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efe70004800 0x7efe881440f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:27.835 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.833+0000 7efe8db7e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efe70004800 0x7efe881440f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33744/0 (socket says 172.21.15.33:33744) 2024-05-08T10:55:27.835 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.833+0000 7efe8db7e640 1 -- 172.21.15.33:0/2866931338 learned_addr learned my addr 172.21.15.33:0/2866931338 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:27.835 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.833+0000 7efe8d37d640 1 --2- 172.21.15.33:0/2866931338 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efe88144630 0x7efe881604c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:27.835 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.833+0000 7efe8e37f640 1 --2- 172.21.15.33:0/2866931338 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe88160a00 0x7efe88153af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:27.835 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.833+0000 7efe8db7e640 1 -- 172.21.15.33:0/2866931338 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efe88144630 msgr2=0x7efe881604c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:27.835 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.833+0000 7efe8db7e640 1 --2- 172.21.15.33:0/2866931338 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efe88144630 0x7efe881604c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:27.835 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.833+0000 7efe8db7e640 1 -- 172.21.15.33:0/2866931338 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe88160a00 msgr2=0x7efe88153af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:27.835 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.833+0000 7efe8db7e640 1 --2- 172.21.15.33:0/2866931338 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe88160a00 0x7efe88153af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:27.835 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.833+0000 7efe8db7e640 1 -- 172.21.15.33:0/2866931338 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe8815f700 con 0x7efe70004800 2024-05-08T10:55:27.835 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.834+0000 7efe8db7e640 1 --2- 172.21.15.33:0/2866931338 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efe70004800 0x7efe881440f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7efe800114e0 tx=0x7efe800119a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:27.835 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.834+0000 7efe867fc640 1 -- 172.21.15.33:0/2866931338 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe80015870 con 0x7efe70004800 2024-05-08T10:55:27.835 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.834+0000 7efe867fc640 1 -- 172.21.15.33:0/2866931338 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe80015a10 con 0x7efe70004800 2024-05-08T10:55:27.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.834+0000 7efe8fde2640 1 -- 172.21.15.33:0/2866931338 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe8815f9e0 con 0x7efe70004800 2024-05-08T10:55:27.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.834+0000 7efe867fc640 1 -- 172.21.15.33:0/2866931338 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe80015e00 con 0x7efe70004800 2024-05-08T10:55:27.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.834+0000 7efe8fde2640 1 -- 172.21.15.33:0/2866931338 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe8815ffa0 con 0x7efe70004800 2024-05-08T10:55:27.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.835+0000 7efe8fde2640 1 -- 172.21.15.33:0/2866931338 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe88160e10 con 0x7efe70004800 2024-05-08T10:55:27.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.835+0000 7efe867fc640 1 -- 172.21.15.33:0/2866931338 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7efe8001d400 con 0x7efe70004800 2024-05-08T10:55:27.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.836+0000 7efe867fc640 1 --2- 172.21.15.33:0/2866931338 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7efe7406b4d0 0x7efe7406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:27.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.836+0000 7efe867fc640 1 -- 172.21.15.33:0/2866931338 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7efe8008a740 con 0x7efe70004800 2024-05-08T10:55:27.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.836+0000 7efe8d37d640 1 --2- 172.21.15.33:0/2866931338 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7efe7406b4d0 0x7efe7406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:27.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.836+0000 7efe8d37d640 1 --2- 172.21.15.33:0/2866931338 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7efe7406b4d0 0x7efe7406d990 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7efe7c032000 tx=0x7efe7c02e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:27.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:27.840+0000 7efe867fc640 1 -- 172.21.15.33:0/2866931338 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7efe80019030 con 0x7efe70004800 2024-05-08T10:55:28.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.089+0000 7efe8fde2640 1 -- 172.21.15.33:0/2866931338 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7efe88069d20 con 0x7efe70004800 2024-05-08T10:55:28.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.091+0000 7efe867fc640 1 -- 172.21.15.33:0/2866931338 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v13) v1 ==== 97+0+0 (secure 0 0 0) 0x7efe80059350 con 0x7efe70004800 2024-05-08T10:55:28.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.093+0000 7efe8fde2640 1 -- 172.21.15.33:0/2866931338 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7efe7406b4d0 msgr2=0x7efe7406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:28.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.093+0000 7efe8fde2640 1 --2- 172.21.15.33:0/2866931338 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7efe7406b4d0 0x7efe7406d990 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7efe7c032000 tx=0x7efe7c02e000 comp rx=0 tx=0).stop 2024-05-08T10:55:28.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.093+0000 7efe8fde2640 1 -- 172.21.15.33:0/2866931338 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efe70004800 msgr2=0x7efe881440f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:28.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.093+0000 7efe8fde2640 1 --2- 172.21.15.33:0/2866931338 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efe70004800 0x7efe881440f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7efe800114e0 tx=0x7efe800119a0 comp rx=0 tx=0).stop 2024-05-08T10:55:28.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.093+0000 7efe8fde2640 1 -- 172.21.15.33:0/2866931338 shutdown_connections 2024-05-08T10:55:28.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.093+0000 7efe8fde2640 1 --2- 172.21.15.33:0/2866931338 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7efe7406b4d0 0x7efe7406d990 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:28.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.093+0000 7efe8fde2640 1 --2- 172.21.15.33:0/2866931338 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe88160a00 0x7efe88153af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:28.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.093+0000 7efe8fde2640 1 --2- 172.21.15.33:0/2866931338 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efe88144630 0x7efe881604c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:28.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.093+0000 7efe8fde2640 1 --2- 172.21.15.33:0/2866931338 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efe70004800 0x7efe881440f0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:28.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.093+0000 7efe8fde2640 1 -- 172.21.15.33:0/2866931338 >> 172.21.15.33:0/2866931338 conn(0x7efe880d3b80 msgr2=0x7efe880b2680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:28.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.093+0000 7efe8fde2640 1 -- 172.21.15.33:0/2866931338 shutdown_connections 2024-05-08T10:55:28.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.093+0000 7efe8fde2640 1 -- 172.21.15.33:0/2866931338 wait complete. 2024-05-08T10:55:28.101 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-05-08T10:55:28.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.209+0000 7fe1c6b70640 1 Processor -- start 2024-05-08T10:55:28.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.209+0000 7fe1c6b70640 1 -- start start 2024-05-08T10:55:28.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.210+0000 7fe1c6b70640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe1c015e2c0 0x7fe1c00b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:28.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.210+0000 7fe1c6b70640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fe1c00b40a0 0x7fe1c0162380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:28.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.210+0000 7fe1c6b70640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1c006c3f0 con 0x7fe1c015dee0 2024-05-08T10:55:28.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.210+0000 7fe1c6b70640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1c006bec0 con 0x7fe1c00b40a0 2024-05-08T10:55:28.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.210+0000 7fe1c6b70640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1c01629f0 con 0x7fe1c015e2c0 2024-05-08T10:55:28.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.210+0000 7fe1c510d640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fe1c00b40a0 0x7fe1c0162380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:28.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.210+0000 7fe1c490c640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fe1c015dee0 0x7fe1c0161c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:53916/0 (socket says 172.21.15.33:53916) 2024-05-08T10:55:28.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.210+0000 7fe1c490c640 1 -- 172.21.15.33:0/3250051411 learned_addr learned my addr 172.21.15.33:0/3250051411 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-05-08T10:55:28.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.210+0000 7fe1c510d640 1 -- 172.21.15.33:0/3250051411 >> v2:172.21.15.174:3300/0 conn(0x7fe1c015e2c0 msgr2=0x7fe1c00b2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:28.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.210+0000 7fe1c510d640 1 --2- 172.21.15.33:0/3250051411 >> v2:172.21.15.174:3300/0 conn(0x7fe1c015e2c0 0x7fe1c00b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:28.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.210+0000 7fe1c510d640 1 -- 172.21.15.33:0/3250051411 >> v1:172.21.15.33:6789/0 conn(0x7fe1c015dee0 legacy=0x7fe1c0161c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:28.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.210+0000 7fe1c510d640 1 -- 172.21.15.33:0/3250051411 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1c006c110 con 0x7fe1c00b40a0 2024-05-08T10:55:28.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.210+0000 7fe1b77fe640 1 -- 172.21.15.33:0/3250051411 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 437380385 0 0) 0x7fe1c006c3f0 con 0x7fe1c015dee0 2024-05-08T10:55:28.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.211+0000 7fe1c510d640 1 --2- 172.21.15.33:0/3250051411 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe1c00b40a0 0x7fe1c0162380 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe1c00681c0 tx=0x7fe1b802a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c20470495ac1279a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:28.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.211+0000 7fe1b77fe640 1 -- 172.21.15.33:0/3250051411 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1b8007740 con 0x7fe1c00b40a0 2024-05-08T10:55:28.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.211+0000 7fe1b77fe640 1 -- 172.21.15.33:0/3250051411 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1b80078e0 con 0x7fe1c00b40a0 2024-05-08T10:55:28.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.211+0000 7fe1b77fe640 1 -- 172.21.15.33:0/3250051411 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1b8007cb0 con 0x7fe1c00b40a0 2024-05-08T10:55:28.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.212+0000 7fe1c6b70640 1 -- 172.21.15.33:0/3250051411 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe1c00b40a0 msgr2=0x7fe1c0162380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:28.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.212+0000 7fe1c6b70640 1 --2- 172.21.15.33:0/3250051411 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe1c00b40a0 0x7fe1c0162380 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe1c00681c0 tx=0x7fe1b802a560 comp rx=0 tx=0).stop 2024-05-08T10:55:28.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.212+0000 7fe1c6b70640 1 -- 172.21.15.33:0/3250051411 shutdown_connections 2024-05-08T10:55:28.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.212+0000 7fe1c6b70640 1 --2- 172.21.15.33:0/3250051411 >> v2:172.21.15.174:3300/0 conn(0x7fe1c015e2c0 0x7fe1c00b2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:28.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.212+0000 7fe1c6b70640 1 --2- 172.21.15.33:0/3250051411 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe1c00b40a0 0x7fe1c0162380 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:28.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.212+0000 7fe1c6b70640 1 -- 172.21.15.33:0/3250051411 >> 172.21.15.33:0/3250051411 conn(0x7fe1c00b3580 msgr2=0x7fe1c00b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:28.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.212+0000 7fe1c6b70640 1 -- 172.21.15.33:0/3250051411 shutdown_connections 2024-05-08T10:55:28.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.212+0000 7fe1c6b70640 1 -- 172.21.15.33:0/3250051411 wait complete. 2024-05-08T10:55:28.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.213+0000 7fe1c6b70640 1 Processor -- start 2024-05-08T10:55:28.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.213+0000 7fe1c6b70640 1 -- start start 2024-05-08T10:55:28.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.214+0000 7fe1c6b70640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe1c00b40a0 0x7fe1c0157670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:28.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.214+0000 7fe1c6b70640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe1c015dee0 0x7fe1c01606b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:28.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.214+0000 7fe1c6b70640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe1c015e2c0 0x7fe1c0154b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:28.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.214+0000 7fe1c6b70640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c00b4fc0 con 0x7fe1c015dee0 2024-05-08T10:55:28.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.214+0000 7fe1c6b70640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c00b4e40 con 0x7fe1c00b40a0 2024-05-08T10:55:28.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.214+0000 7fe1c6b70640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c00b5140 con 0x7fe1c015e2c0 2024-05-08T10:55:28.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.214+0000 7fe1b7fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe1c015dee0 0x7fe1c01606b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:28.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.214+0000 7fe1b7fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe1c015dee0 0x7fe1c01606b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33758/0 (socket says 172.21.15.33:33758) 2024-05-08T10:55:28.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.214+0000 7fe1b7fff640 1 -- 172.21.15.33:0/3920345128 learned_addr learned my addr 172.21.15.33:0/3920345128 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:28.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.214+0000 7fe1b7fff640 1 -- 172.21.15.33:0/3920345128 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe1c015e2c0 msgr2=0x7fe1c0154b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:28.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.214+0000 7fe1b7fff640 1 --2- 172.21.15.33:0/3920345128 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe1c015e2c0 0x7fe1c0154b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:28.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.214+0000 7fe1b7fff640 1 -- 172.21.15.33:0/3920345128 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe1c00b40a0 msgr2=0x7fe1c0157670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:28.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.214+0000 7fe1b7fff640 1 --2- 172.21.15.33:0/3920345128 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe1c00b40a0 0x7fe1c0157670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:28.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.214+0000 7fe1b7fff640 1 -- 172.21.15.33:0/3920345128 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1c01619b0 con 0x7fe1c015dee0 2024-05-08T10:55:28.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.214+0000 7fe1b7fff640 1 --2- 172.21.15.33:0/3920345128 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe1c015dee0 0x7fe1c01606b0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe1b000b440 tx=0x7fe1b000b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:28.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.215+0000 7fe1b57fa640 1 -- 172.21.15.33:0/3920345128 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1b0015020 con 0x7fe1c015dee0 2024-05-08T10:55:28.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.215+0000 7fe1b57fa640 1 -- 172.21.15.33:0/3920345128 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1b00118b0 con 0x7fe1c015dee0 2024-05-08T10:55:28.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.215+0000 7fe1c6b70640 1 -- 172.21.15.33:0/3920345128 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1c0161110 con 0x7fe1c015dee0 2024-05-08T10:55:28.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.215+0000 7fe1b57fa640 1 -- 172.21.15.33:0/3920345128 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1b0011ca0 con 0x7fe1c015dee0 2024-05-08T10:55:28.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.215+0000 7fe1c6b70640 1 -- 172.21.15.33:0/3920345128 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1c01616d0 con 0x7fe1c015dee0 2024-05-08T10:55:28.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.216+0000 7fe1c6b70640 1 -- 172.21.15.33:0/3920345128 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1c0069d20 con 0x7fe1c015dee0 2024-05-08T10:55:28.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.216+0000 7fe1b57fa640 1 -- 172.21.15.33:0/3920345128 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe1b0018020 con 0x7fe1c015dee0 2024-05-08T10:55:28.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.217+0000 7fe1b57fa640 1 --2- 172.21.15.33:0/3920345128 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fe1ac06b500 0x7fe1ac06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:28.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.217+0000 7fe1b57fa640 1 -- 172.21.15.33:0/3920345128 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe1b0089f20 con 0x7fe1c015dee0 2024-05-08T10:55:28.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.217+0000 7fe1c490c640 1 --2- 172.21.15.33:0/3920345128 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fe1ac06b500 0x7fe1ac06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:28.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.217+0000 7fe1c490c640 1 --2- 172.21.15.33:0/3920345128 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fe1ac06b500 0x7fe1ac06d9c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc007fd0 tx=0x7fe1bc007920 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:28.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.221+0000 7fe1b57fa640 1 -- 172.21.15.33:0/3920345128 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe1b001f020 con 0x7fe1c015dee0 2024-05-08T10:55:28.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.468+0000 7fe1c6b70640 1 -- 172.21.15.33:0/3920345128 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7fe1c006c3f0 con 0x7fe1c015dee0 2024-05-08T10:55:28.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.471+0000 7fe1b57fa640 1 -- 172.21.15.33:0/3920345128 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v14) v1 ==== 90+0+0 (secure 0 0 0) 0x7fe1b000d040 con 0x7fe1c015dee0 2024-05-08T10:55:28.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.472+0000 7fe1c6b70640 1 -- 172.21.15.33:0/3920345128 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fe1ac06b500 msgr2=0x7fe1ac06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:28.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.472+0000 7fe1c6b70640 1 --2- 172.21.15.33:0/3920345128 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fe1ac06b500 0x7fe1ac06d9c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc007fd0 tx=0x7fe1bc007920 comp rx=0 tx=0).stop 2024-05-08T10:55:28.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.472+0000 7fe1c6b70640 1 -- 172.21.15.33:0/3920345128 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe1c015dee0 msgr2=0x7fe1c01606b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:28.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.472+0000 7fe1c6b70640 1 --2- 172.21.15.33:0/3920345128 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe1c015dee0 0x7fe1c01606b0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe1b000b440 tx=0x7fe1b000b900 comp rx=0 tx=0).stop 2024-05-08T10:55:28.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.473+0000 7fe1c6b70640 1 -- 172.21.15.33:0/3920345128 shutdown_connections 2024-05-08T10:55:28.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.473+0000 7fe1c6b70640 1 --2- 172.21.15.33:0/3920345128 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fe1ac06b500 0x7fe1ac06d9c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:28.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.473+0000 7fe1c6b70640 1 --2- 172.21.15.33:0/3920345128 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe1c015e2c0 0x7fe1c0154b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:28.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.473+0000 7fe1c6b70640 1 --2- 172.21.15.33:0/3920345128 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe1c015dee0 0x7fe1c01606b0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:28.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.473+0000 7fe1c6b70640 1 --2- 172.21.15.33:0/3920345128 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe1c00b40a0 0x7fe1c0157670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:28.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.473+0000 7fe1c6b70640 1 -- 172.21.15.33:0/3920345128 >> 172.21.15.33:0/3920345128 conn(0x7fe1c00b3580 msgr2=0x7fe1c015d110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:28.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.473+0000 7fe1c6b70640 1 -- 172.21.15.33:0/3920345128 shutdown_connections 2024-05-08T10:55:28.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.473+0000 7fe1c6b70640 1 -- 172.21.15.33:0/3920345128 wait complete. 2024-05-08T10:55:28.481 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-08T10:55:28.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.587+0000 7f2848e95640 1 Processor -- start 2024-05-08T10:55:28.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.588+0000 7f2848e95640 1 -- start start 2024-05-08T10:55:28.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.588+0000 7f2848e95640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f28440d4960 0x7f28440d17e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:28.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.588+0000 7f2848e95640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28440ce720 con 0x7f28441613a0 2024-05-08T10:55:28.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.588+0000 7f2848e95640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28440d12d0 con 0x7f28440d1e10 2024-05-08T10:55:28.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.588+0000 7f2848e95640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28440cf010 con 0x7f28440d4960 2024-05-08T10:55:28.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.589+0000 7f284259c640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f28441613a0 0x7f28440cf4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:53928/0 (socket says 172.21.15.33:53928) 2024-05-08T10:55:28.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.589+0000 7f284259c640 1 -- 172.21.15.33:0/3452402193 learned_addr learned my addr 172.21.15.33:0/3452402193 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-05-08T10:55:28.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.589+0000 7f2841d9b640 1 --2- 172.21.15.33:0/3452402193 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f28440d4960 0x7f28440d17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:28.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.589+0000 7f284159a640 1 -- 172.21.15.33:0/3452402193 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 44266202 0 0) 0x7f28440ce720 con 0x7f28441613a0 2024-05-08T10:55:28.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.589+0000 7f284159a640 1 -- 172.21.15.33:0/3452402193 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2830003520 con 0x7f28441613a0 2024-05-08T10:55:28.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.589+0000 7f284159a640 1 -- 172.21.15.33:0/3452402193 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 567588528 0 0) 0x7f2830003520 con 0x7f28441613a0 2024-05-08T10:55:28.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.589+0000 7f284159a640 1 -- 172.21.15.33:0/3452402193 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f28440d4960 msgr2=0x7f28440d17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:28.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.589+0000 7f284159a640 1 --2- 172.21.15.33:0/3452402193 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f28440d4960 0x7f28440d17e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:28.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.589+0000 7f284159a640 1 -- 172.21.15.33:0/3452402193 >> v1:172.21.15.174:6789/0 conn(0x7f28440d1e10 legacy=0x7f28440b0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:28.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.589+0000 7f284159a640 1 -- 172.21.15.33:0/3452402193 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28440ce9c0 con 0x7f28441613a0 2024-05-08T10:55:28.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.589+0000 7f284159a640 1 -- 172.21.15.33:0/3452402193 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2948294915 0 0) 0x7f283c0019f0 con 0x7f28441613a0 2024-05-08T10:55:28.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.589+0000 7f284159a640 1 -- 172.21.15.33:0/3452402193 >> v1:172.21.15.33:6789/0 conn(0x7f28441613a0 legacy=0x7f28440cf4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:28.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.589+0000 7f284159a640 1 --2- 172.21.15.33:0/3452402193 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f28440d4960 0x7f28300039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:28.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.589+0000 7f284159a640 1 --2- 172.21.15.33:0/3452402193 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2830003f20 0x7f2830004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:28.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.589+0000 7f284159a640 1 --2- 172.21.15.33:0/3452402193 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2830004d40 0x7f28300051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:28.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.589+0000 7f284159a640 1 -- 172.21.15.33:0/3452402193 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28440cf010 con 0x7f2830003f20 2024-05-08T10:55:28.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.589+0000 7f284159a640 1 -- 172.21.15.33:0/3452402193 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f283000ba20 con 0x7f2830004d40 2024-05-08T10:55:28.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.589+0000 7f284159a640 1 -- 172.21.15.33:0/3452402193 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f283000bc20 con 0x7f28440d4960 2024-05-08T10:55:28.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.589+0000 7f2841d9b640 1 --2- 172.21.15.33:0/3452402193 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2830003f20 0x7f2830004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:28.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.589+0000 7f284259c640 1 --2- 172.21.15.33:0/3452402193 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f28440d4960 0x7f28300039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:28.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.589+0000 7f2842d9d640 1 --2- 172.21.15.33:0/3452402193 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2830004d40 0x7f28300051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:28.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.590+0000 7f2841d9b640 1 -- 172.21.15.33:0/3452402193 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f28440d4960 msgr2=0x7f28300039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:28.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.590+0000 7f2841d9b640 1 --2- 172.21.15.33:0/3452402193 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f28440d4960 0x7f28300039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:28.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.590+0000 7f2841d9b640 1 -- 172.21.15.33:0/3452402193 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2830004d40 msgr2=0x7f28300051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:28.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.590+0000 7f2841d9b640 1 --2- 172.21.15.33:0/3452402193 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2830004d40 0x7f28300051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:28.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.590+0000 7f2841d9b640 1 -- 172.21.15.33:0/3452402193 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2830003520 con 0x7f2830003f20 2024-05-08T10:55:28.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.590+0000 7f2841d9b640 1 --2- 172.21.15.33:0/3452402193 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2830003f20 0x7f2830004800 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f282c009ac0 tx=0x7f2830005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d395f76ae6f8af8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:28.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.591+0000 7f284159a640 1 -- 172.21.15.33:0/3452402193 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f282c036070 con 0x7f2830003f20 2024-05-08T10:55:28.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.591+0000 7f284159a640 1 -- 172.21.15.33:0/3452402193 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f282c031400 con 0x7f2830003f20 2024-05-08T10:55:28.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.591+0000 7f284159a640 1 -- 172.21.15.33:0/3452402193 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f282c009690 con 0x7f2830003f20 2024-05-08T10:55:28.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.591+0000 7f2848e95640 1 -- 172.21.15.33:0/3452402193 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2830003f20 msgr2=0x7f2830004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:28.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.591+0000 7f2848e95640 1 --2- 172.21.15.33:0/3452402193 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2830003f20 0x7f2830004800 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f282c009ac0 tx=0x7f2830005830 comp rx=0 tx=0).stop 2024-05-08T10:55:28.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.591+0000 7f2842d9d640 1 -- 172.21.15.33:0/3452402193 reap_dead start 2024-05-08T10:55:28.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.591+0000 7f2848e95640 1 -- 172.21.15.33:0/3452402193 shutdown_connections 2024-05-08T10:55:28.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.591+0000 7f2848e95640 1 -- 172.21.15.33:0/3452402193 >> 172.21.15.33:0/3452402193 conn(0x7f28440d3c10 msgr2=0x7f28440d4020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:28.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.591+0000 7f2848e95640 1 -- 172.21.15.33:0/3452402193 shutdown_connections 2024-05-08T10:55:28.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.591+0000 7f2848e95640 1 -- 172.21.15.33:0/3452402193 wait complete. 2024-05-08T10:55:28.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.593+0000 7f2848e95640 1 Processor -- start 2024-05-08T10:55:28.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.593+0000 7f2848e95640 1 -- start start 2024-05-08T10:55:28.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.593+0000 7f2848e95640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2830003f20 0x7f28440a1400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:28.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.593+0000 7f2848e95640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f28440cd0e0 0x7f28440cd560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:28.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.593+0000 7f2848e95640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2844155dd0 0x7f2844156250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:28.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.593+0000 7f2848e95640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28440d0f80 con 0x7f2830003f20 2024-05-08T10:55:28.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.593+0000 7f2848e95640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28440cfbb0 con 0x7f28440cd0e0 2024-05-08T10:55:28.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.593+0000 7f2848e95640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2844161780 con 0x7f2844155dd0 2024-05-08T10:55:28.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.594+0000 7f284259c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2830003f20 0x7f28440a1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:28.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.594+0000 7f284259c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2830003f20 0x7f28440a1400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33780/0 (socket says 172.21.15.33:33780) 2024-05-08T10:55:28.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.594+0000 7f284259c640 1 -- 172.21.15.33:0/3485795177 learned_addr learned my addr 172.21.15.33:0/3485795177 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:28.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.594+0000 7f2842d9d640 1 --2- 172.21.15.33:0/3485795177 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2844155dd0 0x7f2844156250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:28.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.594+0000 7f2841d9b640 1 --2- 172.21.15.33:0/3485795177 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f28440cd0e0 0x7f28440cd560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:28.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.594+0000 7f284259c640 1 -- 172.21.15.33:0/3485795177 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2844155dd0 msgr2=0x7f2844156250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:28.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.594+0000 7f284259c640 1 --2- 172.21.15.33:0/3485795177 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2844155dd0 0x7f2844156250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:28.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.594+0000 7f284259c640 1 -- 172.21.15.33:0/3485795177 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f28440cd0e0 msgr2=0x7f28440cd560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:28.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.594+0000 7f284259c640 1 --2- 172.21.15.33:0/3485795177 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f28440cd0e0 0x7f28440cd560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:28.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.594+0000 7f284259c640 1 -- 172.21.15.33:0/3485795177 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2844156790 con 0x7f2830003f20 2024-05-08T10:55:28.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.594+0000 7f2842d9d640 1 --2- 172.21.15.33:0/3485795177 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2844155dd0 0x7f2844156250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:55:28.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.594+0000 7f2841d9b640 1 --2- 172.21.15.33:0/3485795177 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f28440cd0e0 0x7f28440cd560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:55:28.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.594+0000 7f284259c640 1 --2- 172.21.15.33:0/3485795177 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2830003f20 0x7f28440a1400 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f283c0012e0 tx=0x7f283c00a750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:28.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.594+0000 7f283affd640 1 -- 172.21.15.33:0/3485795177 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f283c017020 con 0x7f2830003f20 2024-05-08T10:55:28.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.594+0000 7f283affd640 1 -- 172.21.15.33:0/3485795177 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f283c007ab0 con 0x7f2830003f20 2024-05-08T10:55:28.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.594+0000 7f2848e95640 1 -- 172.21.15.33:0/3485795177 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28441f7870 con 0x7f2830003f20 2024-05-08T10:55:28.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.594+0000 7f283affd640 1 -- 172.21.15.33:0/3485795177 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f283c00ae60 con 0x7f2830003f20 2024-05-08T10:55:28.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.594+0000 7f2848e95640 1 -- 172.21.15.33:0/3485795177 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28441f7e30 con 0x7f2830003f20 2024-05-08T10:55:28.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.595+0000 7f2848e95640 1 -- 172.21.15.33:0/3485795177 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2844069d20 con 0x7f2830003f20 2024-05-08T10:55:28.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.596+0000 7f283affd640 1 -- 172.21.15.33:0/3485795177 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f283c01a020 con 0x7f2830003f20 2024-05-08T10:55:28.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.596+0000 7f283affd640 1 --2- 172.21.15.33:0/3485795177 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f282406b500 0x7f282406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:28.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.597+0000 7f283affd640 1 -- 172.21.15.33:0/3485795177 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f283c08aa70 con 0x7f2830003f20 2024-05-08T10:55:28.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.597+0000 7f2841d9b640 1 --2- 172.21.15.33:0/3485795177 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f282406b500 0x7f282406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:28.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.597+0000 7f2841d9b640 1 --2- 172.21.15.33:0/3485795177 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f282406b500 0x7f282406d9c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f282c033000 tx=0x7f282c008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:28.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.601+0000 7f283affd640 1 -- 172.21.15.33:0/3485795177 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f283c021020 con 0x7f2830003f20 2024-05-08T10:55:28.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.786+0000 7f2848e95640 1 -- 172.21.15.33:0/3485795177 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f28440caa50 con 0x7f2830003f20 2024-05-08T10:55:28.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.786+0000 7f283affd640 1 -- 172.21.15.33:0/3485795177 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v27) v1 ==== 84+0+65 (secure 0 0 0) 0x7f283c059c40 con 0x7f2830003f20 2024-05-08T10:55:28.783 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:55:28.784 INFO:teuthology.orchestra.run.smithi033.stdout:[ 2024-05-08T10:55:28.784 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T10:55:28.784 INFO:teuthology.orchestra.run.smithi033.stdout: "poolnum": 1, 2024-05-08T10:55:28.784 INFO:teuthology.orchestra.run.smithi033.stdout: "poolname": ".mgr" 2024-05-08T10:55:28.784 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T10:55:28.784 INFO:teuthology.orchestra.run.smithi033.stdout:] 2024-05-08T10:55:28.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.788+0000 7f2848e95640 1 -- 172.21.15.33:0/3485795177 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f282406b500 msgr2=0x7f282406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:28.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.788+0000 7f2848e95640 1 --2- 172.21.15.33:0/3485795177 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f282406b500 0x7f282406d9c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f282c033000 tx=0x7f282c008030 comp rx=0 tx=0).stop 2024-05-08T10:55:28.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.788+0000 7f2848e95640 1 -- 172.21.15.33:0/3485795177 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2830003f20 msgr2=0x7f28440a1400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:28.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.788+0000 7f2848e95640 1 --2- 172.21.15.33:0/3485795177 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2830003f20 0x7f28440a1400 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f283c0012e0 tx=0x7f283c00a750 comp rx=0 tx=0).stop 2024-05-08T10:55:28.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.788+0000 7f2848e95640 1 -- 172.21.15.33:0/3485795177 shutdown_connections 2024-05-08T10:55:28.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.788+0000 7f2848e95640 1 --2- 172.21.15.33:0/3485795177 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f282406b500 0x7f282406d9c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:28.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.788+0000 7f2848e95640 1 --2- 172.21.15.33:0/3485795177 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2844155dd0 0x7f2844156250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:28.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.788+0000 7f2848e95640 1 --2- 172.21.15.33:0/3485795177 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f28440cd0e0 0x7f28440cd560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:28.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.788+0000 7f2848e95640 1 --2- 172.21.15.33:0/3485795177 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2830003f20 0x7f28440a1400 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:28.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.788+0000 7f2848e95640 1 -- 172.21.15.33:0/3485795177 >> 172.21.15.33:0/3485795177 conn(0x7f28440d3c10 msgr2=0x7f28441605d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:28.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.788+0000 7f2848e95640 1 -- 172.21.15.33:0/3485795177 shutdown_connections 2024-05-08T10:55:28.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.788+0000 7f2848e95640 1 -- 172.21.15.33:0/3485795177 wait complete. 2024-05-08T10:55:28.796 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-08T10:55:28.796 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-08T10:55:28.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.906+0000 7f649b97e640 1 Processor -- start 2024-05-08T10:55:28.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.907+0000 7f649b97e640 1 -- start start 2024-05-08T10:55:28.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.907+0000 7f649b97e640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f6494161660 0x7f64940b2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:28.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.907+0000 7f649b97e640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f64940b1070 0x7f6494167cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:28.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.907+0000 7f649b97e640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6494161a40 con 0x7f64940d47e0 2024-05-08T10:55:28.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.907+0000 7f649b97e640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64940b5510 con 0x7f6494161660 2024-05-08T10:55:28.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.907+0000 7f649b97e640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64940b1a10 con 0x7f64940b1070 2024-05-08T10:55:28.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.907+0000 7f649971a640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f6494161660 0x7f64940b2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:28.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.908+0000 7f649971a640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f6494161660 0x7f64940b2aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33792/0 (socket says 172.21.15.33:33792) 2024-05-08T10:55:28.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.908+0000 7f649971a640 1 -- 172.21.15.33:0/2346953260 learned_addr learned my addr 172.21.15.33:0/2346953260 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:28.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.908+0000 7f6499f1b640 1 --2- 172.21.15.33:0/2346953260 >> v2:172.21.15.174:3300/0 conn(0x7f64940b1070 0x7f6494167cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:28.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.908+0000 7f649971a640 1 -- 172.21.15.33:0/2346953260 >> v2:172.21.15.174:3300/0 conn(0x7f64940b1070 msgr2=0x7f6494167cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:28.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.908+0000 7f649971a640 1 --2- 172.21.15.33:0/2346953260 >> v2:172.21.15.174:3300/0 conn(0x7f64940b1070 0x7f6494167cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:28.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.908+0000 7f649971a640 1 -- 172.21.15.33:0/2346953260 >> v1:172.21.15.174:6789/0 conn(0x7f64940d47e0 legacy=0x7f64940b0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:28.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.908+0000 7f649971a640 1 -- 172.21.15.33:0/2346953260 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64940b1cf0 con 0x7f6494161660 2024-05-08T10:55:28.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.908+0000 7f6499f1b640 1 --2- 172.21.15.33:0/2346953260 >> v2:172.21.15.174:3300/0 conn(0x7f64940b1070 0x7f6494167cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:55:28.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.908+0000 7f649971a640 1 --2- 172.21.15.33:0/2346953260 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6494161660 0x7f64940b2aa0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f648c009870 tx=0x7f648c02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d505611d544d965 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:28.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.909+0000 7f6493fff640 1 -- 172.21.15.33:0/2346953260 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f648c037070 con 0x7f6494161660 2024-05-08T10:55:28.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.909+0000 7f6493fff640 1 -- 172.21.15.33:0/2346953260 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f648c032440 con 0x7f6494161660 2024-05-08T10:55:28.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.909+0000 7f6493fff640 1 -- 172.21.15.33:0/2346953260 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f648c032810 con 0x7f6494161660 2024-05-08T10:55:28.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.909+0000 7f649b97e640 1 -- 172.21.15.33:0/2346953260 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6494161660 msgr2=0x7f64940b2aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:28.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.909+0000 7f649b97e640 1 --2- 172.21.15.33:0/2346953260 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6494161660 0x7f64940b2aa0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f648c009870 tx=0x7f648c02a1c0 comp rx=0 tx=0).stop 2024-05-08T10:55:28.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.909+0000 7f649b97e640 1 -- 172.21.15.33:0/2346953260 shutdown_connections 2024-05-08T10:55:28.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.909+0000 7f649b97e640 1 --2- 172.21.15.33:0/2346953260 >> v2:172.21.15.174:3300/0 conn(0x7f64940b1070 0x7f6494167cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:28.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.909+0000 7f649b97e640 1 --2- 172.21.15.33:0/2346953260 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6494161660 0x7f64940b2aa0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:28.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.909+0000 7f649b97e640 1 -- 172.21.15.33:0/2346953260 >> 172.21.15.33:0/2346953260 conn(0x7f649409cf20 msgr2=0x7f64940d3c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:28.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.909+0000 7f649b97e640 1 -- 172.21.15.33:0/2346953260 shutdown_connections 2024-05-08T10:55:28.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.909+0000 7f649b97e640 1 -- 172.21.15.33:0/2346953260 wait complete. 2024-05-08T10:55:28.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.910+0000 7f649b97e640 1 Processor -- start 2024-05-08T10:55:28.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.911+0000 7f649b97e640 1 -- start start 2024-05-08T10:55:28.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.911+0000 7f649b97e640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f64940b1070 0x7f6494153130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:28.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.911+0000 7f649b97e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f64940d47e0 0x7f64940b8320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:28.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.911+0000 7f649b97e640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6494161660 0x7f64940b8860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:28.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.911+0000 7f649b97e640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64940b27d0 con 0x7f64940d47e0 2024-05-08T10:55:28.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.911+0000 7f649b97e640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64940b22b0 con 0x7f64940b1070 2024-05-08T10:55:28.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.911+0000 7f649b97e640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64940b14c0 con 0x7f6494161660 2024-05-08T10:55:28.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.911+0000 7f6498f19640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f64940d47e0 0x7f64940b8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:28.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.911+0000 7f6498f19640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f64940d47e0 0x7f64940b8320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33794/0 (socket says 172.21.15.33:33794) 2024-05-08T10:55:28.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.911+0000 7f6498f19640 1 -- 172.21.15.33:0/231432973 learned_addr learned my addr 172.21.15.33:0/231432973 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:28.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.912+0000 7f649971a640 1 --2- 172.21.15.33:0/231432973 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f64940b1070 0x7f6494153130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:28.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.912+0000 7f6499f1b640 1 --2- 172.21.15.33:0/231432973 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6494161660 0x7f64940b8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:28.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.912+0000 7f6498f19640 1 -- 172.21.15.33:0/231432973 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6494161660 msgr2=0x7f64940b8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:28.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.912+0000 7f6498f19640 1 --2- 172.21.15.33:0/231432973 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6494161660 0x7f64940b8860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:28.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.912+0000 7f6498f19640 1 -- 172.21.15.33:0/231432973 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f64940b1070 msgr2=0x7f6494153130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:28.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.912+0000 7f6498f19640 1 --2- 172.21.15.33:0/231432973 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f64940b1070 0x7f6494153130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:28.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.912+0000 7f6498f19640 1 -- 172.21.15.33:0/231432973 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6494153670 con 0x7f64940d47e0 2024-05-08T10:55:28.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.912+0000 7f649971a640 1 --2- 172.21.15.33:0/231432973 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f64940b1070 0x7f6494153130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:55:28.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.912+0000 7f6498f19640 1 --2- 172.21.15.33:0/231432973 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f64940d47e0 0x7f64940b8320 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f648800c430 tx=0x7f648800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:28.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.912+0000 7f6491ffb640 1 -- 172.21.15.33:0/231432973 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6488011790 con 0x7f64940d47e0 2024-05-08T10:55:28.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.912+0000 7f6491ffb640 1 -- 172.21.15.33:0/231432973 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6488017070 con 0x7f64940d47e0 2024-05-08T10:55:28.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.912+0000 7f649b97e640 1 -- 172.21.15.33:0/231432973 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64940cb2c0 con 0x7f64940d47e0 2024-05-08T10:55:28.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.912+0000 7f6491ffb640 1 -- 172.21.15.33:0/231432973 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6488011b70 con 0x7f64940d47e0 2024-05-08T10:55:28.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.912+0000 7f649b97e640 1 -- 172.21.15.33:0/231432973 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64940cb880 con 0x7f64940d47e0 2024-05-08T10:55:28.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.913+0000 7f649b97e640 1 -- 172.21.15.33:0/231432973 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6494069d20 con 0x7f64940d47e0 2024-05-08T10:55:28.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.914+0000 7f6491ffb640 1 -- 172.21.15.33:0/231432973 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6488011d10 con 0x7f64940d47e0 2024-05-08T10:55:28.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.914+0000 7f6491ffb640 1 --2- 172.21.15.33:0/231432973 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f648006b4d0 0x7f648006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:28.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.914+0000 7f6491ffb640 1 -- 172.21.15.33:0/231432973 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6488089d30 con 0x7f64940d47e0 2024-05-08T10:55:28.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.914+0000 7f649971a640 1 --2- 172.21.15.33:0/231432973 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f648006b4d0 0x7f648006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:28.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.915+0000 7f649971a640 1 --2- 172.21.15.33:0/231432973 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f648006b4d0 0x7f648006d990 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f648c034000 tx=0x7f648c02e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:28.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:28.918+0000 7f6491ffb640 1 -- 172.21.15.33:0/231432973 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6488058f00 con 0x7f64940d47e0 2024-05-08T10:55:29.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:29.101+0000 7f649b97e640 1 -- 172.21.15.33:0/231432973 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f64940d0570 con 0x7f64940d47e0 2024-05-08T10:55:29.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:29.946+0000 7f6491ffb640 1 -- 172.21.15.33:0/231432973 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v28) v1 ==== 138+0+0 (secure 0 0 0) 0x7f6488058800 con 0x7f64940d47e0 2024-05-08T10:55:29.944 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_metadata' created 2024-05-08T10:55:29.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:29.949+0000 7f649b97e640 1 -- 172.21.15.33:0/231432973 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f648006b4d0 msgr2=0x7f648006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:29.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:29.949+0000 7f649b97e640 1 --2- 172.21.15.33:0/231432973 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f648006b4d0 0x7f648006d990 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f648c034000 tx=0x7f648c02e000 comp rx=0 tx=0).stop 2024-05-08T10:55:29.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:29.949+0000 7f649b97e640 1 -- 172.21.15.33:0/231432973 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f64940d47e0 msgr2=0x7f64940b8320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:29.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:29.949+0000 7f649b97e640 1 --2- 172.21.15.33:0/231432973 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f64940d47e0 0x7f64940b8320 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f648800c430 tx=0x7f648800c8f0 comp rx=0 tx=0).stop 2024-05-08T10:55:29.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:29.949+0000 7f649b97e640 1 -- 172.21.15.33:0/231432973 shutdown_connections 2024-05-08T10:55:29.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:29.949+0000 7f649b97e640 1 --2- 172.21.15.33:0/231432973 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f648006b4d0 0x7f648006d990 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:29.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:29.949+0000 7f649b97e640 1 --2- 172.21.15.33:0/231432973 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6494161660 0x7f64940b8860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:29.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:29.949+0000 7f649b97e640 1 --2- 172.21.15.33:0/231432973 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f64940d47e0 0x7f64940b8320 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:29.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:29.949+0000 7f649b97e640 1 --2- 172.21.15.33:0/231432973 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f64940b1070 0x7f6494153130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:29.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:29.949+0000 7f649b97e640 1 -- 172.21.15.33:0/231432973 >> 172.21.15.33:0/231432973 conn(0x7f649409cf20 msgr2=0x7f649406c300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:29.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:29.949+0000 7f649b97e640 1 -- 172.21.15.33:0/231432973 shutdown_connections 2024-05-08T10:55:29.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:29.949+0000 7f649b97e640 1 -- 172.21.15.33:0/231432973 wait complete. 2024-05-08T10:55:29.964 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-08T10:55:30.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:30.084+0000 7f132ccee640 1 Processor -- start 2024-05-08T10:55:30.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:30.084+0000 7f132ccee640 1 -- start start 2024-05-08T10:55:30.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:30.085+0000 7f132ccee640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f132815db90 0x7f132815df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:30.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:30.085+0000 7f132ccee640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f132806ce70 0x7f13280d1a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:30.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:30.085+0000 7f132ccee640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f132806c0b0 con 0x7f13280cee50 2024-05-08T10:55:30.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:30.085+0000 7f132ccee640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f132806d300 con 0x7f132806ce70 2024-05-08T10:55:30.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:30.085+0000 7f132ccee640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f132806c390 con 0x7f132815db90 2024-05-08T10:55:30.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:30.085+0000 7f1326d9d640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f132806ce70 0x7f13280d1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:30.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:30.085+0000 7f131ffff640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f13280cee50 0x7f132806f050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:53940/0 (socket says 172.21.15.33:53940) 2024-05-08T10:55:30.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:30.085+0000 7f131ffff640 1 -- 172.21.15.33:0/554398219 learned_addr learned my addr 172.21.15.33:0/554398219 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-05-08T10:55:30.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:30.085+0000 7f132659c640 1 --2- 172.21.15.33:0/554398219 >> v2:172.21.15.174:3300/0 conn(0x7f132815db90 0x7f132815df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:30.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:30.085+0000 7f1326d9d640 1 -- 172.21.15.33:0/554398219 >> v2:172.21.15.174:3300/0 conn(0x7f132815db90 msgr2=0x7f132815df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:30.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:30.085+0000 7f1326d9d640 1 --2- 172.21.15.33:0/554398219 >> v2:172.21.15.174:3300/0 conn(0x7f132815db90 0x7f132815df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:30.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:30.085+0000 7f1326d9d640 1 -- 172.21.15.33:0/554398219 >> v1:172.21.15.33:6789/0 conn(0x7f13280cee50 legacy=0x7f132806f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:30.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:30.085+0000 7f1326d9d640 1 -- 172.21.15.33:0/554398219 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f132806c670 con 0x7f132806ce70 2024-05-08T10:55:30.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:30.085+0000 7f1325d9b640 1 -- 172.21.15.33:0/554398219 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3988013986 0 0) 0x7f132806c0b0 con 0x7f13280cee50 2024-05-08T10:55:30.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:30.086+0000 7f1326d9d640 1 --2- 172.21.15.33:0/554398219 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f132806ce70 0x7f13280d1a90 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f132806b850 tx=0x7f132002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=563858fb41d3ca3d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:30.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:30.086+0000 7f1325d9b640 1 -- 172.21.15.33:0/554398219 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1320007740 con 0x7f132806ce70 2024-05-08T10:55:30.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:30.086+0000 7f1325d9b640 1 -- 172.21.15.33:0/554398219 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13200078e0 con 0x7f132806ce70 2024-05-08T10:55:30.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:30.086+0000 7f1325d9b640 1 -- 172.21.15.33:0/554398219 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1320007cb0 con 0x7f132806ce70 2024-05-08T10:55:30.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:30.086+0000 7f132ccee640 1 -- 172.21.15.33:0/554398219 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f132806ce70 msgr2=0x7f13280d1a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:30.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:30.086+0000 7f132ccee640 1 --2- 172.21.15.33:0/554398219 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f132806ce70 0x7f13280d1a90 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f132806b850 tx=0x7f132002a680 comp rx=0 tx=0).stop 2024-05-08T10:55:30.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:30.087+0000 7f132ccee640 1 -- 172.21.15.33:0/554398219 shutdown_connections 2024-05-08T10:55:30.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:30.087+0000 7f132ccee640 1 --2- 172.21.15.33:0/554398219 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f132806ce70 0x7f13280d1a90 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:30.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:30.087+0000 7f132ccee640 1 --2- 172.21.15.33:0/554398219 >> v2:172.21.15.174:3300/0 conn(0x7f132815db90 0x7f132815df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:30.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:30.087+0000 7f132ccee640 1 -- 172.21.15.33:0/554398219 >> 172.21.15.33:0/554398219 conn(0x7f132809a9d0 msgr2=0x7f132809ade0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:30.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:30.087+0000 7f132ccee640 1 -- 172.21.15.33:0/554398219 shutdown_connections 2024-05-08T10:55:30.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:30.087+0000 7f132ccee640 1 -- 172.21.15.33:0/554398219 wait complete. 2024-05-08T10:55:30.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:30.088+0000 7f132ccee640 1 Processor -- start 2024-05-08T10:55:30.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:30.088+0000 7f132ccee640 1 -- start start 2024-05-08T10:55:30.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:30.089+0000 7f132ccee640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f132806ce70 0x7f13280b3d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:30.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:30.089+0000 7f132ccee640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f13280cee50 0x7f13281f6e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:30.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:30.089+0000 7f132ccee640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f132815db90 0x7f13281f2b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:30.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:30.089+0000 7f132ccee640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f132806fa00 con 0x7f132806ce70 2024-05-08T10:55:30.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:30.089+0000 7f132ccee640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f132806f880 con 0x7f132815db90 2024-05-08T10:55:30.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:30.089+0000 7f132ccee640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13280d1fd0 con 0x7f13280cee50 2024-05-08T10:55:30.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:30.089+0000 7f132659c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f132806ce70 0x7f13280b3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:30.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:30.089+0000 7f132659c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f132806ce70 0x7f13280b3d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33818/0 (socket says 172.21.15.33:33818) 2024-05-08T10:55:30.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:30.089+0000 7f132659c640 1 -- 172.21.15.33:0/2391912356 learned_addr learned my addr 172.21.15.33:0/2391912356 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:30.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:30.089+0000 7f132659c640 1 -- 172.21.15.33:0/2391912356 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f13280cee50 msgr2=0x7f13281f6e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:30.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:30.089+0000 7f132659c640 1 --2- 172.21.15.33:0/2391912356 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f13280cee50 0x7f13281f6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:30.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:30.089+0000 7f132659c640 1 -- 172.21.15.33:0/2391912356 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f132815db90 msgr2=0x7f13281f2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:30.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:30.089+0000 7f132659c640 1 --2- 172.21.15.33:0/2391912356 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f132815db90 0x7f13281f2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:30.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:30.089+0000 7f132659c640 1 -- 172.21.15.33:0/2391912356 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13280b7320 con 0x7f132806ce70 2024-05-08T10:55:30.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:30.089+0000 7f132659c640 1 --2- 172.21.15.33:0/2391912356 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f132806ce70 0x7f13280b3d50 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f131800d5f0 tx=0x7f131800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:30.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:30.090+0000 7f131effd640 1 -- 172.21.15.33:0/2391912356 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13180125f0 con 0x7f132806ce70 2024-05-08T10:55:30.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:30.090+0000 7f131effd640 1 -- 172.21.15.33:0/2391912356 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1318019070 con 0x7f132806ce70 2024-05-08T10:55:30.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:30.090+0000 7f132ccee640 1 -- 172.21.15.33:0/2391912356 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13280b2000 con 0x7f132806ce70 2024-05-08T10:55:30.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:30.090+0000 7f131effd640 1 -- 172.21.15.33:0/2391912356 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13180129d0 con 0x7f132806ce70 2024-05-08T10:55:30.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:30.090+0000 7f132ccee640 1 -- 172.21.15.33:0/2391912356 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13280b4290 con 0x7f132806ce70 2024-05-08T10:55:30.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:30.091+0000 7f132ccee640 1 -- 172.21.15.33:0/2391912356 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1328069d20 con 0x7f132806ce70 2024-05-08T10:55:30.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:30.091+0000 7f131effd640 1 -- 172.21.15.33:0/2391912356 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1318012b70 con 0x7f132806ce70 2024-05-08T10:55:30.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:30.092+0000 7f131effd640 1 --2- 172.21.15.33:0/2391912356 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f130806b4d0 0x7f130806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:30.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:30.092+0000 7f131effd640 1 -- 172.21.15.33:0/2391912356 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f131808a510 con 0x7f132806ce70 2024-05-08T10:55:30.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:30.092+0000 7f131ffff640 1 --2- 172.21.15.33:0/2391912356 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f130806b4d0 0x7f130806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:30.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:30.093+0000 7f131ffff640 1 --2- 172.21.15.33:0/2391912356 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f130806b4d0 0x7f130806d990 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1310007fd0 tx=0x7f1310007920 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:30.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:30.096+0000 7f131effd640 1 -- 172.21.15.33:0/2391912356 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f13180594d0 con 0x7f132806ce70 2024-05-08T10:55:30.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:30.275+0000 7f132ccee640 1 -- 172.21.15.33:0/2391912356 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f132806bdf0 con 0x7f132806ce70 2024-05-08T10:55:30.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:30.948+0000 7f131effd640 1 -- 172.21.15.33:0/2391912356 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v29) v1 ==== 170+0+0 (secure 0 0 0) 0x7f1318058dd0 con 0x7f132806ce70 2024-05-08T10:55:30.946 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_data' created 2024-05-08T10:55:30.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:30.950+0000 7f132ccee640 1 -- 172.21.15.33:0/2391912356 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f130806b4d0 msgr2=0x7f130806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:30.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:30.950+0000 7f132ccee640 1 --2- 172.21.15.33:0/2391912356 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f130806b4d0 0x7f130806d990 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1310007fd0 tx=0x7f1310007920 comp rx=0 tx=0).stop 2024-05-08T10:55:30.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:30.950+0000 7f132ccee640 1 -- 172.21.15.33:0/2391912356 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f132806ce70 msgr2=0x7f13280b3d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:30.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:30.950+0000 7f132ccee640 1 --2- 172.21.15.33:0/2391912356 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f132806ce70 0x7f13280b3d50 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f131800d5f0 tx=0x7f131800dab0 comp rx=0 tx=0).stop 2024-05-08T10:55:30.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:30.950+0000 7f132ccee640 1 -- 172.21.15.33:0/2391912356 shutdown_connections 2024-05-08T10:55:30.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:30.950+0000 7f132ccee640 1 --2- 172.21.15.33:0/2391912356 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f130806b4d0 0x7f130806d990 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:30.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:30.950+0000 7f132ccee640 1 --2- 172.21.15.33:0/2391912356 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f132815db90 0x7f13281f2b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:30.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:30.950+0000 7f132ccee640 1 --2- 172.21.15.33:0/2391912356 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f13280cee50 0x7f13281f6e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:30.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:30.951+0000 7f132ccee640 1 --2- 172.21.15.33:0/2391912356 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f132806ce70 0x7f13280b3d50 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:30.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:30.951+0000 7f132ccee640 1 -- 172.21.15.33:0/2391912356 >> 172.21.15.33:0/2391912356 conn(0x7f132809a9d0 msgr2=0x7f132815c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:30.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:30.951+0000 7f132ccee640 1 -- 172.21.15.33:0/2391912356 shutdown_connections 2024-05-08T10:55:30.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:30.951+0000 7f132ccee640 1 -- 172.21.15.33:0/2391912356 wait complete. 2024-05-08T10:55:30.970 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-08T10:55:31.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:31.080+0000 7f7dfc672640 1 Processor -- start 2024-05-08T10:55:31.078 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:31.080+0000 7f7dfc672640 1 -- start start 2024-05-08T10:55:31.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:31.081+0000 7f7dfc672640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7df41614f0 0x7f7df406c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:31.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:31.081+0000 7f7dfc672640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f7df406e890 0x7f7df406aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:31.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:31.081+0000 7f7dfc672640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f7df4162570 0x7f7df406b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:31.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:31.081+0000 7f7dfc672640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7df406d8a0 con 0x7f7df4162570 2024-05-08T10:55:31.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:31.081+0000 7f7dfc672640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7df41618d0 con 0x7f7df406e890 2024-05-08T10:55:31.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:31.081+0000 7f7dfc672640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7df406dad0 con 0x7f7df41614f0 2024-05-08T10:55:31.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:31.081+0000 7f7dfac0f640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f7df4162570 0x7f7df406b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:31.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:31.081+0000 7f7dfac0f640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f7df4162570 0x7f7df406b0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33834/0 (socket says 172.21.15.33:33834) 2024-05-08T10:55:31.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:31.081+0000 7f7dfac0f640 1 -- 172.21.15.33:0/724718340 learned_addr learned my addr 172.21.15.33:0/724718340 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:31.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:31.082+0000 7f7dfa40e640 1 --2- 172.21.15.33:0/724718340 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7df41614f0 0x7f7df406c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:31.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:31.082+0000 7f7df9c0d640 1 --2- 172.21.15.33:0/724718340 >> v2:172.21.15.174:3300/0 conn(0x7f7df406e890 0x7f7df406aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:31.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:31.082+0000 7f7dfac0f640 1 -- 172.21.15.33:0/724718340 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7df41614f0 msgr2=0x7f7df406c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:31.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:31.082+0000 7f7dfac0f640 1 --2- 172.21.15.33:0/724718340 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7df41614f0 0x7f7df406c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:31.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:31.082+0000 7f7dfac0f640 1 -- 172.21.15.33:0/724718340 >> v2:172.21.15.174:3300/0 conn(0x7f7df406e890 msgr2=0x7f7df406aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:31.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:31.082+0000 7f7dfac0f640 1 --2- 172.21.15.33:0/724718340 >> v2:172.21.15.174:3300/0 conn(0x7f7df406e890 0x7f7df406aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:31.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:31.082+0000 7f7dfac0f640 1 -- 172.21.15.33:0/724718340 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7df406ddb0 con 0x7f7df4162570 2024-05-08T10:55:31.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:31.082+0000 7f7df9c0d640 1 --2- 172.21.15.33:0/724718340 >> v2:172.21.15.174:3300/0 conn(0x7f7df406e890 0x7f7df406aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:55:31.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:31.082+0000 7f7dfa40e640 1 --2- 172.21.15.33:0/724718340 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7df41614f0 0x7f7df406c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:55:31.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:31.082+0000 7f7dfac0f640 1 --2- 172.21.15.33:0/724718340 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7df4162570 0x7f7df406b0e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f7df40746c0 tx=0x7f7dec02a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7feaa7468d6f7afb server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:31.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:31.083+0000 7f7df940c640 1 -- 172.21.15.33:0/724718340 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dec036070 con 0x7f7df4162570 2024-05-08T10:55:31.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:31.083+0000 7f7df940c640 1 -- 172.21.15.33:0/724718340 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dec031600 con 0x7f7df4162570 2024-05-08T10:55:31.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:31.083+0000 7f7df940c640 1 -- 172.21.15.33:0/724718340 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dec0319d0 con 0x7f7df4162570 2024-05-08T10:55:31.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:31.083+0000 7f7dfc672640 1 -- 172.21.15.33:0/724718340 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7df4162570 msgr2=0x7f7df406b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:31.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:31.083+0000 7f7dfc672640 1 --2- 172.21.15.33:0/724718340 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7df4162570 0x7f7df406b0e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f7df40746c0 tx=0x7f7dec02a610 comp rx=0 tx=0).stop 2024-05-08T10:55:31.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:31.083+0000 7f7dfc672640 1 -- 172.21.15.33:0/724718340 shutdown_connections 2024-05-08T10:55:31.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:31.083+0000 7f7dfc672640 1 --2- 172.21.15.33:0/724718340 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7df4162570 0x7f7df406b0e0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:31.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:31.083+0000 7f7dfc672640 1 --2- 172.21.15.33:0/724718340 >> v2:172.21.15.174:3300/0 conn(0x7f7df406e890 0x7f7df406aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:31.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:31.083+0000 7f7dfc672640 1 --2- 172.21.15.33:0/724718340 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7df41614f0 0x7f7df406c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:31.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:31.083+0000 7f7dfc672640 1 -- 172.21.15.33:0/724718340 >> 172.21.15.33:0/724718340 conn(0x7f7df40b1be0 msgr2=0x7f7df40b1fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:31.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:31.083+0000 7f7dfc672640 1 -- 172.21.15.33:0/724718340 shutdown_connections 2024-05-08T10:55:31.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:31.083+0000 7f7dfc672640 1 -- 172.21.15.33:0/724718340 wait complete. 2024-05-08T10:55:31.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:31.085+0000 7f7dfc672640 1 Processor -- start 2024-05-08T10:55:31.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:31.085+0000 7f7dfc672640 1 -- start start 2024-05-08T10:55:31.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:31.085+0000 7f7dfc672640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7df406e890 0x7f7df41f0d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:31.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:31.085+0000 7f7dfc672640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7df41614f0 0x7f7df4071bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:31.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:31.085+0000 7f7dfc672640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7df4162570 0x7f7df40720f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:31.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:31.085+0000 7f7dfc672640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7df40ae190 con 0x7f7df406e890 2024-05-08T10:55:31.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:31.085+0000 7f7dfc672640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7df406e370 con 0x7f7df41614f0 2024-05-08T10:55:31.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:31.085+0000 7f7dfc672640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7df40acec0 con 0x7f7df4162570 2024-05-08T10:55:31.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:31.085+0000 7f7dfa40e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7df406e890 0x7f7df41f0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:31.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:31.085+0000 7f7dfa40e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7df406e890 0x7f7df41f0d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33836/0 (socket says 172.21.15.33:33836) 2024-05-08T10:55:31.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:31.085+0000 7f7dfa40e640 1 -- 172.21.15.33:0/39348408 learned_addr learned my addr 172.21.15.33:0/39348408 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:31.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:31.086+0000 7f7df9c0d640 1 --2- 172.21.15.33:0/39348408 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7df41614f0 0x7f7df4071bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:31.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:31.086+0000 7f7dfac0f640 1 --2- 172.21.15.33:0/39348408 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7df4162570 0x7f7df40720f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:31.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:31.086+0000 7f7dfa40e640 1 -- 172.21.15.33:0/39348408 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7df4162570 msgr2=0x7f7df40720f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:31.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:31.086+0000 7f7dfa40e640 1 --2- 172.21.15.33:0/39348408 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7df4162570 0x7f7df40720f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:31.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:31.086+0000 7f7dfa40e640 1 -- 172.21.15.33:0/39348408 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7df41614f0 msgr2=0x7f7df4071bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:31.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:31.086+0000 7f7dfa40e640 1 --2- 172.21.15.33:0/39348408 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7df41614f0 0x7f7df4071bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:31.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:31.086+0000 7f7dfa40e640 1 -- 172.21.15.33:0/39348408 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7df41f47b0 con 0x7f7df406e890 2024-05-08T10:55:31.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:31.086+0000 7f7df9c0d640 1 --2- 172.21.15.33:0/39348408 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7df41614f0 0x7f7df4071bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:55:31.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:31.086+0000 7f7dfac0f640 1 --2- 172.21.15.33:0/39348408 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7df4162570 0x7f7df40720f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:55:31.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:31.086+0000 7f7dfa40e640 1 --2- 172.21.15.33:0/39348408 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7df406e890 0x7f7df41f0d20 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f7df000c820 tx=0x7f7df000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:31.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:31.086+0000 7f7deaffd640 1 -- 172.21.15.33:0/39348408 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df0015070 con 0x7f7df406e890 2024-05-08T10:55:31.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:31.086+0000 7f7deaffd640 1 -- 172.21.15.33:0/39348408 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7df0007a30 con 0x7f7df406e890 2024-05-08T10:55:31.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:31.086+0000 7f7dfc672640 1 -- 172.21.15.33:0/39348408 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7df41f39f0 con 0x7f7df406e890 2024-05-08T10:55:31.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:31.086+0000 7f7deaffd640 1 -- 172.21.15.33:0/39348408 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df0007e00 con 0x7f7df406e890 2024-05-08T10:55:31.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:31.086+0000 7f7dfc672640 1 -- 172.21.15.33:0/39348408 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7df41f3fb0 con 0x7f7df406e890 2024-05-08T10:55:31.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:31.087+0000 7f7dfc672640 1 -- 172.21.15.33:0/39348408 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7df4069d20 con 0x7f7df406e890 2024-05-08T10:55:31.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:31.088+0000 7f7deaffd640 1 -- 172.21.15.33:0/39348408 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7df0018070 con 0x7f7df406e890 2024-05-08T10:55:31.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:31.088+0000 7f7deaffd640 1 --2- 172.21.15.33:0/39348408 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f7dd806b4d0 0x7f7dd806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:31.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:31.088+0000 7f7deaffd640 1 -- 172.21.15.33:0/39348408 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f7df008a050 con 0x7f7df406e890 2024-05-08T10:55:31.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:31.089+0000 7f7df9c0d640 1 --2- 172.21.15.33:0/39348408 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f7dd806b4d0 0x7f7dd806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:31.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:31.089+0000 7f7df9c0d640 1 --2- 172.21.15.33:0/39348408 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f7dd806b4d0 0x7f7dd806d990 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f7df415d150 tx=0x7f7de4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:31.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:31.092+0000 7f7deaffd640 1 -- 172.21.15.33:0/39348408 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7df0058fc0 con 0x7f7df406e890 2024-05-08T10:55:31.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:31.310+0000 7f7dfc672640 1 -- 172.21.15.33:0/39348408 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f7df4066f80 con 0x7f7df406e890 2024-05-08T10:55:31.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:31.959+0000 7f7deaffd640 1 -- 172.21.15.33:0/39348408 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v12) v1 ==== 172+0+0 (secure 0 0 0) 0x7f7df00588c0 con 0x7f7df406e890 2024-05-08T10:55:31.957 INFO:teuthology.orchestra.run.smithi033.stderr:new fs with metadata pool 4 and data pool 5 2024-05-08T10:55:31.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:31.962+0000 7f7dfc672640 1 -- 172.21.15.33:0/39348408 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f7dd806b4d0 msgr2=0x7f7dd806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:31.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:31.962+0000 7f7dfc672640 1 --2- 172.21.15.33:0/39348408 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f7dd806b4d0 0x7f7dd806d990 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f7df415d150 tx=0x7f7de4008040 comp rx=0 tx=0).stop 2024-05-08T10:55:31.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:31.962+0000 7f7dfc672640 1 -- 172.21.15.33:0/39348408 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7df406e890 msgr2=0x7f7df41f0d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:31.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:31.962+0000 7f7dfc672640 1 --2- 172.21.15.33:0/39348408 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7df406e890 0x7f7df41f0d20 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f7df000c820 tx=0x7f7df000cc20 comp rx=0 tx=0).stop 2024-05-08T10:55:31.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:31.962+0000 7f7dfc672640 1 -- 172.21.15.33:0/39348408 shutdown_connections 2024-05-08T10:55:31.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:31.962+0000 7f7dfc672640 1 --2- 172.21.15.33:0/39348408 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f7dd806b4d0 0x7f7dd806d990 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:31.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:31.962+0000 7f7dfc672640 1 --2- 172.21.15.33:0/39348408 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7df4162570 0x7f7df40720f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:31.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:31.962+0000 7f7dfc672640 1 --2- 172.21.15.33:0/39348408 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7df41614f0 0x7f7df4071bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:31.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:31.962+0000 7f7dfc672640 1 --2- 172.21.15.33:0/39348408 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7df406e890 0x7f7df41f0d20 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:31.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:31.962+0000 7f7dfc672640 1 -- 172.21.15.33:0/39348408 >> 172.21.15.33:0/39348408 conn(0x7f7df40b1be0 msgr2=0x7f7df40c4e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:31.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:31.962+0000 7f7dfc672640 1 -- 172.21.15.33:0/39348408 shutdown_connections 2024-05-08T10:55:31.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:31.962+0000 7f7dfc672640 1 -- 172.21.15.33:0/39348408 wait complete. 2024-05-08T10:55:31.982 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T10:55:32.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.095+0000 7fe60383f640 1 Processor -- start 2024-05-08T10:55:32.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.096+0000 7fe60383f640 1 -- start start 2024-05-08T10:55:32.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.096+0000 7fe60383f640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fe5fc0d07a0 0x7fe5fc0b6990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:32.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.096+0000 7fe60383f640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5fc0ce650 con 0x7fe5fc0d03c0 2024-05-08T10:55:32.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.096+0000 7fe60383f640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5fc0d4250 con 0x7fe5fc0b6ed0 2024-05-08T10:55:32.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.096+0000 7fe60383f640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5fc0d4530 con 0x7fe5fc0d07a0 2024-05-08T10:55:32.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.097+0000 7fe600dda640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fe5fc0d07a0 0x7fe5fc0b6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:32.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.097+0000 7fe6015db640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fe5fc0d03c0 0x7fe5fc0d1920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:53950/0 (socket says 172.21.15.33:53950) 2024-05-08T10:55:32.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.097+0000 7fe6015db640 1 -- 172.21.15.33:0/2967530336 learned_addr learned my addr 172.21.15.33:0/2967530336 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-05-08T10:55:32.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.097+0000 7fe600dda640 1 -- 172.21.15.33:0/2967530336 >> v1:172.21.15.174:6789/0 conn(0x7fe5fc0b6ed0 legacy=0x7fe5fc0cf0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:32.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.097+0000 7fe600dda640 1 -- 172.21.15.33:0/2967530336 >> v1:172.21.15.33:6789/0 conn(0x7fe5fc0d03c0 legacy=0x7fe5fc0d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:32.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.097+0000 7fe5fbfff640 1 -- 172.21.15.33:0/2967530336 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3717212898 0 0) 0x7fe5fc0ce650 con 0x7fe5fc0d03c0 2024-05-08T10:55:32.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.097+0000 7fe600dda640 1 -- 172.21.15.33:0/2967530336 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5fc0d4810 con 0x7fe5fc0d07a0 2024-05-08T10:55:32.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.098+0000 7fe600dda640 1 --2- 172.21.15.33:0/2967530336 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5fc0d07a0 0x7fe5fc0b6990 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe5f00097a0 tx=0x7fe5f002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=647be6c0f2e7261b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:32.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.098+0000 7fe5fbfff640 1 -- 172.21.15.33:0/2967530336 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f0037070 con 0x7fe5fc0d07a0 2024-05-08T10:55:32.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.098+0000 7fe5fbfff640 1 -- 172.21.15.33:0/2967530336 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5f0032440 con 0x7fe5fc0d07a0 2024-05-08T10:55:32.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.098+0000 7fe5fbfff640 1 -- 172.21.15.33:0/2967530336 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f0032810 con 0x7fe5fc0d07a0 2024-05-08T10:55:32.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.098+0000 7fe60383f640 1 -- 172.21.15.33:0/2967530336 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5fc0d07a0 msgr2=0x7fe5fc0b6990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:32.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.098+0000 7fe60383f640 1 --2- 172.21.15.33:0/2967530336 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5fc0d07a0 0x7fe5fc0b6990 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe5f00097a0 tx=0x7fe5f002a1e0 comp rx=0 tx=0).stop 2024-05-08T10:55:32.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.098+0000 7fe60383f640 1 -- 172.21.15.33:0/2967530336 shutdown_connections 2024-05-08T10:55:32.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.098+0000 7fe60383f640 1 --2- 172.21.15.33:0/2967530336 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5fc0d07a0 0x7fe5fc0b6990 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:32.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.098+0000 7fe60383f640 1 -- 172.21.15.33:0/2967530336 >> 172.21.15.33:0/2967530336 conn(0x7fe5fc09ce90 msgr2=0x7fe5fc0d3b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:32.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.099+0000 7fe60383f640 1 -- 172.21.15.33:0/2967530336 shutdown_connections 2024-05-08T10:55:32.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.099+0000 7fe60383f640 1 -- 172.21.15.33:0/2967530336 wait complete. 2024-05-08T10:55:32.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.100+0000 7fe60383f640 1 Processor -- start 2024-05-08T10:55:32.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.100+0000 7fe60383f640 1 -- start start 2024-05-08T10:55:32.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.100+0000 7fe60383f640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5fc0d03c0 0x7fe5fc153280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:32.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.100+0000 7fe60383f640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe5fc0d07a0 0x7fe5fc0cbc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:32.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.100+0000 7fe60383f640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe5fc1f5360 0x7fe5fc1f6b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:32.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.100+0000 7fe60383f640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5fc0b4db0 con 0x7fe5fc0d03c0 2024-05-08T10:55:32.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.100+0000 7fe60383f640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5fc0cebd0 con 0x7fe5fc1f5360 2024-05-08T10:55:32.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.100+0000 7fe60383f640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5fc0b4f30 con 0x7fe5fc0d07a0 2024-05-08T10:55:32.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.101+0000 7fe6015db640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5fc0d03c0 0x7fe5fc153280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:32.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.101+0000 7fe6015db640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5fc0d03c0 0x7fe5fc153280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33856/0 (socket says 172.21.15.33:33856) 2024-05-08T10:55:32.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.101+0000 7fe6015db640 1 -- 172.21.15.33:0/741218305 learned_addr learned my addr 172.21.15.33:0/741218305 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:32.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.101+0000 7fe601ddc640 1 --2- 172.21.15.33:0/741218305 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe5fc1f5360 0x7fe5fc1f6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:32.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.101+0000 7fe600dda640 1 --2- 172.21.15.33:0/741218305 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe5fc0d07a0 0x7fe5fc0cbc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:32.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.101+0000 7fe6015db640 1 -- 172.21.15.33:0/741218305 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe5fc0d07a0 msgr2=0x7fe5fc0cbc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:32.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.101+0000 7fe6015db640 1 --2- 172.21.15.33:0/741218305 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe5fc0d07a0 0x7fe5fc0cbc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:32.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.101+0000 7fe6015db640 1 -- 172.21.15.33:0/741218305 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe5fc1f5360 msgr2=0x7fe5fc1f6b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:32.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.101+0000 7fe6015db640 1 --2- 172.21.15.33:0/741218305 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe5fc1f5360 0x7fe5fc1f6b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:32.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.101+0000 7fe6015db640 1 -- 172.21.15.33:0/741218305 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5fc1f5810 con 0x7fe5fc0d03c0 2024-05-08T10:55:32.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.101+0000 7fe6015db640 1 --2- 172.21.15.33:0/741218305 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5fc0d03c0 0x7fe5fc153280 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fe5f400c4d0 tx=0x7fe5f400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:32.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.101+0000 7fe5f9ffb640 1 -- 172.21.15.33:0/741218305 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f4017070 con 0x7fe5fc0d03c0 2024-05-08T10:55:32.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.101+0000 7fe60383f640 1 -- 172.21.15.33:0/741218305 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5fc1f5a90 con 0x7fe5fc0d03c0 2024-05-08T10:55:32.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.101+0000 7fe5f9ffb640 1 -- 172.21.15.33:0/741218305 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5f4005d00 con 0x7fe5fc0d03c0 2024-05-08T10:55:32.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.101+0000 7fe5f9ffb640 1 -- 172.21.15.33:0/741218305 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f40072b0 con 0x7fe5fc0d03c0 2024-05-08T10:55:32.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.102+0000 7fe60383f640 1 -- 172.21.15.33:0/741218305 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5fc1f6050 con 0x7fe5fc0d03c0 2024-05-08T10:55:32.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.102+0000 7fe60383f640 1 -- 172.21.15.33:0/741218305 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5fc069d20 con 0x7fe5fc0d03c0 2024-05-08T10:55:32.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.103+0000 7fe5f9ffb640 1 -- 172.21.15.33:0/741218305 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe5f401a070 con 0x7fe5fc0d03c0 2024-05-08T10:55:32.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.103+0000 7fe5f9ffb640 1 --2- 172.21.15.33:0/741218305 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fe5e806b4d0 0x7fe5e806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:32.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.104+0000 7fe5f9ffb640 1 -- 172.21.15.33:0/741218305 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe5f40894e0 con 0x7fe5fc0d03c0 2024-05-08T10:55:32.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.104+0000 7fe600dda640 1 --2- 172.21.15.33:0/741218305 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fe5e806b4d0 0x7fe5e806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:32.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.104+0000 7fe600dda640 1 --2- 172.21.15.33:0/741218305 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fe5e806b4d0 0x7fe5e806d990 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe5f0034000 tx=0x7fe5f002e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:32.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.108+0000 7fe5f9ffb640 1 -- 172.21.15.33:0/741218305 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe5fc1f5810 con 0x7fe5fc0d03c0 2024-05-08T10:55:32.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.289+0000 7fe60383f640 1 -- 172.21.15.33:0/741218305 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe5fc0d10f0 con 0x7fe5fc0d03c0 2024-05-08T10:55:32.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.290+0000 7fe5f9ffb640 1 -- 172.21.15.33:0/741218305 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+16694 (secure 0 0 0) 0x7fe5f4057d20 con 0x7fe5fc0d03c0 2024-05-08T10:55:32.288 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:55:32.288 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":30,"fsid":"963217b2-c375-4f5a-95cf-88e199dd38ff","created":"2024-05-08T10:54:26.711528+0000","modified":"2024-05-08T10:55:31.311513+0000","last_up_change":"2024-05-08T10:54:37.987478+0000","last_in_change":"2024-05-08T10:54:28.834106+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T10:54:38.989228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-05-08T10:55:29.133374+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-05-08T10:55:30.307270+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c5da4fb5-d4f2-4982-a804-2aa92fe77731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3990629207},{"type":"v1","addr":"172.21.15.33:6817","nonce":3990629207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3990629207},{"type":"v1","addr":"172.21.15.33:6819","nonce":3990629207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3990629207},{"type":"v1","addr":"172.21.15.33:6823","nonce":3990629207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3990629207},{"type":"v1","addr":"172.21.15.33:6821","nonce":3990629207}]},"public_addr":"172.21.15.33:6817/3990629207","cluster_addr":"172.21.15.33:6819/3990629207","heartbeat_back_addr":"172.21.15.33:6823/3990629207","heartbeat_front_addr":"172.21.15.33:6821/3990629207","state":["exists","up"]},{"osd":1,"uuid":"f8fdd8db-c2a3-4d28-81f3-b30f44bea7c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":1758076090},{"type":"v1","addr":"172.21.15.33:6825","nonce":1758076090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":1758076090},{"type":"v1","addr":"172.21.15.33:6827","nonce":1758076090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":1758076090},{"type":"v1","addr":"172.21.15.33:6831","nonce":1758076090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":1758076090},{"type":"v1","addr":"172.21.15.33:6829","nonce":1758076090}]},"public_addr":"172.21.15.33:6825/1758076090","cluster_addr":"172.21.15.33:6827/1758076090","heartbeat_back_addr":"172.21.15.33:6831/1758076090","heartbeat_front_addr":"172.21.15.33:6829/1758076090","state":["exists","up"]},{"osd":2,"uuid":"87d465f3-b40f-48dd-bae2-4c67904d4828","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":2940853479},{"type":"v1","addr":"172.21.15.33:6801","nonce":2940853479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6803","nonce":2940853479},{"type":"v1","addr":"172.21.15.33:6805","nonce":2940853479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6811","nonce":2940853479},{"type":"v1","addr":"172.21.15.33:6813","nonce":2940853479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6807","nonce":2940853479},{"type":"v1","addr":"172.21.15.33:6809","nonce":2940853479}]},"public_addr":"172.21.15.33:6801/2940853479","cluster_addr":"172.21.15.33:6805/2940853479","heartbeat_back_addr":"172.21.15.33:6813/2940853479","heartbeat_front_addr":"172.21.15.33:6809/2940853479","state":["exists","up"]},{"osd":3,"uuid":"79450edf-9637-4181-9372-e1cd5e91e73e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":4029047077},{"type":"v1","addr":"172.21.15.33:6804","nonce":4029047077}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":4029047077},{"type":"v1","addr":"172.21.15.33:6808","nonce":4029047077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":4029047077},{"type":"v1","addr":"172.21.15.33:6815","nonce":4029047077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":4029047077},{"type":"v1","addr":"172.21.15.33:6812","nonce":4029047077}]},"public_addr":"172.21.15.33:6804/4029047077","cluster_addr":"172.21.15.33:6808/4029047077","heartbeat_back_addr":"172.21.15.33:6815/4029047077","heartbeat_front_addr":"172.21.15.33:6812/4029047077","state":["exists","up"]},{"osd":4,"uuid":"bd0debfa-e559-4b1e-920d-6b2639c7085e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":1697399220},{"type":"v1","addr":"172.21.15.174:6801","nonce":1697399220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":1697399220},{"type":"v1","addr":"172.21.15.174:6803","nonce":1697399220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":1697399220},{"type":"v1","addr":"172.21.15.174:6807","nonce":1697399220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":1697399220},{"type":"v1","addr":"172.21.15.174:6805","nonce":1697399220}]},"public_addr":"172.21.15.174:6801/1697399220","cluster_addr":"172.21.15.174:6803/1697399220","heartbeat_back_addr":"172.21.15.174:6807/1697399220","heartbeat_front_addr":"172.21.15.174:6805/1697399220","state":["exists","up"]},{"osd":5,"uuid":"ff0f51c0-672b-448f-9de1-b9305ce8c00d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":1511860729},{"type":"v1","addr":"172.21.15.174:6825","nonce":1511860729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":1511860729},{"type":"v1","addr":"172.21.15.174:6827","nonce":1511860729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":1511860729},{"type":"v1","addr":"172.21.15.174:6831","nonce":1511860729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":1511860729},{"type":"v1","addr":"172.21.15.174:6829","nonce":1511860729}]},"public_addr":"172.21.15.174:6825/1511860729","cluster_addr":"172.21.15.174:6827/1511860729","heartbeat_back_addr":"172.21.15.174:6831/1511860729","heartbeat_front_addr":"172.21.15.174:6829/1511860729","state":["exists","up"]},{"osd":6,"uuid":"93061f6c-c0ce-47e9-88a0-1151c5ccb4e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":2326407945},{"type":"v1","addr":"172.21.15.174:6817","nonce":2326407945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":2326407945},{"type":"v1","addr":"172.21.15.174:6819","nonce":2326407945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":2326407945},{"type":"v1","addr":"172.21.15.174:6823","nonce":2326407945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":2326407945},{"type":"v1","addr":"172.21.15.174:6821","nonce":2326407945}]},"public_addr":"172.21.15.174:6817/2326407945","cluster_addr":"172.21.15.174:6819/2326407945","heartbeat_back_addr":"172.21.15.174:6823/2326407945","heartbeat_front_addr":"172.21.15.174:6821/2326407945","state":["exists","up"]},{"osd":7,"uuid":"7be1dcf3-1957-4ec3-bacf-f5f9fff580a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":1637570253},{"type":"v1","addr":"172.21.15.174:6809","nonce":1637570253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":1637570253},{"type":"v1","addr":"172.21.15.174:6811","nonce":1637570253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":1637570253},{"type":"v1","addr":"172.21.15.174:6815","nonce":1637570253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":1637570253},{"type":"v1","addr":"172.21.15.174:6813","nonce":1637570253}]},"public_addr":"172.21.15.174:6809/1637570253","cluster_addr":"172.21.15.174:6811/1637570253","heartbeat_back_addr":"172.21.15.174:6815/1637570253","heartbeat_front_addr":"172.21.15.174:6813/1637570253","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:33.997709+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:34.016568+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:33.990484+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:33.980666+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:33.920609+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:34.005069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:34.018345+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:34.061646+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T10:55:32.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.292+0000 7fe60383f640 1 -- 172.21.15.33:0/741218305 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fe5e806b4d0 msgr2=0x7fe5e806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:32.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.292+0000 7fe60383f640 1 --2- 172.21.15.33:0/741218305 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fe5e806b4d0 0x7fe5e806d990 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe5f0034000 tx=0x7fe5f002e000 comp rx=0 tx=0).stop 2024-05-08T10:55:32.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.292+0000 7fe60383f640 1 -- 172.21.15.33:0/741218305 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5fc0d03c0 msgr2=0x7fe5fc153280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:32.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.292+0000 7fe60383f640 1 --2- 172.21.15.33:0/741218305 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5fc0d03c0 0x7fe5fc153280 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fe5f400c4d0 tx=0x7fe5f400c990 comp rx=0 tx=0).stop 2024-05-08T10:55:32.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.292+0000 7fe60383f640 1 -- 172.21.15.33:0/741218305 shutdown_connections 2024-05-08T10:55:32.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.292+0000 7fe60383f640 1 --2- 172.21.15.33:0/741218305 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fe5e806b4d0 0x7fe5e806d990 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:32.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.292+0000 7fe60383f640 1 --2- 172.21.15.33:0/741218305 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe5fc1f5360 0x7fe5fc1f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:32.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.292+0000 7fe60383f640 1 --2- 172.21.15.33:0/741218305 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe5fc0d07a0 0x7fe5fc0cbc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:32.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.292+0000 7fe60383f640 1 --2- 172.21.15.33:0/741218305 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5fc0d03c0 0x7fe5fc153280 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:32.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.292+0000 7fe60383f640 1 -- 172.21.15.33:0/741218305 >> 172.21.15.33:0/741218305 conn(0x7fe5fc09ce90 msgr2=0x7fe5fc154f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:32.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.292+0000 7fe60383f640 1 -- 172.21.15.33:0/741218305 shutdown_connections 2024-05-08T10:55:32.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.292+0000 7fe60383f640 1 -- 172.21.15.33:0/741218305 wait complete. 2024-05-08T10:55:32.301 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T10:55:32.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.407+0000 7f97a0d9e640 1 Processor -- start 2024-05-08T10:55:32.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.407+0000 7f97a0d9e640 1 -- start start 2024-05-08T10:55:32.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.408+0000 7f97a0d9e640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f979c15dd20 0x7f979c0d1f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:32.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.408+0000 7f97a0d9e640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f979c0d2640 con 0x7f979c0d4440 2024-05-08T10:55:32.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.408+0000 7f97a0d9e640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f979c0d2920 con 0x7f979c0d0910 2024-05-08T10:55:32.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.408+0000 7f97a0d9e640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f979c06b0b0 con 0x7f979c15dd20 2024-05-08T10:55:32.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.408+0000 7f979affd640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f979c0d4440 0x7f979c0d0200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:53960/0 (socket says 172.21.15.33:53960) 2024-05-08T10:55:32.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.408+0000 7f979affd640 1 -- 172.21.15.33:0/70217038 learned_addr learned my addr 172.21.15.33:0/70217038 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-05-08T10:55:32.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.408+0000 7f979b7fe640 1 --2- 172.21.15.33:0/70217038 >> v2:172.21.15.174:3300/0 conn(0x7f979c15dd20 0x7f979c0d1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:32.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.408+0000 7f979a7fc640 1 -- 172.21.15.33:0/70217038 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 377546231 0 0) 0x7f979c0d2640 con 0x7f979c0d4440 2024-05-08T10:55:32.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.408+0000 7f979a7fc640 1 -- 172.21.15.33:0/70217038 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9784003520 con 0x7f979c0d4440 2024-05-08T10:55:32.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.408+0000 7f979a7fc640 1 -- 172.21.15.33:0/70217038 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2694374475 0 0) 0x7f979c0d2920 con 0x7f979c0d0910 2024-05-08T10:55:32.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.408+0000 7f979a7fc640 1 -- 172.21.15.33:0/70217038 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f979c0d2640 con 0x7f979c0d0910 2024-05-08T10:55:32.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.408+0000 7f979b7fe640 1 -- 172.21.15.33:0/70217038 >> v1:172.21.15.174:6789/0 conn(0x7f979c0d0910 legacy=0x7f979c06bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:32.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.408+0000 7f979a7fc640 1 -- 172.21.15.33:0/70217038 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1314890101 0 0) 0x7f9784003520 con 0x7f979c0d4440 2024-05-08T10:55:32.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.408+0000 7f979b7fe640 1 -- 172.21.15.33:0/70217038 >> v1:172.21.15.33:6789/0 conn(0x7f979c0d4440 legacy=0x7f979c0d0200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:32.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.408+0000 7f979b7fe640 1 -- 172.21.15.33:0/70217038 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f979c06b390 con 0x7f979c15dd20 2024-05-08T10:55:32.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.409+0000 7f979b7fe640 1 --2- 172.21.15.33:0/70217038 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f979c15dd20 0x7f979c0d1f80 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f978c0097a0 tx=0x7f978c02a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e851aff2f4a9f5ae server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:32.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.409+0000 7f979a7fc640 1 -- 172.21.15.33:0/70217038 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f978c037070 con 0x7f979c15dd20 2024-05-08T10:55:32.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.409+0000 7f979a7fc640 1 -- 172.21.15.33:0/70217038 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f978c02ac50 con 0x7f979c15dd20 2024-05-08T10:55:32.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.409+0000 7f979a7fc640 1 -- 172.21.15.33:0/70217038 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9790001670 con 0x7f979c15dd20 2024-05-08T10:55:32.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.410+0000 7f97a0d9e640 1 -- 172.21.15.33:0/70217038 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f979c15dd20 msgr2=0x7f979c0d1f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:32.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.410+0000 7f97a0d9e640 1 --2- 172.21.15.33:0/70217038 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f979c15dd20 0x7f979c0d1f80 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f978c0097a0 tx=0x7f978c02a1c0 comp rx=0 tx=0).stop 2024-05-08T10:55:32.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.410+0000 7f97a0d9e640 1 -- 172.21.15.33:0/70217038 shutdown_connections 2024-05-08T10:55:32.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.410+0000 7f97a0d9e640 1 --2- 172.21.15.33:0/70217038 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f979c15dd20 0x7f979c0d1f80 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:32.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.410+0000 7f97a0d9e640 1 -- 172.21.15.33:0/70217038 >> 172.21.15.33:0/70217038 conn(0x7f979c09ccd0 msgr2=0x7f979c0d39a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:32.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.410+0000 7f97a0d9e640 1 -- 172.21.15.33:0/70217038 shutdown_connections 2024-05-08T10:55:32.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.410+0000 7f97a0d9e640 1 -- 172.21.15.33:0/70217038 wait complete. 2024-05-08T10:55:32.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.411+0000 7f97a0d9e640 1 Processor -- start 2024-05-08T10:55:32.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.412+0000 7f97a0d9e640 1 -- start start 2024-05-08T10:55:32.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.412+0000 7f97a0d9e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f979c0d0910 0x7f979c15c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:32.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.412+0000 7f97a0d9e640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f979c0d4440 0x7f979c0cd290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:32.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.412+0000 7f97a0d9e640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f979c15dd20 0x7f979c0cd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:32.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.412+0000 7f97a0d9e640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f979c06c2a0 con 0x7f979c0d0910 2024-05-08T10:55:32.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.412+0000 7f97a0d9e640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f979c0d4880 con 0x7f979c0d4440 2024-05-08T10:55:32.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.412+0000 7f97a0d9e640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f979c06c420 con 0x7f979c15dd20 2024-05-08T10:55:32.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.412+0000 7f979b7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f979c0d0910 0x7f979c15c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:32.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.412+0000 7f979b7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f979c0d0910 0x7f979c15c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33862/0 (socket says 172.21.15.33:33862) 2024-05-08T10:55:32.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.412+0000 7f979b7fe640 1 -- 172.21.15.33:0/2205149893 learned_addr learned my addr 172.21.15.33:0/2205149893 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:32.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.412+0000 7f979affd640 1 --2- 172.21.15.33:0/2205149893 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f979c0d4440 0x7f979c0cd290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:32.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.412+0000 7f979bfff640 1 --2- 172.21.15.33:0/2205149893 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f979c15dd20 0x7f979c0cd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:32.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.413+0000 7f979b7fe640 1 -- 172.21.15.33:0/2205149893 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f979c15dd20 msgr2=0x7f979c0cd7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:32.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.413+0000 7f979b7fe640 1 --2- 172.21.15.33:0/2205149893 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f979c15dd20 0x7f979c0cd7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:32.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.413+0000 7f979b7fe640 1 -- 172.21.15.33:0/2205149893 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f979c0d4440 msgr2=0x7f979c0cd290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:32.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.413+0000 7f979b7fe640 1 --2- 172.21.15.33:0/2205149893 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f979c0d4440 0x7f979c0cd290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:32.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.413+0000 7f979b7fe640 1 -- 172.21.15.33:0/2205149893 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f979c0cab10 con 0x7f979c0d0910 2024-05-08T10:55:32.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.413+0000 7f979bfff640 1 --2- 172.21.15.33:0/2205149893 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f979c15dd20 0x7f979c0cd7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:55:32.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.413+0000 7f979b7fe640 1 --2- 172.21.15.33:0/2205149893 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f979c0d0910 0x7f979c15c480 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f978c035040 tx=0x7f978c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:32.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.413+0000 7f9783fff640 1 -- 172.21.15.33:0/2205149893 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f978c041020 con 0x7f979c0d0910 2024-05-08T10:55:32.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.413+0000 7f9783fff640 1 -- 172.21.15.33:0/2205149893 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f978c03d420 con 0x7f979c0d0910 2024-05-08T10:55:32.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.413+0000 7f9783fff640 1 -- 172.21.15.33:0/2205149893 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f978c037040 con 0x7f979c0d0910 2024-05-08T10:55:32.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.413+0000 7f97a0d9e640 1 -- 172.21.15.33:0/2205149893 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f979c0b8c00 con 0x7f979c0d0910 2024-05-08T10:55:32.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.413+0000 7f97a0d9e640 1 -- 172.21.15.33:0/2205149893 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f979c0c8910 con 0x7f979c0d0910 2024-05-08T10:55:32.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.414+0000 7f97a0d9e640 1 -- 172.21.15.33:0/2205149893 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f979c04efc0 con 0x7f979c0d0910 2024-05-08T10:55:32.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.415+0000 7f9783fff640 1 -- 172.21.15.33:0/2205149893 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f978c044020 con 0x7f979c0d0910 2024-05-08T10:55:32.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.415+0000 7f9783fff640 1 --2- 172.21.15.33:0/2205149893 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f978806b4d0 0x7f978806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:32.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.415+0000 7f9783fff640 1 -- 172.21.15.33:0/2205149893 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f978c0aa150 con 0x7f979c0d0910 2024-05-08T10:55:32.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.415+0000 7f979affd640 1 --2- 172.21.15.33:0/2205149893 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f978806b4d0 0x7f978806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:32.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.416+0000 7f979affd640 1 --2- 172.21.15.33:0/2205149893 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f978806b4d0 0x7f978806d990 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f979c0b9840 tx=0x7f9790001610 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:32.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.419+0000 7f9783fff640 1 -- 172.21.15.33:0/2205149893 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f978c04b070 con 0x7f979c0d0910 2024-05-08T10:55:32.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.598+0000 7f97a0d9e640 1 -- 172.21.15.33:0/2205149893 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f979c0b1950 con 0x7f979c0d0910 2024-05-08T10:55:32.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.600+0000 7f9783fff640 1 -- 172.21.15.33:0/2205149893 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+16694 (secure 0 0 0) 0x7f978c078fe0 con 0x7f979c0d0910 2024-05-08T10:55:32.597 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:55:32.597 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":30,"fsid":"963217b2-c375-4f5a-95cf-88e199dd38ff","created":"2024-05-08T10:54:26.711528+0000","modified":"2024-05-08T10:55:31.311513+0000","last_up_change":"2024-05-08T10:54:37.987478+0000","last_in_change":"2024-05-08T10:54:28.834106+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T10:54:38.989228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-05-08T10:55:29.133374+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-05-08T10:55:30.307270+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c5da4fb5-d4f2-4982-a804-2aa92fe77731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3990629207},{"type":"v1","addr":"172.21.15.33:6817","nonce":3990629207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3990629207},{"type":"v1","addr":"172.21.15.33:6819","nonce":3990629207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3990629207},{"type":"v1","addr":"172.21.15.33:6823","nonce":3990629207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3990629207},{"type":"v1","addr":"172.21.15.33:6821","nonce":3990629207}]},"public_addr":"172.21.15.33:6817/3990629207","cluster_addr":"172.21.15.33:6819/3990629207","heartbeat_back_addr":"172.21.15.33:6823/3990629207","heartbeat_front_addr":"172.21.15.33:6821/3990629207","state":["exists","up"]},{"osd":1,"uuid":"f8fdd8db-c2a3-4d28-81f3-b30f44bea7c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":1758076090},{"type":"v1","addr":"172.21.15.33:6825","nonce":1758076090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":1758076090},{"type":"v1","addr":"172.21.15.33:6827","nonce":1758076090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":1758076090},{"type":"v1","addr":"172.21.15.33:6831","nonce":1758076090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":1758076090},{"type":"v1","addr":"172.21.15.33:6829","nonce":1758076090}]},"public_addr":"172.21.15.33:6825/1758076090","cluster_addr":"172.21.15.33:6827/1758076090","heartbeat_back_addr":"172.21.15.33:6831/1758076090","heartbeat_front_addr":"172.21.15.33:6829/1758076090","state":["exists","up"]},{"osd":2,"uuid":"87d465f3-b40f-48dd-bae2-4c67904d4828","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":2940853479},{"type":"v1","addr":"172.21.15.33:6801","nonce":2940853479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6803","nonce":2940853479},{"type":"v1","addr":"172.21.15.33:6805","nonce":2940853479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6811","nonce":2940853479},{"type":"v1","addr":"172.21.15.33:6813","nonce":2940853479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6807","nonce":2940853479},{"type":"v1","addr":"172.21.15.33:6809","nonce":2940853479}]},"public_addr":"172.21.15.33:6801/2940853479","cluster_addr":"172.21.15.33:6805/2940853479","heartbeat_back_addr":"172.21.15.33:6813/2940853479","heartbeat_front_addr":"172.21.15.33:6809/2940853479","state":["exists","up"]},{"osd":3,"uuid":"79450edf-9637-4181-9372-e1cd5e91e73e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":4029047077},{"type":"v1","addr":"172.21.15.33:6804","nonce":4029047077}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":4029047077},{"type":"v1","addr":"172.21.15.33:6808","nonce":4029047077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":4029047077},{"type":"v1","addr":"172.21.15.33:6815","nonce":4029047077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":4029047077},{"type":"v1","addr":"172.21.15.33:6812","nonce":4029047077}]},"public_addr":"172.21.15.33:6804/4029047077","cluster_addr":"172.21.15.33:6808/4029047077","heartbeat_back_addr":"172.21.15.33:6815/4029047077","heartbeat_front_addr":"172.21.15.33:6812/4029047077","state":["exists","up"]},{"osd":4,"uuid":"bd0debfa-e559-4b1e-920d-6b2639c7085e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":1697399220},{"type":"v1","addr":"172.21.15.174:6801","nonce":1697399220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":1697399220},{"type":"v1","addr":"172.21.15.174:6803","nonce":1697399220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":1697399220},{"type":"v1","addr":"172.21.15.174:6807","nonce":1697399220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":1697399220},{"type":"v1","addr":"172.21.15.174:6805","nonce":1697399220}]},"public_addr":"172.21.15.174:6801/1697399220","cluster_addr":"172.21.15.174:6803/1697399220","heartbeat_back_addr":"172.21.15.174:6807/1697399220","heartbeat_front_addr":"172.21.15.174:6805/1697399220","state":["exists","up"]},{"osd":5,"uuid":"ff0f51c0-672b-448f-9de1-b9305ce8c00d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":1511860729},{"type":"v1","addr":"172.21.15.174:6825","nonce":1511860729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":1511860729},{"type":"v1","addr":"172.21.15.174:6827","nonce":1511860729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":1511860729},{"type":"v1","addr":"172.21.15.174:6831","nonce":1511860729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":1511860729},{"type":"v1","addr":"172.21.15.174:6829","nonce":1511860729}]},"public_addr":"172.21.15.174:6825/1511860729","cluster_addr":"172.21.15.174:6827/1511860729","heartbeat_back_addr":"172.21.15.174:6831/1511860729","heartbeat_front_addr":"172.21.15.174:6829/1511860729","state":["exists","up"]},{"osd":6,"uuid":"93061f6c-c0ce-47e9-88a0-1151c5ccb4e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":2326407945},{"type":"v1","addr":"172.21.15.174:6817","nonce":2326407945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":2326407945},{"type":"v1","addr":"172.21.15.174:6819","nonce":2326407945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":2326407945},{"type":"v1","addr":"172.21.15.174:6823","nonce":2326407945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":2326407945},{"type":"v1","addr":"172.21.15.174:6821","nonce":2326407945}]},"public_addr":"172.21.15.174:6817/2326407945","cluster_addr":"172.21.15.174:6819/2326407945","heartbeat_back_addr":"172.21.15.174:6823/2326407945","heartbeat_front_addr":"172.21.15.174:6821/2326407945","state":["exists","up"]},{"osd":7,"uuid":"7be1dcf3-1957-4ec3-bacf-f5f9fff580a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":1637570253},{"type":"v1","addr":"172.21.15.174:6809","nonce":1637570253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":1637570253},{"type":"v1","addr":"172.21.15.174:6811","nonce":1637570253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":1637570253},{"type":"v1","addr":"172.21.15.174:6815","nonce":1637570253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":1637570253},{"type":"v1","addr":"172.21.15.174:6813","nonce":1637570253}]},"public_addr":"172.21.15.174:6809/1637570253","cluster_addr":"172.21.15.174:6811/1637570253","heartbeat_back_addr":"172.21.15.174:6815/1637570253","heartbeat_front_addr":"172.21.15.174:6813/1637570253","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:33.997709+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:34.016568+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:33.990484+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:33.980666+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:33.920609+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:34.005069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:34.018345+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:34.061646+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T10:55:32.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.602+0000 7f97a0d9e640 1 -- 172.21.15.33:0/2205149893 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f978806b4d0 msgr2=0x7f978806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:32.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.602+0000 7f97a0d9e640 1 --2- 172.21.15.33:0/2205149893 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f978806b4d0 0x7f978806d990 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f979c0b9840 tx=0x7f9790001610 comp rx=0 tx=0).stop 2024-05-08T10:55:32.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.602+0000 7f97a0d9e640 1 -- 172.21.15.33:0/2205149893 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f979c0d0910 msgr2=0x7f979c15c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:32.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.602+0000 7f97a0d9e640 1 --2- 172.21.15.33:0/2205149893 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f979c0d0910 0x7f979c15c480 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f978c035040 tx=0x7f978c0046c0 comp rx=0 tx=0).stop 2024-05-08T10:55:32.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.602+0000 7f97a0d9e640 1 -- 172.21.15.33:0/2205149893 shutdown_connections 2024-05-08T10:55:32.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.602+0000 7f97a0d9e640 1 --2- 172.21.15.33:0/2205149893 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f978806b4d0 0x7f978806d990 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:32.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.602+0000 7f97a0d9e640 1 --2- 172.21.15.33:0/2205149893 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f979c15dd20 0x7f979c0cd7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:32.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.602+0000 7f97a0d9e640 1 --2- 172.21.15.33:0/2205149893 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f979c0d4440 0x7f979c0cd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:32.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.602+0000 7f97a0d9e640 1 --2- 172.21.15.33:0/2205149893 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f979c0d0910 0x7f979c15c480 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:32.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.602+0000 7f97a0d9e640 1 -- 172.21.15.33:0/2205149893 >> 172.21.15.33:0/2205149893 conn(0x7f979c09ccd0 msgr2=0x7f979c0d3900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:32.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.602+0000 7f97a0d9e640 1 -- 172.21.15.33:0/2205149893 shutdown_connections 2024-05-08T10:55:32.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.602+0000 7f97a0d9e640 1 -- 172.21.15.33:0/2205149893 wait complete. 2024-05-08T10:55:32.610 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-08T10:55:32.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.720+0000 7f11f872b640 1 Processor -- start 2024-05-08T10:55:32.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.720+0000 7f11f872b640 1 -- start start 2024-05-08T10:55:32.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.722+0000 7f11f872b640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f11f00d18b0 0x7f11f00cf1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:32.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.722+0000 7f11f872b640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11f00cfa30 con 0x7f11f00b7720 2024-05-08T10:55:32.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.722+0000 7f11f872b640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11f00b6c40 con 0x7f11f00d21c0 2024-05-08T10:55:32.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.722+0000 7f11f872b640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11f00b7290 con 0x7f11f00d18b0 2024-05-08T10:55:32.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.722+0000 7f11f5cc6640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f11f00d18b0 0x7f11f00cf1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:32.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.722+0000 7f11f6cc8640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f11f00b7720 0x7f11f00b7b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:53968/0 (socket says 172.21.15.33:53968) 2024-05-08T10:55:32.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.722+0000 7f11f6cc8640 1 -- 172.21.15.33:0/864336309 learned_addr learned my addr 172.21.15.33:0/864336309 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-05-08T10:55:32.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.722+0000 7f11f5cc6640 1 -- 172.21.15.33:0/864336309 >> v1:172.21.15.174:6789/0 conn(0x7f11f00d21c0 legacy=0x7f11f00d25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:32.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.722+0000 7f11f5cc6640 1 -- 172.21.15.33:0/864336309 >> v1:172.21.15.33:6789/0 conn(0x7f11f00b7720 legacy=0x7f11f00b7b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:32.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.722+0000 7f11f5cc6640 1 -- 172.21.15.33:0/864336309 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11f00b6f20 con 0x7f11f00d18b0 2024-05-08T10:55:32.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.723+0000 7f11f5cc6640 1 --2- 172.21.15.33:0/864336309 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11f00d18b0 0x7f11f00cf1d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f11f00b7410 tx=0x7f11e002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a087210b8cfb636 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:32.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.723+0000 7f11f54c5640 1 -- 172.21.15.33:0/864336309 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11e0037070 con 0x7f11f00d18b0 2024-05-08T10:55:32.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.723+0000 7f11f54c5640 1 -- 172.21.15.33:0/864336309 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11e0032440 con 0x7f11f00d18b0 2024-05-08T10:55:32.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.723+0000 7f11f54c5640 1 -- 172.21.15.33:0/864336309 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11e0032810 con 0x7f11f00d18b0 2024-05-08T10:55:32.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.723+0000 7f11f872b640 1 -- 172.21.15.33:0/864336309 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11f00d18b0 msgr2=0x7f11f00cf1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:32.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.723+0000 7f11f872b640 1 --2- 172.21.15.33:0/864336309 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11f00d18b0 0x7f11f00cf1d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f11f00b7410 tx=0x7f11e002a270 comp rx=0 tx=0).stop 2024-05-08T10:55:32.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.724+0000 7f11f872b640 1 -- 172.21.15.33:0/864336309 shutdown_connections 2024-05-08T10:55:32.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.724+0000 7f11f872b640 1 --2- 172.21.15.33:0/864336309 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11f00d18b0 0x7f11f00cf1d0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:32.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.724+0000 7f11f872b640 1 -- 172.21.15.33:0/864336309 >> 172.21.15.33:0/864336309 conn(0x7f11f00d3be0 msgr2=0x7f11f00d3ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:32.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.724+0000 7f11f872b640 1 -- 172.21.15.33:0/864336309 shutdown_connections 2024-05-08T10:55:32.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.724+0000 7f11f872b640 1 -- 172.21.15.33:0/864336309 wait complete. 2024-05-08T10:55:32.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.725+0000 7f11f872b640 1 Processor -- start 2024-05-08T10:55:32.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.725+0000 7f11f872b640 1 -- start start 2024-05-08T10:55:32.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.726+0000 7f11f872b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11f00b7720 0x7f11f0153ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:32.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.726+0000 7f11f872b640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f11f00d18b0 0x7f11f00ccf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:32.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.726+0000 7f11f872b640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f11f00d21c0 0x7f11f00b2560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:32.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.726+0000 7f11f872b640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11f00b8260 con 0x7f11f00b7720 2024-05-08T10:55:32.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.726+0000 7f11f872b640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11f00cf710 con 0x7f11f00d21c0 2024-05-08T10:55:32.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.726+0000 7f11f872b640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11f00b83e0 con 0x7f11f00d18b0 2024-05-08T10:55:32.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.726+0000 7f11f64c7640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11f00b7720 0x7f11f0153ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:32.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.726+0000 7f11f64c7640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11f00b7720 0x7f11f0153ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33880/0 (socket says 172.21.15.33:33880) 2024-05-08T10:55:32.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.726+0000 7f11f64c7640 1 -- 172.21.15.33:0/3149723567 learned_addr learned my addr 172.21.15.33:0/3149723567 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:32.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.726+0000 7f11f5cc6640 1 --2- 172.21.15.33:0/3149723567 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f11f00d18b0 0x7f11f00ccf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:32.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.726+0000 7f11f6cc8640 1 --2- 172.21.15.33:0/3149723567 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f11f00d21c0 0x7f11f00b2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:32.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.726+0000 7f11f64c7640 1 -- 172.21.15.33:0/3149723567 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f11f00d18b0 msgr2=0x7f11f00ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:32.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.726+0000 7f11f64c7640 1 --2- 172.21.15.33:0/3149723567 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f11f00d18b0 0x7f11f00ccf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:32.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.726+0000 7f11f64c7640 1 -- 172.21.15.33:0/3149723567 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f11f00d21c0 msgr2=0x7f11f00b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:32.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.726+0000 7f11f64c7640 1 --2- 172.21.15.33:0/3149723567 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f11f00d21c0 0x7f11f00b2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:32.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.726+0000 7f11f64c7640 1 -- 172.21.15.33:0/3149723567 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11f0154400 con 0x7f11f00b7720 2024-05-08T10:55:32.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.726+0000 7f11f64c7640 1 --2- 172.21.15.33:0/3149723567 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11f00b7720 0x7f11f0153ec0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f11ec00ba50 tx=0x7f11ec00bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:32.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.726+0000 7f11e6ffd640 1 -- 172.21.15.33:0/3149723567 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11ec019070 con 0x7f11f00b7720 2024-05-08T10:55:32.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.726+0000 7f11e6ffd640 1 -- 172.21.15.33:0/3149723567 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11ec00cc20 con 0x7f11f00b7720 2024-05-08T10:55:32.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.726+0000 7f11f872b640 1 -- 172.21.15.33:0/3149723567 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11f01517c0 con 0x7f11f00b7720 2024-05-08T10:55:32.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.726+0000 7f11e6ffd640 1 -- 172.21.15.33:0/3149723567 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11ec014680 con 0x7f11f00b7720 2024-05-08T10:55:32.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.726+0000 7f11f872b640 1 -- 172.21.15.33:0/3149723567 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11f0151d80 con 0x7f11f00b7720 2024-05-08T10:55:32.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.727+0000 7f11f872b640 1 -- 172.21.15.33:0/3149723567 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11f0069d20 con 0x7f11f00b7720 2024-05-08T10:55:32.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.728+0000 7f11e6ffd640 1 -- 172.21.15.33:0/3149723567 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f11ec01c070 con 0x7f11f00b7720 2024-05-08T10:55:32.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.728+0000 7f11e6ffd640 1 --2- 172.21.15.33:0/3149723567 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f11d406b4d0 0x7f11d406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:32.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.729+0000 7f11e6ffd640 1 -- 172.21.15.33:0/3149723567 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f11ec089df0 con 0x7f11f00b7720 2024-05-08T10:55:32.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.729+0000 7f11f5cc6640 1 --2- 172.21.15.33:0/3149723567 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f11d406b4d0 0x7f11d406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:32.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.729+0000 7f11f5cc6640 1 --2- 172.21.15.33:0/3149723567 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f11d406b4d0 0x7f11d406d990 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f11e0034000 tx=0x7f11e002e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:32.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.732+0000 7f11e6ffd640 1 -- 172.21.15.33:0/3149723567 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f11f0154400 con 0x7f11f00b7720 2024-05-08T10:55:32.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.949+0000 7f11f872b640 1 -- 172.21.15.33:0/3149723567 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f11f008dc40 con 0x7f11f00b7720 2024-05-08T10:55:32.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.980+0000 7f11e6ffd640 1 -- 172.21.15.33:0/3149723567 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v13) v1 ==== 118+0+0 (secure 0 0 0) 0x7f11ec0586b0 con 0x7f11f00b7720 2024-05-08T10:55:32.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.982+0000 7f11f872b640 1 -- 172.21.15.33:0/3149723567 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f11d406b4d0 msgr2=0x7f11d406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:32.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.982+0000 7f11f872b640 1 --2- 172.21.15.33:0/3149723567 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f11d406b4d0 0x7f11d406d990 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f11e0034000 tx=0x7f11e002e000 comp rx=0 tx=0).stop 2024-05-08T10:55:32.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.982+0000 7f11f872b640 1 -- 172.21.15.33:0/3149723567 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11f00b7720 msgr2=0x7f11f0153ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:32.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.982+0000 7f11f872b640 1 --2- 172.21.15.33:0/3149723567 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11f00b7720 0x7f11f0153ec0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f11ec00ba50 tx=0x7f11ec00bf10 comp rx=0 tx=0).stop 2024-05-08T10:55:32.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.982+0000 7f11f872b640 1 -- 172.21.15.33:0/3149723567 shutdown_connections 2024-05-08T10:55:32.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.982+0000 7f11f872b640 1 --2- 172.21.15.33:0/3149723567 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f11d406b4d0 0x7f11d406d990 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:32.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.982+0000 7f11f872b640 1 --2- 172.21.15.33:0/3149723567 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f11f00d21c0 0x7f11f00b2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:32.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.982+0000 7f11f872b640 1 --2- 172.21.15.33:0/3149723567 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f11f00d18b0 0x7f11f00ccf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:32.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.982+0000 7f11f872b640 1 --2- 172.21.15.33:0/3149723567 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11f00b7720 0x7f11f0153ec0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:32.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.982+0000 7f11f872b640 1 -- 172.21.15.33:0/3149723567 >> 172.21.15.33:0/3149723567 conn(0x7f11f00d3be0 msgr2=0x7f11f006caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:32.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.982+0000 7f11f872b640 1 -- 172.21.15.33:0/3149723567 shutdown_connections 2024-05-08T10:55:32.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:32.982+0000 7f11f872b640 1 -- 172.21.15.33:0/3149723567 wait complete. 2024-05-08T10:55:32.991 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-05-08T10:55:32.991 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-08T10:55:33.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:33.101+0000 7f8117990640 1 Processor -- start 2024-05-08T10:55:33.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:33.101+0000 7f8117990640 1 -- start start 2024-05-08T10:55:33.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:33.102+0000 7f8117990640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f81100b4320 0x7f81100d4510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:33.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:33.102+0000 7f8117990640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f81100b33b0 0x7f81100d0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:33.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:33.102+0000 7f8117990640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81100cfb90 con 0x7f81100d0a50 2024-05-08T10:55:33.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:33.102+0000 7f8117990640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81100d0ec0 con 0x7f81100b33b0 2024-05-08T10:55:33.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:33.102+0000 7f8117990640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81100d4a50 con 0x7f81100b4320 2024-05-08T10:55:33.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:33.102+0000 7f8114f2b640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f81100b33b0 0x7f81100d0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:33.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:33.102+0000 7f8115f2d640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f81100d0a50 0x7f81100d1fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:53982/0 (socket says 172.21.15.33:53982) 2024-05-08T10:55:33.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:33.102+0000 7f8115f2d640 1 -- 172.21.15.33:0/1731401237 learned_addr learned my addr 172.21.15.33:0/1731401237 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-05-08T10:55:33.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:33.102+0000 7f811572c640 1 --2- 172.21.15.33:0/1731401237 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f81100b4320 0x7f81100d4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:33.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:33.102+0000 7f8114f2b640 1 -- 172.21.15.33:0/1731401237 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f81100b4320 msgr2=0x7f81100d4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:33.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:33.102+0000 7f8114f2b640 1 --2- 172.21.15.33:0/1731401237 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f81100b4320 0x7f81100d4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:33.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:33.102+0000 7f8114f2b640 1 -- 172.21.15.33:0/1731401237 >> v1:172.21.15.33:6789/0 conn(0x7f81100d0a50 legacy=0x7f81100d1fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:33.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:33.102+0000 7f8114f2b640 1 -- 172.21.15.33:0/1731401237 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81100cf5d0 con 0x7f81100b33b0 2024-05-08T10:55:33.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:33.102+0000 7f8107fff640 1 -- 172.21.15.33:0/1731401237 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3819748310 0 0) 0x7f81100cfb90 con 0x7f81100d0a50 2024-05-08T10:55:33.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:33.103+0000 7f8114f2b640 1 --2- 172.21.15.33:0/1731401237 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81100b33b0 0x7f81100d0510 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f81000097a0 tx=0x7f810002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8857e39c62e33823 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:33.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:33.103+0000 7f8107fff640 1 -- 172.21.15.33:0/1731401237 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8100037070 con 0x7f81100b33b0 2024-05-08T10:55:33.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:33.103+0000 7f8107fff640 1 -- 172.21.15.33:0/1731401237 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8100032440 con 0x7f81100b33b0 2024-05-08T10:55:33.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:33.103+0000 7f8107fff640 1 -- 172.21.15.33:0/1731401237 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8100032810 con 0x7f81100b33b0 2024-05-08T10:55:33.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:33.104+0000 7f8117990640 1 -- 172.21.15.33:0/1731401237 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81100b33b0 msgr2=0x7f81100d0510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:33.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:33.104+0000 7f8117990640 1 --2- 172.21.15.33:0/1731401237 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81100b33b0 0x7f81100d0510 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f81000097a0 tx=0x7f810002a180 comp rx=0 tx=0).stop 2024-05-08T10:55:33.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:33.104+0000 7f8117990640 1 -- 172.21.15.33:0/1731401237 shutdown_connections 2024-05-08T10:55:33.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:33.104+0000 7f8117990640 1 --2- 172.21.15.33:0/1731401237 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81100b33b0 0x7f81100d0510 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:33.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:33.104+0000 7f8117990640 1 --2- 172.21.15.33:0/1731401237 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f81100b4320 0x7f81100d4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:33.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:33.104+0000 7f8117990640 1 -- 172.21.15.33:0/1731401237 >> 172.21.15.33:0/1731401237 conn(0x7f811009ce90 msgr2=0x7f81100d3b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:33.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:33.104+0000 7f8117990640 1 -- 172.21.15.33:0/1731401237 shutdown_connections 2024-05-08T10:55:33.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:33.104+0000 7f8117990640 1 -- 172.21.15.33:0/1731401237 wait complete. 2024-05-08T10:55:33.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:33.105+0000 7f8117990640 1 Processor -- start 2024-05-08T10:55:33.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:33.105+0000 7f8117990640 1 -- start start 2024-05-08T10:55:33.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:33.106+0000 7f8117990640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f81100b33b0 0x7f81100a0f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:33.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:33.106+0000 7f8117990640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f81100b4320 0x7f81100b79f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:33.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:33.106+0000 7f8117990640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81100d0a50 0x7f81101528f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:33.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:33.106+0000 7f8117990640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81100d1a90 con 0x7f81100d0a50 2024-05-08T10:55:33.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:33.106+0000 7f8117990640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81100d17b0 con 0x7f81100b33b0 2024-05-08T10:55:33.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:33.106+0000 7f8117990640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81100b4ca0 con 0x7f81100b4320 2024-05-08T10:55:33.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:33.106+0000 7f8115f2d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81100d0a50 0x7f81101528f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:33.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:33.106+0000 7f8115f2d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81100d0a50 0x7f81101528f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33890/0 (socket says 172.21.15.33:33890) 2024-05-08T10:55:33.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:33.106+0000 7f8115f2d640 1 -- 172.21.15.33:0/45211929 learned_addr learned my addr 172.21.15.33:0/45211929 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:33.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:33.106+0000 7f8114f2b640 1 --2- 172.21.15.33:0/45211929 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f81100b4320 0x7f81100b79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:33.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:33.106+0000 7f811572c640 1 --2- 172.21.15.33:0/45211929 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f81100b33b0 0x7f81100a0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:33.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:33.106+0000 7f8115f2d640 1 -- 172.21.15.33:0/45211929 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f81100b4320 msgr2=0x7f81100b79f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:33.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:33.106+0000 7f8115f2d640 1 --2- 172.21.15.33:0/45211929 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f81100b4320 0x7f81100b79f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:33.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:33.106+0000 7f8115f2d640 1 -- 172.21.15.33:0/45211929 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f81100b33b0 msgr2=0x7f81100a0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:33.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:33.106+0000 7f8115f2d640 1 --2- 172.21.15.33:0/45211929 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f81100b33b0 0x7f81100a0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:33.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:33.106+0000 7f8115f2d640 1 -- 172.21.15.33:0/45211929 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81100b6950 con 0x7f81100d0a50 2024-05-08T10:55:33.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:33.106+0000 7f811572c640 1 --2- 172.21.15.33:0/45211929 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f81100b33b0 0x7f81100a0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:55:33.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:33.106+0000 7f8114f2b640 1 --2- 172.21.15.33:0/45211929 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f81100b4320 0x7f81100b79f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:55:33.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:33.106+0000 7f8115f2d640 1 --2- 172.21.15.33:0/45211929 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81100d0a50 0x7f81101528f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f810800c7a0 tx=0x7f810800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:33.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:33.107+0000 7f8105ffb640 1 -- 172.21.15.33:0/45211929 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8108018070 con 0x7f81100d0a50 2024-05-08T10:55:33.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:33.107+0000 7f8105ffb640 1 -- 172.21.15.33:0/45211929 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f810800a640 con 0x7f81100d0a50 2024-05-08T10:55:33.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:33.107+0000 7f8117990640 1 -- 172.21.15.33:0/45211929 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81100b6c30 con 0x7f81100d0a50 2024-05-08T10:55:33.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:33.107+0000 7f8105ffb640 1 -- 172.21.15.33:0/45211929 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f810800aab0 con 0x7f81100d0a50 2024-05-08T10:55:33.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:33.107+0000 7f8117990640 1 -- 172.21.15.33:0/45211929 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81100b71f0 con 0x7f81100d0a50 2024-05-08T10:55:33.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:33.108+0000 7f8117990640 1 -- 172.21.15.33:0/45211929 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8110069d20 con 0x7f81100d0a50 2024-05-08T10:55:33.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:33.108+0000 7f8105ffb640 1 -- 172.21.15.33:0/45211929 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f810801b070 con 0x7f81100d0a50 2024-05-08T10:55:33.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:33.109+0000 7f8105ffb640 1 --2- 172.21.15.33:0/45211929 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f80f406b4d0 0x7f80f406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:33.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:33.109+0000 7f8105ffb640 1 -- 172.21.15.33:0/45211929 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8108089820 con 0x7f81100d0a50 2024-05-08T10:55:33.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:33.109+0000 7f811572c640 1 --2- 172.21.15.33:0/45211929 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f80f406b4d0 0x7f80f406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:33.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:33.109+0000 7f811572c640 1 --2- 172.21.15.33:0/45211929 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f80f406b4d0 0x7f80f406d990 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f810c006fd0 tx=0x7f810c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:33.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:33.113+0000 7f8105ffb640 1 -- 172.21.15.33:0/45211929 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f81080586a0 con 0x7f81100d0a50 2024-05-08T10:55:33.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:33.332+0000 7f8117990640 1 -- 172.21.15.33:0/45211929 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f8110068d10 con 0x7f81100d0a50 2024-05-08T10:55:33.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:33.988+0000 7f8105ffb640 1 -- 172.21.15.33:0/45211929 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7f8108057fa0 con 0x7f81100d0a50 2024-05-08T10:55:33.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:33.990+0000 7f8117990640 1 -- 172.21.15.33:0/45211929 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f80f406b4d0 msgr2=0x7f80f406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:33.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:33.990+0000 7f8117990640 1 --2- 172.21.15.33:0/45211929 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f80f406b4d0 0x7f80f406d990 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f810c006fd0 tx=0x7f810c008040 comp rx=0 tx=0).stop 2024-05-08T10:55:33.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:33.990+0000 7f8117990640 1 -- 172.21.15.33:0/45211929 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81100d0a50 msgr2=0x7f81101528f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:33.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:33.990+0000 7f8117990640 1 --2- 172.21.15.33:0/45211929 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81100d0a50 0x7f81101528f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f810800c7a0 tx=0x7f810800cc60 comp rx=0 tx=0).stop 2024-05-08T10:55:33.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:33.990+0000 7f8117990640 1 -- 172.21.15.33:0/45211929 shutdown_connections 2024-05-08T10:55:33.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:33.990+0000 7f8117990640 1 --2- 172.21.15.33:0/45211929 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f80f406b4d0 0x7f80f406d990 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:33.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:33.990+0000 7f8117990640 1 --2- 172.21.15.33:0/45211929 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81100d0a50 0x7f81101528f0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:33.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:33.990+0000 7f8117990640 1 --2- 172.21.15.33:0/45211929 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f81100b4320 0x7f81100b79f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:33.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:33.990+0000 7f8117990640 1 --2- 172.21.15.33:0/45211929 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f81100b33b0 0x7f81100a0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:33.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:33.990+0000 7f8117990640 1 -- 172.21.15.33:0/45211929 >> 172.21.15.33:0/45211929 conn(0x7f811009ce90 msgr2=0x7f81100ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:33.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:33.991+0000 7f8117990640 1 -- 172.21.15.33:0/45211929 shutdown_connections 2024-05-08T10:55:33.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:33.991+0000 7f8117990640 1 -- 172.21.15.33:0/45211929 wait complete. 2024-05-08T10:55:34.001 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-08T10:55:34.001 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T10:55:34.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.112+0000 7f3d563e7640 1 Processor -- start 2024-05-08T10:55:34.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.112+0000 7f3d563e7640 1 -- start start 2024-05-08T10:55:34.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.113+0000 7f3d563e7640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f3d5015e1d0 0x7f3d500cf270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:34.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.113+0000 7f3d563e7640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f3d500d25e0 0x7f3d500b4170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:34.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.113+0000 7f3d563e7640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d500d48f0 con 0x7f3d500d1a90 2024-05-08T10:55:34.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.113+0000 7f3d563e7640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d500b3ce0 con 0x7f3d5015e1d0 2024-05-08T10:55:34.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.113+0000 7f3d563e7640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d500cf900 con 0x7f3d500d25e0 2024-05-08T10:55:34.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.113+0000 7f3d4ffff640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f3d5015e1d0 0x7f3d500cf270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:34.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.113+0000 7f3d47fff640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f3d500d1a90 0x7f3d500d1ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:53994/0 (socket says 172.21.15.33:53994) 2024-05-08T10:55:34.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.113+0000 7f3d47fff640 1 -- 172.21.15.33:0/1258793298 learned_addr learned my addr 172.21.15.33:0/1258793298 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-05-08T10:55:34.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.114+0000 7f3d54984640 1 --2- 172.21.15.33:0/1258793298 >> v2:172.21.15.174:3300/0 conn(0x7f3d500d25e0 0x7f3d500b4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:34.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.114+0000 7f3d4ffff640 1 -- 172.21.15.33:0/1258793298 >> v2:172.21.15.174:3300/0 conn(0x7f3d500d25e0 msgr2=0x7f3d500b4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:34.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.114+0000 7f3d4ffff640 1 --2- 172.21.15.33:0/1258793298 >> v2:172.21.15.174:3300/0 conn(0x7f3d500d25e0 0x7f3d500b4170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:34.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.114+0000 7f3d4ffff640 1 -- 172.21.15.33:0/1258793298 >> v1:172.21.15.33:6789/0 conn(0x7f3d500d1a90 legacy=0x7f3d500d1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:34.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.114+0000 7f3d4f7fe640 1 -- 172.21.15.33:0/1258793298 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2577161727 0 0) 0x7f3d500d48f0 con 0x7f3d500d1a90 2024-05-08T10:55:34.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.114+0000 7f3d4ffff640 1 -- 172.21.15.33:0/1258793298 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d500b3690 con 0x7f3d5015e1d0 2024-05-08T10:55:34.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.114+0000 7f3d4ffff640 1 --2- 172.21.15.33:0/1258793298 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3d5015e1d0 0x7f3d500cf270 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f3d5008d030 tx=0x7f3d4002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72713bea86660eeb server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:34.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.115+0000 7f3d4f7fe640 1 -- 172.21.15.33:0/1258793298 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d40037070 con 0x7f3d5015e1d0 2024-05-08T10:55:34.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.115+0000 7f3d4f7fe640 1 -- 172.21.15.33:0/1258793298 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d40032440 con 0x7f3d5015e1d0 2024-05-08T10:55:34.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.115+0000 7f3d4f7fe640 1 -- 172.21.15.33:0/1258793298 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d40032810 con 0x7f3d5015e1d0 2024-05-08T10:55:34.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.115+0000 7f3d563e7640 1 -- 172.21.15.33:0/1258793298 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3d5015e1d0 msgr2=0x7f3d500cf270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:34.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.115+0000 7f3d563e7640 1 --2- 172.21.15.33:0/1258793298 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3d5015e1d0 0x7f3d500cf270 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f3d5008d030 tx=0x7f3d4002a1a0 comp rx=0 tx=0).stop 2024-05-08T10:55:34.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.115+0000 7f3d563e7640 1 -- 172.21.15.33:0/1258793298 shutdown_connections 2024-05-08T10:55:34.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.115+0000 7f3d563e7640 1 --2- 172.21.15.33:0/1258793298 >> v2:172.21.15.174:3300/0 conn(0x7f3d500d25e0 0x7f3d500b4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:34.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.115+0000 7f3d563e7640 1 --2- 172.21.15.33:0/1258793298 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3d5015e1d0 0x7f3d500cf270 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:34.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.115+0000 7f3d563e7640 1 -- 172.21.15.33:0/1258793298 >> 172.21.15.33:0/1258793298 conn(0x7f3d500d3b90 msgr2=0x7f3d500d3fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:34.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.115+0000 7f3d563e7640 1 -- 172.21.15.33:0/1258793298 shutdown_connections 2024-05-08T10:55:34.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.115+0000 7f3d563e7640 1 -- 172.21.15.33:0/1258793298 wait complete. 2024-05-08T10:55:34.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.117+0000 7f3d563e7640 1 Processor -- start 2024-05-08T10:55:34.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.117+0000 7f3d563e7640 1 -- start start 2024-05-08T10:55:34.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.117+0000 7f3d563e7640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3d500d1a90 0x7f3d501f4460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:34.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.117+0000 7f3d563e7640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3d500d25e0 0x7f3d500cac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:34.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.117+0000 7f3d563e7640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3d5015e1d0 0x7f3d501f3240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:34.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.117+0000 7f3d563e7640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5015e730 con 0x7f3d500d25e0 2024-05-08T10:55:34.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.117+0000 7f3d563e7640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5015e5b0 con 0x7f3d5015e1d0 2024-05-08T10:55:34.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.117+0000 7f3d563e7640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d500b46b0 con 0x7f3d500d1a90 2024-05-08T10:55:34.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.117+0000 7f3d47fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3d500d25e0 0x7f3d500cac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:34.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.117+0000 7f3d47fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3d500d25e0 0x7f3d500cac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33910/0 (socket says 172.21.15.33:33910) 2024-05-08T10:55:34.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.117+0000 7f3d47fff640 1 -- 172.21.15.33:0/1528558627 learned_addr learned my addr 172.21.15.33:0/1528558627 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:34.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.118+0000 7f3d54984640 1 --2- 172.21.15.33:0/1528558627 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3d5015e1d0 0x7f3d501f3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:34.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.118+0000 7f3d4ffff640 1 --2- 172.21.15.33:0/1528558627 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3d500d1a90 0x7f3d501f4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:34.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.118+0000 7f3d47fff640 1 -- 172.21.15.33:0/1528558627 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3d500d1a90 msgr2=0x7f3d501f4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:34.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.118+0000 7f3d47fff640 1 --2- 172.21.15.33:0/1528558627 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3d500d1a90 0x7f3d501f4460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:34.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.118+0000 7f3d47fff640 1 -- 172.21.15.33:0/1528558627 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3d5015e1d0 msgr2=0x7f3d501f3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:34.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.118+0000 7f3d47fff640 1 --2- 172.21.15.33:0/1528558627 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3d5015e1d0 0x7f3d501f3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:34.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.118+0000 7f3d47fff640 1 -- 172.21.15.33:0/1528558627 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d5006c410 con 0x7f3d500d25e0 2024-05-08T10:55:34.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.118+0000 7f3d47fff640 1 --2- 172.21.15.33:0/1528558627 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3d500d25e0 0x7f3d500cac60 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f3d3800c500 tx=0x7f3d3800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:34.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.118+0000 7f3d4d7fa640 1 -- 172.21.15.33:0/1528558627 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d38018070 con 0x7f3d500d25e0 2024-05-08T10:55:34.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.118+0000 7f3d4d7fa640 1 -- 172.21.15.33:0/1528558627 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d38007580 con 0x7f3d500d25e0 2024-05-08T10:55:34.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.118+0000 7f3d563e7640 1 -- 172.21.15.33:0/1528558627 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d5006c6f0 con 0x7f3d500d25e0 2024-05-08T10:55:34.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.118+0000 7f3d4d7fa640 1 -- 172.21.15.33:0/1528558627 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d38004a20 con 0x7f3d500d25e0 2024-05-08T10:55:34.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.118+0000 7f3d563e7640 1 -- 172.21.15.33:0/1528558627 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d500b85c0 con 0x7f3d500d25e0 2024-05-08T10:55:34.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.119+0000 7f3d563e7640 1 -- 172.21.15.33:0/1528558627 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d50069d20 con 0x7f3d500d25e0 2024-05-08T10:55:34.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.120+0000 7f3d4d7fa640 1 -- 172.21.15.33:0/1528558627 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3d3801b070 con 0x7f3d500d25e0 2024-05-08T10:55:34.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.120+0000 7f3d4d7fa640 1 --2- 172.21.15.33:0/1528558627 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f3d3006b4d0 0x7f3d3006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:34.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.120+0000 7f3d4d7fa640 1 -- 172.21.15.33:0/1528558627 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3d38089440 con 0x7f3d500d25e0 2024-05-08T10:55:34.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.120+0000 7f3d4ffff640 1 --2- 172.21.15.33:0/1528558627 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f3d3006b4d0 0x7f3d3006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:34.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.121+0000 7f3d4ffff640 1 --2- 172.21.15.33:0/1528558627 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f3d3006b4d0 0x7f3d3006d990 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3d40034000 tx=0x7f3d4002e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:34.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.124+0000 7f3d4d7fa640 1 -- 172.21.15.33:0/1528558627 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3d38057d00 con 0x7f3d500d25e0 2024-05-08T10:55:34.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.340+0000 7f3d563e7640 1 -- 172.21.15.33:0/1528558627 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3d500b8790 con 0x7f3d500d25e0 2024-05-08T10:55:34.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.341+0000 7f3d4d7fa640 1 -- 172.21.15.33:0/1528558627 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4941 (secure 0 0 0) 0x7f3d3805bda0 con 0x7f3d500d25e0 2024-05-08T10:55:34.338 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:55:34.338 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4592,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6836/2731663891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2731663891},{"type":"v1","addr":"172.21.15.174:6836","nonce":2731663891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":4598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/2004985147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6833","nonce":2004985147},{"type":"v1","addr":"172.21.15.33:6835","nonce":2004985147}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4702,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6837/3164144740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6835","nonce":3164144740},{"type":"v1","addr":"172.21.15.174:6837","nonce":3164144740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T10:55:31.311811+0000","modified":"2024-05-08T10:55:33.333600+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4708},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4708":{"gid":4708,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.33:6834/415400390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":415400390},{"type":"v1","addr":"172.21.15.33:6834","nonce":415400390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-05-08T10:55:34.338 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 14 2024-05-08T10:55:34.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.342+0000 7f3d563e7640 1 -- 172.21.15.33:0/1528558627 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f3d3006b4d0 msgr2=0x7f3d3006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:34.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.342+0000 7f3d563e7640 1 --2- 172.21.15.33:0/1528558627 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f3d3006b4d0 0x7f3d3006d990 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3d40034000 tx=0x7f3d4002e000 comp rx=0 tx=0).stop 2024-05-08T10:55:34.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.342+0000 7f3d563e7640 1 -- 172.21.15.33:0/1528558627 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3d500d25e0 msgr2=0x7f3d500cac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:34.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.342+0000 7f3d563e7640 1 --2- 172.21.15.33:0/1528558627 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3d500d25e0 0x7f3d500cac60 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f3d3800c500 tx=0x7f3d3800c9c0 comp rx=0 tx=0).stop 2024-05-08T10:55:34.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.343+0000 7f3d563e7640 1 -- 172.21.15.33:0/1528558627 shutdown_connections 2024-05-08T10:55:34.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.343+0000 7f3d563e7640 1 --2- 172.21.15.33:0/1528558627 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f3d3006b4d0 0x7f3d3006d990 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:34.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.343+0000 7f3d563e7640 1 --2- 172.21.15.33:0/1528558627 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3d5015e1d0 0x7f3d501f3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:34.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.343+0000 7f3d563e7640 1 --2- 172.21.15.33:0/1528558627 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3d500d25e0 0x7f3d500cac60 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:34.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.343+0000 7f3d563e7640 1 --2- 172.21.15.33:0/1528558627 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3d500d1a90 0x7f3d501f4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:34.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.343+0000 7f3d563e7640 1 -- 172.21.15.33:0/1528558627 >> 172.21.15.33:0/1528558627 conn(0x7f3d500d3b90 msgr2=0x7f3d500d3f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:34.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.343+0000 7f3d563e7640 1 -- 172.21.15.33:0/1528558627 shutdown_connections 2024-05-08T10:55:34.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.343+0000 7f3d563e7640 1 -- 172.21.15.33:0/1528558627 wait complete. 2024-05-08T10:55:34.351 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T10:55:34.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.456+0000 7f9d8361b640 1 Processor -- start 2024-05-08T10:55:34.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.457+0000 7f9d8361b640 1 -- start start 2024-05-08T10:55:34.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.457+0000 7f9d8361b640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9d7c0cc290 0x7f9d7c15b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:34.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.457+0000 7f9d8361b640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f9d7c06d7d0 0x7f9d7c06dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:34.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.457+0000 7f9d8361b640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d7c0cfb60 con 0x7f9d7c15e520 2024-05-08T10:55:34.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.457+0000 7f9d8361b640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d7c06e170 con 0x7f9d7c06d7d0 2024-05-08T10:55:34.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.458+0000 7f9d8361b640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7c15bec0 con 0x7f9d7c0cc290 2024-05-08T10:55:34.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.458+0000 7f9d80bb6640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f9d7c06d7d0 0x7f9d7c06dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:34.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.458+0000 7f9d81bb8640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f9d7c15e520 0x7f9d7c15e9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:54004/0 (socket says 172.21.15.33:54004) 2024-05-08T10:55:34.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.458+0000 7f9d81bb8640 1 -- 172.21.15.33:0/52780207 learned_addr learned my addr 172.21.15.33:0/52780207 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-05-08T10:55:34.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.458+0000 7f9d80bb6640 1 -- 172.21.15.33:0/52780207 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9d7c0cc290 msgr2=0x7f9d7c15b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:34.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.458+0000 7f9d813b7640 1 --2- 172.21.15.33:0/52780207 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9d7c0cc290 0x7f9d7c15b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:34.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.458+0000 7f9d73fff640 1 -- 172.21.15.33:0/52780207 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4096404066 0 0) 0x7f9d7c0cfb60 con 0x7f9d7c15e520 2024-05-08T10:55:34.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.458+0000 7f9d80bb6640 1 --2- 172.21.15.33:0/52780207 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9d7c0cc290 0x7f9d7c15b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:34.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.458+0000 7f9d80bb6640 1 -- 172.21.15.33:0/52780207 >> v1:172.21.15.33:6789/0 conn(0x7f9d7c15e520 legacy=0x7f9d7c15e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:34.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.458+0000 7f9d80bb6640 1 -- 172.21.15.33:0/52780207 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d7c0cfe40 con 0x7f9d7c06d7d0 2024-05-08T10:55:34.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.459+0000 7f9d80bb6640 1 --2- 172.21.15.33:0/52780207 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d7c06d7d0 0x7f9d7c06dc30 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9d6c0097a0 tx=0x7f9d6c02a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=310e4c127f102a77 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:34.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.459+0000 7f9d73fff640 1 -- 172.21.15.33:0/52780207 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d6c037070 con 0x7f9d7c06d7d0 2024-05-08T10:55:34.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.459+0000 7f9d73fff640 1 -- 172.21.15.33:0/52780207 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d6c02ae50 con 0x7f9d7c06d7d0 2024-05-08T10:55:34.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.459+0000 7f9d73fff640 1 -- 172.21.15.33:0/52780207 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d6c032660 con 0x7f9d7c06d7d0 2024-05-08T10:55:34.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.459+0000 7f9d8361b640 1 -- 172.21.15.33:0/52780207 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d7c06d7d0 msgr2=0x7f9d7c06dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:34.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.459+0000 7f9d8361b640 1 --2- 172.21.15.33:0/52780207 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d7c06d7d0 0x7f9d7c06dc30 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9d6c0097a0 tx=0x7f9d6c02a100 comp rx=0 tx=0).stop 2024-05-08T10:55:34.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.459+0000 7f9d8361b640 1 -- 172.21.15.33:0/52780207 shutdown_connections 2024-05-08T10:55:34.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.459+0000 7f9d8361b640 1 --2- 172.21.15.33:0/52780207 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d7c06d7d0 0x7f9d7c06dc30 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:34.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.459+0000 7f9d8361b640 1 --2- 172.21.15.33:0/52780207 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9d7c0cc290 0x7f9d7c15b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:34.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.459+0000 7f9d8361b640 1 -- 172.21.15.33:0/52780207 >> 172.21.15.33:0/52780207 conn(0x7f9d7c06aba0 msgr2=0x7f9d7c06afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:34.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.460+0000 7f9d8361b640 1 -- 172.21.15.33:0/52780207 shutdown_connections 2024-05-08T10:55:34.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.460+0000 7f9d8361b640 1 -- 172.21.15.33:0/52780207 wait complete. 2024-05-08T10:55:34.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.461+0000 7f9d8361b640 1 Processor -- start 2024-05-08T10:55:34.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.461+0000 7f9d8361b640 1 -- start start 2024-05-08T10:55:34.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.461+0000 7f9d8361b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d7c06d7d0 0x7f9d7c152bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:34.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.461+0000 7f9d8361b640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9d7c0cc290 0x7f9d7c142380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:34.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.462+0000 7f9d8361b640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9d7c15e520 0x7f9d7c1555f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:34.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.462+0000 7f9d8361b640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7c0d0400 con 0x7f9d7c06d7d0 2024-05-08T10:55:34.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.462+0000 7f9d8361b640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7c0d0770 con 0x7f9d7c0cc290 2024-05-08T10:55:34.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.462+0000 7f9d8361b640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7c0b36b0 con 0x7f9d7c15e520 2024-05-08T10:55:34.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.462+0000 7f9d813b7640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d7c06d7d0 0x7f9d7c152bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:34.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.462+0000 7f9d813b7640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d7c06d7d0 0x7f9d7c152bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33928/0 (socket says 172.21.15.33:33928) 2024-05-08T10:55:34.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.462+0000 7f9d813b7640 1 -- 172.21.15.33:0/1202913463 learned_addr learned my addr 172.21.15.33:0/1202913463 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:34.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.462+0000 7f9d81bb8640 1 --2- 172.21.15.33:0/1202913463 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9d7c15e520 0x7f9d7c1555f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:34.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.462+0000 7f9d80bb6640 1 --2- 172.21.15.33:0/1202913463 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9d7c0cc290 0x7f9d7c142380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:34.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.462+0000 7f9d813b7640 1 -- 172.21.15.33:0/1202913463 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9d7c15e520 msgr2=0x7f9d7c1555f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:34.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.462+0000 7f9d813b7640 1 --2- 172.21.15.33:0/1202913463 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9d7c15e520 0x7f9d7c1555f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:34.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.462+0000 7f9d813b7640 1 -- 172.21.15.33:0/1202913463 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9d7c0cc290 msgr2=0x7f9d7c142380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:34.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.462+0000 7f9d813b7640 1 --2- 172.21.15.33:0/1202913463 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9d7c0cc290 0x7f9d7c142380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:34.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.462+0000 7f9d813b7640 1 -- 172.21.15.33:0/1202913463 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d7c1532f0 con 0x7f9d7c06d7d0 2024-05-08T10:55:34.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.462+0000 7f9d813b7640 1 --2- 172.21.15.33:0/1202913463 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d7c06d7d0 0x7f9d7c152bc0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f9d7800c7f0 tx=0x7f9d7800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:34.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.462+0000 7f9d71ffb640 1 -- 172.21.15.33:0/1202913463 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d78015070 con 0x7f9d7c06d7d0 2024-05-08T10:55:34.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.462+0000 7f9d71ffb640 1 -- 172.21.15.33:0/1202913463 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d78004240 con 0x7f9d7c06d7d0 2024-05-08T10:55:34.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.462+0000 7f9d71ffb640 1 -- 172.21.15.33:0/1202913463 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d78007620 con 0x7f9d7c06d7d0 2024-05-08T10:55:34.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.462+0000 7f9d8361b640 1 -- 172.21.15.33:0/1202913463 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d7c1535d0 con 0x7f9d7c06d7d0 2024-05-08T10:55:34.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.463+0000 7f9d8361b640 1 -- 172.21.15.33:0/1202913463 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d7c153b90 con 0x7f9d7c06d7d0 2024-05-08T10:55:34.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.464+0000 7f9d8361b640 1 -- 172.21.15.33:0/1202913463 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d7c069d20 con 0x7f9d7c06d7d0 2024-05-08T10:55:34.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.464+0000 7f9d71ffb640 1 -- 172.21.15.33:0/1202913463 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9d780079d0 con 0x7f9d7c06d7d0 2024-05-08T10:55:34.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.465+0000 7f9d71ffb640 1 --2- 172.21.15.33:0/1202913463 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f9d6006b4d0 0x7f9d6006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:34.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.465+0000 7f9d71ffb640 1 -- 172.21.15.33:0/1202913463 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9d7808a2f0 con 0x7f9d7c06d7d0 2024-05-08T10:55:34.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.465+0000 7f9d80bb6640 1 --2- 172.21.15.33:0/1202913463 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f9d6006b4d0 0x7f9d6006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:34.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.465+0000 7f9d80bb6640 1 --2- 172.21.15.33:0/1202913463 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f9d6006b4d0 0x7f9d6006d990 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f9d6c034000 tx=0x7f9d6c02e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:34.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.469+0000 7f9d71ffb640 1 -- 172.21.15.33:0/1202913463 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9d78058a80 con 0x7f9d7c06d7d0 2024-05-08T10:55:34.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.653+0000 7f9d8361b640 1 -- 172.21.15.33:0/1202913463 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9d7c0707a0 con 0x7f9d7c06d7d0 2024-05-08T10:55:34.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.654+0000 7f9d71ffb640 1 -- 172.21.15.33:0/1202913463 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+16681 (secure 0 0 0) 0x7f9d7805cb20 con 0x7f9d7c06d7d0 2024-05-08T10:55:34.673 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:55:34.673 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":31,"fsid":"963217b2-c375-4f5a-95cf-88e199dd38ff","created":"2024-05-08T10:54:26.711528+0000","modified":"2024-05-08T10:55:32.960990+0000","last_up_change":"2024-05-08T10:54:37.987478+0000","last_in_change":"2024-05-08T10:54:28.834106+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T10:54:38.989228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-05-08T10:55:29.133374+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-05-08T10:55:30.307270+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c5da4fb5-d4f2-4982-a804-2aa92fe77731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3990629207},{"type":"v1","addr":"172.21.15.33:6817","nonce":3990629207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3990629207},{"type":"v1","addr":"172.21.15.33:6819","nonce":3990629207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3990629207},{"type":"v1","addr":"172.21.15.33:6823","nonce":3990629207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3990629207},{"type":"v1","addr":"172.21.15.33:6821","nonce":3990629207}]},"public_addr":"172.21.15.33:6817/3990629207","cluster_addr":"172.21.15.33:6819/3990629207","heartbeat_back_addr":"172.21.15.33:6823/3990629207","heartbeat_front_addr":"172.21.15.33:6821/3990629207","state":["exists","up"]},{"osd":1,"uuid":"f8fdd8db-c2a3-4d28-81f3-b30f44bea7c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":1758076090},{"type":"v1","addr":"172.21.15.33:6825","nonce":1758076090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":1758076090},{"type":"v1","addr":"172.21.15.33:6827","nonce":1758076090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":1758076090},{"type":"v1","addr":"172.21.15.33:6831","nonce":1758076090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":1758076090},{"type":"v1","addr":"172.21.15.33:6829","nonce":1758076090}]},"public_addr":"172.21.15.33:6825/1758076090","cluster_addr":"172.21.15.33:6827/1758076090","heartbeat_back_addr":"172.21.15.33:6831/1758076090","heartbeat_front_addr":"172.21.15.33:6829/1758076090","state":["exists","up"]},{"osd":2,"uuid":"87d465f3-b40f-48dd-bae2-4c67904d4828","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":2940853479},{"type":"v1","addr":"172.21.15.33:6801","nonce":2940853479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6803","nonce":2940853479},{"type":"v1","addr":"172.21.15.33:6805","nonce":2940853479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6811","nonce":2940853479},{"type":"v1","addr":"172.21.15.33:6813","nonce":2940853479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6807","nonce":2940853479},{"type":"v1","addr":"172.21.15.33:6809","nonce":2940853479}]},"public_addr":"172.21.15.33:6801/2940853479","cluster_addr":"172.21.15.33:6805/2940853479","heartbeat_back_addr":"172.21.15.33:6813/2940853479","heartbeat_front_addr":"172.21.15.33:6809/2940853479","state":["exists","up"]},{"osd":3,"uuid":"79450edf-9637-4181-9372-e1cd5e91e73e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":4029047077},{"type":"v1","addr":"172.21.15.33:6804","nonce":4029047077}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":4029047077},{"type":"v1","addr":"172.21.15.33:6808","nonce":4029047077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":4029047077},{"type":"v1","addr":"172.21.15.33:6815","nonce":4029047077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":4029047077},{"type":"v1","addr":"172.21.15.33:6812","nonce":4029047077}]},"public_addr":"172.21.15.33:6804/4029047077","cluster_addr":"172.21.15.33:6808/4029047077","heartbeat_back_addr":"172.21.15.33:6815/4029047077","heartbeat_front_addr":"172.21.15.33:6812/4029047077","state":["exists","up"]},{"osd":4,"uuid":"bd0debfa-e559-4b1e-920d-6b2639c7085e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":1697399220},{"type":"v1","addr":"172.21.15.174:6801","nonce":1697399220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":1697399220},{"type":"v1","addr":"172.21.15.174:6803","nonce":1697399220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":1697399220},{"type":"v1","addr":"172.21.15.174:6807","nonce":1697399220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":1697399220},{"type":"v1","addr":"172.21.15.174:6805","nonce":1697399220}]},"public_addr":"172.21.15.174:6801/1697399220","cluster_addr":"172.21.15.174:6803/1697399220","heartbeat_back_addr":"172.21.15.174:6807/1697399220","heartbeat_front_addr":"172.21.15.174:6805/1697399220","state":["exists","up"]},{"osd":5,"uuid":"ff0f51c0-672b-448f-9de1-b9305ce8c00d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":1511860729},{"type":"v1","addr":"172.21.15.174:6825","nonce":1511860729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":1511860729},{"type":"v1","addr":"172.21.15.174:6827","nonce":1511860729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":1511860729},{"type":"v1","addr":"172.21.15.174:6831","nonce":1511860729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":1511860729},{"type":"v1","addr":"172.21.15.174:6829","nonce":1511860729}]},"public_addr":"172.21.15.174:6825/1511860729","cluster_addr":"172.21.15.174:6827/1511860729","heartbeat_back_addr":"172.21.15.174:6831/1511860729","heartbeat_front_addr":"172.21.15.174:6829/1511860729","state":["exists","up"]},{"osd":6,"uuid":"93061f6c-c0ce-47e9-88a0-1151c5ccb4e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":2326407945},{"type":"v1","addr":"172.21.15.174:6817","nonce":2326407945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":2326407945},{"type":"v1","addr":"172.21.15.174:6819","nonce":2326407945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":2326407945},{"type":"v1","addr":"172.21.15.174:6823","nonce":2326407945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":2326407945},{"type":"v1","addr":"172.21.15.174:6821","nonce":2326407945}]},"public_addr":"172.21.15.174:6817/2326407945","cluster_addr":"172.21.15.174:6819/2326407945","heartbeat_back_addr":"172.21.15.174:6823/2326407945","heartbeat_front_addr":"172.21.15.174:6821/2326407945","state":["exists","up"]},{"osd":7,"uuid":"7be1dcf3-1957-4ec3-bacf-f5f9fff580a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":1637570253},{"type":"v1","addr":"172.21.15.174:6809","nonce":1637570253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":1637570253},{"type":"v1","addr":"172.21.15.174:6811","nonce":1637570253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":1637570253},{"type":"v1","addr":"172.21.15.174:6815","nonce":1637570253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":1637570253},{"type":"v1","addr":"172.21.15.174:6813","nonce":1637570253}]},"public_addr":"172.21.15.174:6809/1637570253","cluster_addr":"172.21.15.174:6811/1637570253","heartbeat_back_addr":"172.21.15.174:6815/1637570253","heartbeat_front_addr":"172.21.15.174:6813/1637570253","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:33.997709+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:34.016568+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:33.990484+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:33.980666+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:33.920609+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:34.005069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:34.018345+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:34.061646+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T10:55:34.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.656+0000 7f9d8361b640 1 -- 172.21.15.33:0/1202913463 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f9d6006b4d0 msgr2=0x7f9d6006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:34.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.656+0000 7f9d8361b640 1 --2- 172.21.15.33:0/1202913463 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f9d6006b4d0 0x7f9d6006d990 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f9d6c034000 tx=0x7f9d6c02e000 comp rx=0 tx=0).stop 2024-05-08T10:55:34.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.656+0000 7f9d8361b640 1 -- 172.21.15.33:0/1202913463 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d7c06d7d0 msgr2=0x7f9d7c152bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:34.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.656+0000 7f9d8361b640 1 --2- 172.21.15.33:0/1202913463 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d7c06d7d0 0x7f9d7c152bc0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f9d7800c7f0 tx=0x7f9d7800ccb0 comp rx=0 tx=0).stop 2024-05-08T10:55:34.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.657+0000 7f9d8361b640 1 -- 172.21.15.33:0/1202913463 shutdown_connections 2024-05-08T10:55:34.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.657+0000 7f9d8361b640 1 --2- 172.21.15.33:0/1202913463 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f9d6006b4d0 0x7f9d6006d990 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:34.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.657+0000 7f9d8361b640 1 --2- 172.21.15.33:0/1202913463 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9d7c15e520 0x7f9d7c1555f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:34.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.657+0000 7f9d8361b640 1 --2- 172.21.15.33:0/1202913463 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9d7c0cc290 0x7f9d7c142380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:34.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.657+0000 7f9d8361b640 1 --2- 172.21.15.33:0/1202913463 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d7c06d7d0 0x7f9d7c152bc0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:34.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.657+0000 7f9d8361b640 1 -- 172.21.15.33:0/1202913463 >> 172.21.15.33:0/1202913463 conn(0x7f9d7c06aba0 msgr2=0x7f9d7c06af80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:34.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.657+0000 7f9d8361b640 1 -- 172.21.15.33:0/1202913463 shutdown_connections 2024-05-08T10:55:34.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.657+0000 7f9d8361b640 1 -- 172.21.15.33:0/1202913463 wait complete. 2024-05-08T10:55:34.676 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-08T10:55:34.676 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T10:55:34.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.782+0000 7f9d141cf640 1 Processor -- start 2024-05-08T10:55:34.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.782+0000 7f9d141cf640 1 -- start start 2024-05-08T10:55:34.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.783+0000 7f9d141cf640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9d0c06ee30 0x7f9d0c0d0b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:34.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.783+0000 7f9d141cf640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9d0c162410 0x7f9d0c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:34.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.783+0000 7f9d141cf640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d0c162980 con 0x7f9d0c06f210 2024-05-08T10:55:34.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.783+0000 7f9d141cf640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d0c0b1250 con 0x7f9d0c162410 2024-05-08T10:55:34.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.783+0000 7f9d141cf640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d0c0cfd70 con 0x7f9d0c06ee30 2024-05-08T10:55:34.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.784+0000 7f9d1176a640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9d0c162410 0x7f9d0c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:34.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.784+0000 7f9d1276c640 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f9d0c06f210 0x7f9d0c06bcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.33:59310/0 (socket says 172.21.15.33:59310) 2024-05-08T10:55:34.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.784+0000 7f9d11f6b640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9d0c06ee30 0x7f9d0c0d0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:34.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.784+0000 7f9d1276c640 1 -- 172.21.15.33:0/1163036903 learned_addr learned my addr 172.21.15.33:0/1163036903 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-05-08T10:55:34.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.784+0000 7f9d11f6b640 1 -- 172.21.15.33:0/1163036903 >> v2:172.21.15.174:3300/0 conn(0x7f9d0c162410 msgr2=0x7f9d0c06e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:34.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.784+0000 7f9d11f6b640 1 --2- 172.21.15.33:0/1163036903 >> v2:172.21.15.174:3300/0 conn(0x7f9d0c162410 0x7f9d0c06e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:34.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.784+0000 7f9d11f6b640 1 -- 172.21.15.33:0/1163036903 >> v1:172.21.15.174:6789/0 conn(0x7f9d0c06f210 legacy=0x7f9d0c06bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:34.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.784+0000 7f9d11f6b640 1 -- 172.21.15.33:0/1163036903 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d0c0d0050 con 0x7f9d0c06ee30 2024-05-08T10:55:34.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.784+0000 7f9d1176a640 1 --2- 172.21.15.33:0/1163036903 >> v2:172.21.15.174:3300/0 conn(0x7f9d0c162410 0x7f9d0c06e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T10:55:34.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.785+0000 7f9d11f6b640 1 --2- 172.21.15.33:0/1163036903 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9d0c06ee30 0x7f9d0c0d0b30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9d080097a0 tx=0x7f9d0802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bab1b385e63e436d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:34.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.785+0000 7f9d10f69640 1 -- 172.21.15.33:0/1163036903 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d08037070 con 0x7f9d0c06ee30 2024-05-08T10:55:34.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.785+0000 7f9d10f69640 1 -- 172.21.15.33:0/1163036903 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d08032440 con 0x7f9d0c06ee30 2024-05-08T10:55:34.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.785+0000 7f9d10f69640 1 -- 172.21.15.33:0/1163036903 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d08032810 con 0x7f9d0c06ee30 2024-05-08T10:55:34.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.785+0000 7f9d141cf640 1 -- 172.21.15.33:0/1163036903 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9d0c06ee30 msgr2=0x7f9d0c0d0b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:34.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.785+0000 7f9d141cf640 1 --2- 172.21.15.33:0/1163036903 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9d0c06ee30 0x7f9d0c0d0b30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9d080097a0 tx=0x7f9d0802a180 comp rx=0 tx=0).stop 2024-05-08T10:55:34.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.785+0000 7f9d141cf640 1 -- 172.21.15.33:0/1163036903 shutdown_connections 2024-05-08T10:55:34.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.785+0000 7f9d141cf640 1 --2- 172.21.15.33:0/1163036903 >> v2:172.21.15.174:3300/0 conn(0x7f9d0c162410 0x7f9d0c06e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:34.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.785+0000 7f9d141cf640 1 --2- 172.21.15.33:0/1163036903 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9d0c06ee30 0x7f9d0c0d0b30 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:34.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.785+0000 7f9d141cf640 1 -- 172.21.15.33:0/1163036903 >> 172.21.15.33:0/1163036903 conn(0x7f9d0c0d1990 msgr2=0x7f9d0c0d1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:34.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.786+0000 7f9d141cf640 1 -- 172.21.15.33:0/1163036903 shutdown_connections 2024-05-08T10:55:34.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.786+0000 7f9d141cf640 1 -- 172.21.15.33:0/1163036903 wait complete. 2024-05-08T10:55:34.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.787+0000 7f9d141cf640 1 Processor -- start 2024-05-08T10:55:34.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.787+0000 7f9d141cf640 1 -- start start 2024-05-08T10:55:34.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.788+0000 7f9d141cf640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d0c06ee30 0x7f9d0c148f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:34.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.788+0000 7f9d141cf640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9d0c06f210 0x7f9d0c0afd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:34.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.788+0000 7f9d141cf640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9d0c162410 0x7f9d0c158b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:34.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.788+0000 7f9d141cf640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d0c06f6a0 con 0x7f9d0c06ee30 2024-05-08T10:55:34.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.788+0000 7f9d141cf640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d0c0d0610 con 0x7f9d0c162410 2024-05-08T10:55:34.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.788+0000 7f9d141cf640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d0c15f220 con 0x7f9d0c06f210 2024-05-08T10:55:34.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.788+0000 7f9d11f6b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d0c06ee30 0x7f9d0c148f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:34.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.788+0000 7f9d11f6b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d0c06ee30 0x7f9d0c148f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33936/0 (socket says 172.21.15.33:33936) 2024-05-08T10:55:34.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.788+0000 7f9d11f6b640 1 -- 172.21.15.33:0/81608678 learned_addr learned my addr 172.21.15.33:0/81608678 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:34.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.788+0000 7f9d1176a640 1 --2- 172.21.15.33:0/81608678 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9d0c06f210 0x7f9d0c0afd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:34.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.788+0000 7f9d1276c640 1 --2- 172.21.15.33:0/81608678 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9d0c162410 0x7f9d0c158b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:34.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.788+0000 7f9d11f6b640 1 -- 172.21.15.33:0/81608678 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9d0c06f210 msgr2=0x7f9d0c0afd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:34.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.788+0000 7f9d11f6b640 1 --2- 172.21.15.33:0/81608678 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9d0c06f210 0x7f9d0c0afd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:34.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.788+0000 7f9d11f6b640 1 -- 172.21.15.33:0/81608678 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9d0c162410 msgr2=0x7f9d0c158b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:34.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.788+0000 7f9d11f6b640 1 --2- 172.21.15.33:0/81608678 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9d0c162410 0x7f9d0c158b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:34.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.788+0000 7f9d11f6b640 1 -- 172.21.15.33:0/81608678 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d0c1f4730 con 0x7f9d0c06ee30 2024-05-08T10:55:34.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.788+0000 7f9d11f6b640 1 --2- 172.21.15.33:0/81608678 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d0c06ee30 0x7f9d0c148f30 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f9d080098c0 tx=0x7f9d080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:34.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.788+0000 7f9d027fc640 1 -- 172.21.15.33:0/81608678 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d08041070 con 0x7f9d0c06ee30 2024-05-08T10:55:34.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.788+0000 7f9d027fc640 1 -- 172.21.15.33:0/81608678 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d0803c870 con 0x7f9d0c06ee30 2024-05-08T10:55:34.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.788+0000 7f9d141cf640 1 -- 172.21.15.33:0/81608678 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d0c1f4a10 con 0x7f9d0c06ee30 2024-05-08T10:55:34.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.788+0000 7f9d027fc640 1 -- 172.21.15.33:0/81608678 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d08037040 con 0x7f9d0c06ee30 2024-05-08T10:55:34.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.788+0000 7f9d141cf640 1 -- 172.21.15.33:0/81608678 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d0c1f4fd0 con 0x7f9d0c06ee30 2024-05-08T10:55:34.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.789+0000 7f9d141cf640 1 -- 172.21.15.33:0/81608678 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d0c069d20 con 0x7f9d0c06ee30 2024-05-08T10:55:34.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.790+0000 7f9d027fc640 1 -- 172.21.15.33:0/81608678 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9d08044070 con 0x7f9d0c06ee30 2024-05-08T10:55:34.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.790+0000 7f9d027fc640 1 --2- 172.21.15.33:0/81608678 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f9cf006b4d0 0x7f9cf006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:34.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.790+0000 7f9d027fc640 1 -- 172.21.15.33:0/81608678 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9d080aacf0 con 0x7f9d0c06ee30 2024-05-08T10:55:34.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.791+0000 7f9d1176a640 1 --2- 172.21.15.33:0/81608678 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f9cf006b4d0 0x7f9cf006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:34.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.791+0000 7f9d1176a640 1 --2- 172.21.15.33:0/81608678 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f9cf006b4d0 0x7f9cf006d990 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc009560 tx=0x7f9cfc009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:34.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.794+0000 7f9d027fc640 1 -- 172.21.15.33:0/81608678 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9d080af070 con 0x7f9d0c06ee30 2024-05-08T10:55:34.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.970+0000 7f9d141cf640 1 -- 172.21.15.33:0/81608678 --> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9d0c0b16c0 con 0x7f9cf006b4d0 2024-05-08T10:55:34.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.976+0000 7f9d027fc640 1 -- 172.21.15.33:0/81608678 <== mgr.4103 v2:172.21.15.174:6832/261355069 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251909 (secure 0 0 0) 0x7f9d0c0b16c0 con 0x7f9cf006b4d0 2024-05-08T10:55:34.974 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:55:34.980 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-05-08T10:55:34.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.979+0000 7f9d141cf640 1 -- 172.21.15.33:0/81608678 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f9cf006b4d0 msgr2=0x7f9cf006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:34.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.979+0000 7f9d141cf640 1 --2- 172.21.15.33:0/81608678 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f9cf006b4d0 0x7f9cf006d990 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc009560 tx=0x7f9cfc009190 comp rx=0 tx=0).stop 2024-05-08T10:55:34.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.979+0000 7f9d141cf640 1 -- 172.21.15.33:0/81608678 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d0c06ee30 msgr2=0x7f9d0c148f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:34.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.979+0000 7f9d141cf640 1 --2- 172.21.15.33:0/81608678 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d0c06ee30 0x7f9d0c148f30 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f9d080098c0 tx=0x7f9d080046c0 comp rx=0 tx=0).stop 2024-05-08T10:55:34.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.979+0000 7f9d141cf640 1 -- 172.21.15.33:0/81608678 shutdown_connections 2024-05-08T10:55:34.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.979+0000 7f9d141cf640 1 --2- 172.21.15.33:0/81608678 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f9cf006b4d0 0x7f9cf006d990 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:34.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.979+0000 7f9d141cf640 1 --2- 172.21.15.33:0/81608678 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9d0c162410 0x7f9d0c158b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:34.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.979+0000 7f9d141cf640 1 --2- 172.21.15.33:0/81608678 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9d0c06f210 0x7f9d0c0afd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:34.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.979+0000 7f9d141cf640 1 --2- 172.21.15.33:0/81608678 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d0c06ee30 0x7f9d0c148f30 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:34.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.979+0000 7f9d141cf640 1 -- 172.21.15.33:0/81608678 >> 172.21.15.33:0/81608678 conn(0x7f9d0c0d1990 msgr2=0x7f9d0c0b3ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:34.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.979+0000 7f9d141cf640 1 -- 172.21.15.33:0/81608678 shutdown_connections 2024-05-08T10:55:34.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:34.979+0000 7f9d141cf640 1 -- 172.21.15.33:0/81608678 wait complete. 2024-05-08T10:55:34.987 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":52,"stamp":"2024-05-08T10:55:34.954333+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":123,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220080,"kb_used_data":3884,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754640,"statfs":{"total":773094113280,"available":772868751360,"internally_reserved":0,"allocated":3977216,"data_stored":2227064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.006262"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:55:32.967544+0000","last_change":"2024-05-08T10:55:31.978914+0000","last_active":"2024-05-08T10:55:32.967544+0000","last_peered":"2024-05-08T10:55:32.967544+0000","last_clean":"2024-05-08T10:55:32.967544+0000","last_became_active":"2024-05-08T10:55:31.978665+0000","last_became_peered":"2024-05-08T10:55:31.978665+0000","last_unstale":"2024-05-08T10:55:32.967544+0000","last_undegraded":"2024-05-08T10:55:32.967544+0000","last_fullsized":"2024-05-08T10:55:32.967544+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:47:46.595701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-08T10:55:31.994363+0000","last_change":"2024-05-08T10:55:31.991465+0000","last_active":"2024-05-08T10:55:31.994363+0000","last_peered":"2024-05-08T10:55:31.994363+0000","last_clean":"2024-05-08T10:55:31.994363+0000","last_became_active":"2024-05-08T10:55:31.990866+0000","last_became_peered":"2024-05-08T10:55:31.990866+0000","last_unstale":"2024-05-08T10:55:31.994363+0000","last_undegraded":"2024-05-08T10:55:31.994363+0000","last_fullsized":"2024-05-08T10:55:31.994363+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:09:15.928496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-08T10:55:31.988236+0000","last_change":"2024-05-08T10:55:31.986842+0000","last_active":"2024-05-08T10:55:31.988236+0000","last_peered":"2024-05-08T10:55:31.988236+0000","last_clean":"2024-05-08T10:55:31.988236+0000","last_became_active":"2024-05-08T10:55:31.986573+0000","last_became_peered":"2024-05-08T10:55:31.986573+0000","last_unstale":"2024-05-08T10:55:31.988236+0000","last_undegraded":"2024-05-08T10:55:31.988236+0000","last_fullsized":"2024-05-08T10:55:31.988236+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:52:02.128364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:55:33.211574+0000","last_change":"2024-05-08T10:55:31.973747+0000","last_active":"2024-05-08T10:55:33.211574+0000","last_peered":"2024-05-08T10:55:33.211574+0000","last_clean":"2024-05-08T10:55:33.211574+0000","last_became_active":"2024-05-08T10:55:31.973421+0000","last_became_peered":"2024-05-08T10:55:31.973421+0000","last_unstale":"2024-05-08T10:55:33.211574+0000","last_undegraded":"2024-05-08T10:55:33.211574+0000","last_fullsized":"2024-05-08T10:55:33.211574+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:23:02.622942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-08T10:55:31.998152+0000","last_change":"2024-05-08T10:55:31.994158+0000","last_active":"2024-05-08T10:55:31.998152+0000","last_peered":"2024-05-08T10:55:31.998152+0000","last_clean":"2024-05-08T10:55:31.998152+0000","last_became_active":"2024-05-08T10:55:31.993877+0000","last_became_peered":"2024-05-08T10:55:31.993877+0000","last_unstale":"2024-05-08T10:55:31.998152+0000","last_undegraded":"2024-05-08T10:55:31.998152+0000","last_fullsized":"2024-05-08T10:55:31.998152+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:36:35.041302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-08T10:55:31.994272+0000","last_change":"2024-05-08T10:55:31.990305+0000","last_active":"2024-05-08T10:55:31.994272+0000","last_peered":"2024-05-08T10:55:31.994272+0000","last_clean":"2024-05-08T10:55:31.994272+0000","last_became_active":"2024-05-08T10:55:31.990018+0000","last_became_peered":"2024-05-08T10:55:31.990018+0000","last_unstale":"2024-05-08T10:55:31.994272+0000","last_undegraded":"2024-05-08T10:55:31.994272+0000","last_fullsized":"2024-05-08T10:55:31.994272+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:23:02.622942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-08T10:55:31.993980+0000","last_change":"2024-05-08T10:55:31.987682+0000","last_active":"2024-05-08T10:55:31.993980+0000","last_peered":"2024-05-08T10:55:31.993980+0000","last_clean":"2024-05-08T10:55:31.993980+0000","last_became_active":"2024-05-08T10:55:31.987394+0000","last_became_peered":"2024-05-08T10:55:31.987394+0000","last_unstale":"2024-05-08T10:55:31.993980+0000","last_undegraded":"2024-05-08T10:55:31.993980+0000","last_fullsized":"2024-05-08T10:55:31.993980+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:52:02.128364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-08T10:55:31.993800+0000","last_change":"2024-05-08T10:55:31.986776+0000","last_active":"2024-05-08T10:55:31.993800+0000","last_peered":"2024-05-08T10:55:31.993800+0000","last_clean":"2024-05-08T10:55:31.993800+0000","last_became_active":"2024-05-08T10:55:31.986548+0000","last_became_peered":"2024-05-08T10:55:31.986548+0000","last_unstale":"2024-05-08T10:55:31.993800+0000","last_undegraded":"2024-05-08T10:55:31.993800+0000","last_fullsized":"2024-05-08T10:55:31.993800+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:38:03.229028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:55:32.968521+0000","last_change":"2024-05-08T10:55:31.978010+0000","last_active":"2024-05-08T10:55:32.968521+0000","last_peered":"2024-05-08T10:55:32.968521+0000","last_clean":"2024-05-08T10:55:32.968521+0000","last_became_active":"2024-05-08T10:55:31.976950+0000","last_became_peered":"2024-05-08T10:55:31.976950+0000","last_unstale":"2024-05-08T10:55:32.968521+0000","last_undegraded":"2024-05-08T10:55:32.968521+0000","last_fullsized":"2024-05-08T10:55:32.968521+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:02:15.212512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:55:33.211890+0000","last_change":"2024-05-08T10:55:31.992971+0000","last_active":"2024-05-08T10:55:33.211890+0000","last_peered":"2024-05-08T10:55:33.211890+0000","last_clean":"2024-05-08T10:55:33.211890+0000","last_became_active":"2024-05-08T10:55:31.992675+0000","last_became_peered":"2024-05-08T10:55:31.992675+0000","last_unstale":"2024-05-08T10:55:33.211890+0000","last_undegraded":"2024-05-08T10:55:33.211890+0000","last_fullsized":"2024-05-08T10:55:33.211890+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:09:15.928496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-08T10:55:31.993838+0000","last_change":"2024-05-08T10:55:31.986091+0000","last_active":"2024-05-08T10:55:31.993838+0000","last_peered":"2024-05-08T10:55:31.993838+0000","last_clean":"2024-05-08T10:55:31.993838+0000","last_became_active":"2024-05-08T10:55:31.985747+0000","last_became_peered":"2024-05-08T10:55:31.985747+0000","last_unstale":"2024-05-08T10:55:31.993838+0000","last_undegraded":"2024-05-08T10:55:31.993838+0000","last_fullsized":"2024-05-08T10:55:31.993838+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:02:15.212512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-08T10:55:31.996821+0000","last_change":"2024-05-08T10:55:31.995472+0000","last_active":"2024-05-08T10:55:31.996821+0000","last_peered":"2024-05-08T10:55:31.996821+0000","last_clean":"2024-05-08T10:55:31.996821+0000","last_became_active":"2024-05-08T10:55:31.995235+0000","last_became_peered":"2024-05-08T10:55:31.995235+0000","last_unstale":"2024-05-08T10:55:31.996821+0000","last_undegraded":"2024-05-08T10:55:31.996821+0000","last_fullsized":"2024-05-08T10:55:31.996821+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:33:06.222369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-08T10:55:31.992508+0000","last_change":"2024-05-08T10:55:31.984841+0000","last_active":"2024-05-08T10:55:31.992508+0000","last_peered":"2024-05-08T10:55:31.992508+0000","last_clean":"2024-05-08T10:55:31.992508+0000","last_became_active":"2024-05-08T10:55:31.984570+0000","last_became_peered":"2024-05-08T10:55:31.984570+0000","last_unstale":"2024-05-08T10:55:31.992508+0000","last_undegraded":"2024-05-08T10:55:31.992508+0000","last_fullsized":"2024-05-08T10:55:31.992508+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:09:29.846612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-08T10:55:31.994292+0000","last_change":"2024-05-08T10:55:31.990910+0000","last_active":"2024-05-08T10:55:31.994292+0000","last_peered":"2024-05-08T10:55:31.994292+0000","last_clean":"2024-05-08T10:55:31.994292+0000","last_became_active":"2024-05-08T10:55:31.990592+0000","last_became_peered":"2024-05-08T10:55:31.990592+0000","last_unstale":"2024-05-08T10:55:31.994292+0000","last_undegraded":"2024-05-08T10:55:31.994292+0000","last_fullsized":"2024-05-08T10:55:31.994292+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:36:15.119109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-08T10:55:31.978573+0000","last_change":"2024-05-08T10:55:31.974182+0000","last_active":"2024-05-08T10:55:31.978573+0000","last_peered":"2024-05-08T10:55:31.978573+0000","last_clean":"2024-05-08T10:55:31.978573+0000","last_became_active":"2024-05-08T10:55:31.973915+0000","last_became_peered":"2024-05-08T10:55:31.973915+0000","last_unstale":"2024-05-08T10:55:31.978573+0000","last_undegraded":"2024-05-08T10:55:31.978573+0000","last_fullsized":"2024-05-08T10:55:31.978573+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:12:44.119078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-08T10:55:31.999729+0000","last_change":"2024-05-08T10:55:31.993836+0000","last_active":"2024-05-08T10:55:31.999729+0000","last_peered":"2024-05-08T10:55:31.999729+0000","last_clean":"2024-05-08T10:55:31.999729+0000","last_became_active":"2024-05-08T10:55:31.993530+0000","last_became_peered":"2024-05-08T10:55:31.993530+0000","last_unstale":"2024-05-08T10:55:31.999729+0000","last_undegraded":"2024-05-08T10:55:31.999729+0000","last_fullsized":"2024-05-08T10:55:31.999729+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:09:15.928496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-08T10:55:31.993959+0000","last_change":"2024-05-08T10:55:31.987635+0000","last_active":"2024-05-08T10:55:31.993959+0000","last_peered":"2024-05-08T10:55:31.993959+0000","last_clean":"2024-05-08T10:55:31.993959+0000","last_became_active":"2024-05-08T10:55:31.987334+0000","last_became_peered":"2024-05-08T10:55:31.987334+0000","last_unstale":"2024-05-08T10:55:31.993959+0000","last_undegraded":"2024-05-08T10:55:31.993959+0000","last_fullsized":"2024-05-08T10:55:31.993959+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:36:15.119109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-08T10:55:31.998172+0000","last_change":"2024-05-08T10:55:31.997100+0000","last_active":"2024-05-08T10:55:31.998172+0000","last_peered":"2024-05-08T10:55:31.998172+0000","last_clean":"2024-05-08T10:55:31.998172+0000","last_became_active":"2024-05-08T10:55:31.996808+0000","last_became_peered":"2024-05-08T10:55:31.996808+0000","last_unstale":"2024-05-08T10:55:31.998172+0000","last_undegraded":"2024-05-08T10:55:31.998172+0000","last_fullsized":"2024-05-08T10:55:31.998172+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:32:02.931086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-08T10:55:31.997751+0000","last_change":"2024-05-08T10:55:31.995549+0000","last_active":"2024-05-08T10:55:31.997751+0000","last_peered":"2024-05-08T10:55:31.997751+0000","last_clean":"2024-05-08T10:55:31.997751+0000","last_became_active":"2024-05-08T10:55:31.995287+0000","last_became_peered":"2024-05-08T10:55:31.995287+0000","last_unstale":"2024-05-08T10:55:31.997751+0000","last_undegraded":"2024-05-08T10:55:31.997751+0000","last_fullsized":"2024-05-08T10:55:31.997751+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:33:06.222369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-08T10:55:31.992484+0000","last_change":"2024-05-08T10:55:31.985442+0000","last_active":"2024-05-08T10:55:31.992484+0000","last_peered":"2024-05-08T10:55:31.992484+0000","last_clean":"2024-05-08T10:55:31.992484+0000","last_became_active":"2024-05-08T10:55:31.985036+0000","last_became_peered":"2024-05-08T10:55:31.985036+0000","last_unstale":"2024-05-08T10:55:31.992484+0000","last_undegraded":"2024-05-08T10:55:31.992484+0000","last_fullsized":"2024-05-08T10:55:31.992484+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:41:44.252830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:55:32.968439+0000","last_change":"2024-05-08T10:55:31.983340+0000","last_active":"2024-05-08T10:55:32.968439+0000","last_peered":"2024-05-08T10:55:32.968439+0000","last_clean":"2024-05-08T10:55:32.968439+0000","last_became_active":"2024-05-08T10:55:31.983053+0000","last_became_peered":"2024-05-08T10:55:31.983053+0000","last_unstale":"2024-05-08T10:55:32.968439+0000","last_undegraded":"2024-05-08T10:55:32.968439+0000","last_fullsized":"2024-05-08T10:55:32.968439+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:12:44.119078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:55:32.968231+0000","last_change":"2024-05-08T10:55:31.992929+0000","last_active":"2024-05-08T10:55:32.968231+0000","last_peered":"2024-05-08T10:55:32.968231+0000","last_clean":"2024-05-08T10:55:32.968231+0000","last_became_active":"2024-05-08T10:55:31.992684+0000","last_became_peered":"2024-05-08T10:55:31.992684+0000","last_unstale":"2024-05-08T10:55:32.968231+0000","last_undegraded":"2024-05-08T10:55:32.968231+0000","last_fullsized":"2024-05-08T10:55:32.968231+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:47:46.595701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:55:32.963937+0000","last_change":"2024-05-08T10:55:31.983176+0000","last_active":"2024-05-08T10:55:32.963937+0000","last_peered":"2024-05-08T10:55:32.963937+0000","last_clean":"2024-05-08T10:55:32.963937+0000","last_became_active":"2024-05-08T10:55:31.982873+0000","last_became_peered":"2024-05-08T10:55:31.982873+0000","last_unstale":"2024-05-08T10:55:32.963937+0000","last_undegraded":"2024-05-08T10:55:32.963937+0000","last_fullsized":"2024-05-08T10:55:32.963937+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:42:55.846441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-08T10:55:31.983631+0000","last_change":"2024-05-08T10:55:31.979644+0000","last_active":"2024-05-08T10:55:31.983631+0000","last_peered":"2024-05-08T10:55:31.983631+0000","last_clean":"2024-05-08T10:55:31.983631+0000","last_became_active":"2024-05-08T10:55:31.979353+0000","last_became_peered":"2024-05-08T10:55:31.979353+0000","last_unstale":"2024-05-08T10:55:31.983631+0000","last_undegraded":"2024-05-08T10:55:31.983631+0000","last_fullsized":"2024-05-08T10:55:31.983631+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:02:15.212512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:55:33.212014+0000","last_change":"2024-05-08T10:55:31.977475+0000","last_active":"2024-05-08T10:55:33.212014+0000","last_peered":"2024-05-08T10:55:33.212014+0000","last_clean":"2024-05-08T10:55:33.212014+0000","last_became_active":"2024-05-08T10:55:31.977200+0000","last_became_peered":"2024-05-08T10:55:31.977200+0000","last_unstale":"2024-05-08T10:55:33.212014+0000","last_undegraded":"2024-05-08T10:55:33.212014+0000","last_fullsized":"2024-05-08T10:55:33.212014+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:50:58.157369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-08T10:55:31.994343+0000","last_change":"2024-05-08T10:55:31.991225+0000","last_active":"2024-05-08T10:55:31.994343+0000","last_peered":"2024-05-08T10:55:31.994343+0000","last_clean":"2024-05-08T10:55:31.994343+0000","last_became_active":"2024-05-08T10:55:31.990558+0000","last_became_peered":"2024-05-08T10:55:31.990558+0000","last_unstale":"2024-05-08T10:55:31.994343+0000","last_undegraded":"2024-05-08T10:55:31.994343+0000","last_fullsized":"2024-05-08T10:55:31.994343+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:52:02.128364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:55:33.211926+0000","last_change":"2024-05-08T10:55:31.978283+0000","last_active":"2024-05-08T10:55:33.211926+0000","last_peered":"2024-05-08T10:55:33.211926+0000","last_clean":"2024-05-08T10:55:33.211926+0000","last_became_active":"2024-05-08T10:55:31.977884+0000","last_became_peered":"2024-05-08T10:55:31.977884+0000","last_unstale":"2024-05-08T10:55:33.211926+0000","last_undegraded":"2024-05-08T10:55:33.211926+0000","last_fullsized":"2024-05-08T10:55:33.211926+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:33:06.222369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-08T10:55:31.983569+0000","last_change":"2024-05-08T10:55:31.980186+0000","last_active":"2024-05-08T10:55:31.983569+0000","last_peered":"2024-05-08T10:55:31.983569+0000","last_clean":"2024-05-08T10:55:31.983569+0000","last_became_active":"2024-05-08T10:55:31.979866+0000","last_became_peered":"2024-05-08T10:55:31.979866+0000","last_unstale":"2024-05-08T10:55:31.983569+0000","last_undegraded":"2024-05-08T10:55:31.983569+0000","last_fullsized":"2024-05-08T10:55:31.983569+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:38:03.229028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:55:32.968505+0000","last_change":"2024-05-08T10:55:31.984060+0000","last_active":"2024-05-08T10:55:32.968505+0000","last_peered":"2024-05-08T10:55:32.968505+0000","last_clean":"2024-05-08T10:55:32.968505+0000","last_became_active":"2024-05-08T10:55:31.983777+0000","last_became_peered":"2024-05-08T10:55:31.983777+0000","last_unstale":"2024-05-08T10:55:32.968505+0000","last_undegraded":"2024-05-08T10:55:32.968505+0000","last_fullsized":"2024-05-08T10:55:32.968505+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:27:14.269593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-08T10:55:31.982950+0000","last_change":"2024-05-08T10:55:31.980152+0000","last_active":"2024-05-08T10:55:31.982950+0000","last_peered":"2024-05-08T10:55:31.982950+0000","last_clean":"2024-05-08T10:55:31.982950+0000","last_became_active":"2024-05-08T10:55:31.979907+0000","last_became_peered":"2024-05-08T10:55:31.979907+0000","last_unstale":"2024-05-08T10:55:31.982950+0000","last_undegraded":"2024-05-08T10:55:31.982950+0000","last_fullsized":"2024-05-08T10:55:31.982950+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:41:08.704848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:55:32.967530+0000","last_change":"2024-05-08T10:55:31.978733+0000","last_active":"2024-05-08T10:55:32.967530+0000","last_peered":"2024-05-08T10:55:32.967530+0000","last_clean":"2024-05-08T10:55:32.967530+0000","last_became_active":"2024-05-08T10:55:31.978436+0000","last_became_peered":"2024-05-08T10:55:31.978436+0000","last_unstale":"2024-05-08T10:55:32.967530+0000","last_undegraded":"2024-05-08T10:55:32.967530+0000","last_fullsized":"2024-05-08T10:55:32.967530+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:41:08.704848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-08T10:55:31.988052+0000","last_change":"2024-05-08T10:55:31.982578+0000","last_active":"2024-05-08T10:55:31.988052+0000","last_peered":"2024-05-08T10:55:31.988052+0000","last_clean":"2024-05-08T10:55:31.988052+0000","last_became_active":"2024-05-08T10:55:31.982281+0000","last_became_peered":"2024-05-08T10:55:31.982281+0000","last_unstale":"2024-05-08T10:55:31.988052+0000","last_undegraded":"2024-05-08T10:55:31.988052+0000","last_fullsized":"2024-05-08T10:55:31.988052+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:12:44.119078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:55:32.964000+0000","last_change":"2024-05-08T10:55:31.978960+0000","last_active":"2024-05-08T10:55:32.964000+0000","last_peered":"2024-05-08T10:55:32.964000+0000","last_clean":"2024-05-08T10:55:32.964000+0000","last_became_active":"2024-05-08T10:55:31.978709+0000","last_became_peered":"2024-05-08T10:55:31.978709+0000","last_unstale":"2024-05-08T10:55:32.964000+0000","last_undegraded":"2024-05-08T10:55:32.964000+0000","last_fullsized":"2024-05-08T10:55:32.964000+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:27:14.269593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"30'4","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:55:32.967638+0000","last_change":"2024-05-08T10:55:30.972242+0000","last_active":"2024-05-08T10:55:32.967638+0000","last_peered":"2024-05-08T10:55:32.967638+0000","last_clean":"2024-05-08T10:55:32.967638+0000","last_became_active":"2024-05-08T10:55:30.971924+0000","last_became_peered":"2024-05-08T10:55:30.971924+0000","last_unstale":"2024-05-08T10:55:32.967638+0000","last_undegraded":"2024-05-08T10:55:32.967638+0000","last_fullsized":"2024-05-08T10:55:32.967638+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_clean_scrub_stamp":"2024-05-08T10:55:29.942582+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:16:20.054239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:55:32.967666+0000","last_change":"2024-05-08T10:55:31.976597+0000","last_active":"2024-05-08T10:55:32.967666+0000","last_peered":"2024-05-08T10:55:32.967666+0000","last_clean":"2024-05-08T10:55:32.967666+0000","last_became_active":"2024-05-08T10:55:31.975889+0000","last_became_peered":"2024-05-08T10:55:31.975889+0000","last_unstale":"2024-05-08T10:55:32.967666+0000","last_undegraded":"2024-05-08T10:55:32.967666+0000","last_fullsized":"2024-05-08T10:55:32.967666+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:42:55.846441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:55:32.964115+0000","last_change":"2024-05-08T10:55:30.966601+0000","last_active":"2024-05-08T10:55:32.964115+0000","last_peered":"2024-05-08T10:55:32.964115+0000","last_clean":"2024-05-08T10:55:32.964115+0000","last_became_active":"2024-05-08T10:55:30.966336+0000","last_became_peered":"2024-05-08T10:55:30.966336+0000","last_unstale":"2024-05-08T10:55:32.964115+0000","last_undegraded":"2024-05-08T10:55:32.964115+0000","last_fullsized":"2024-05-08T10:55:32.964115+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_clean_scrub_stamp":"2024-05-08T10:55:29.942582+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:56:13.033163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:55:32.968058+0000","last_change":"2024-05-08T10:55:31.992974+0000","last_active":"2024-05-08T10:55:32.968058+0000","last_peered":"2024-05-08T10:55:32.968058+0000","last_clean":"2024-05-08T10:55:32.968058+0000","last_became_active":"2024-05-08T10:55:31.992719+0000","last_became_peered":"2024-05-08T10:55:31.992719+0000","last_unstale":"2024-05-08T10:55:32.968058+0000","last_undegraded":"2024-05-08T10:55:32.968058+0000","last_fullsized":"2024-05-08T10:55:32.968058+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:57:31.319535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"30'2","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-08T10:55:31.997839+0000","last_change":"2024-05-08T10:55:30.970885+0000","last_active":"2024-05-08T10:55:31.997839+0000","last_peered":"2024-05-08T10:55:31.997839+0000","last_clean":"2024-05-08T10:55:31.997839+0000","last_became_active":"2024-05-08T10:55:30.970621+0000","last_became_peered":"2024-05-08T10:55:30.970621+0000","last_unstale":"2024-05-08T10:55:31.997839+0000","last_undegraded":"2024-05-08T10:55:31.997839+0000","last_fullsized":"2024-05-08T10:55:31.997839+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_clean_scrub_stamp":"2024-05-08T10:55:29.942582+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:42:54.841747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:55:33.211923+0000","last_change":"2024-05-08T10:55:31.978178+0000","last_active":"2024-05-08T10:55:33.211923+0000","last_peered":"2024-05-08T10:55:33.211923+0000","last_clean":"2024-05-08T10:55:33.211923+0000","last_became_active":"2024-05-08T10:55:31.977499+0000","last_became_peered":"2024-05-08T10:55:31.977499+0000","last_unstale":"2024-05-08T10:55:33.211923+0000","last_undegraded":"2024-05-08T10:55:33.211923+0000","last_fullsized":"2024-05-08T10:55:33.211923+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:59:19.363053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"30'2","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-08T10:55:31.989412+0000","last_change":"2024-05-08T10:55:30.964915+0000","last_active":"2024-05-08T10:55:31.989412+0000","last_peered":"2024-05-08T10:55:31.989412+0000","last_clean":"2024-05-08T10:55:31.989412+0000","last_became_active":"2024-05-08T10:55:30.964636+0000","last_became_peered":"2024-05-08T10:55:30.964636+0000","last_unstale":"2024-05-08T10:55:31.989412+0000","last_undegraded":"2024-05-08T10:55:31.989412+0000","last_fullsized":"2024-05-08T10:55:31.989412+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_clean_scrub_stamp":"2024-05-08T10:55:29.942582+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:34:57.616494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-08T10:55:31.986037+0000","last_change":"2024-05-08T10:55:31.980718+0000","last_active":"2024-05-08T10:55:31.986037+0000","last_peered":"2024-05-08T10:55:31.986037+0000","last_clean":"2024-05-08T10:55:31.986037+0000","last_became_active":"2024-05-08T10:55:31.980454+0000","last_became_peered":"2024-05-08T10:55:31.980454+0000","last_unstale":"2024-05-08T10:55:31.986037+0000","last_undegraded":"2024-05-08T10:55:31.986037+0000","last_fullsized":"2024-05-08T10:55:31.986037+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:42:55.846441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:55:32.968544+0000","last_change":"2024-05-08T10:55:30.971285+0000","last_active":"2024-05-08T10:55:32.968544+0000","last_peered":"2024-05-08T10:55:32.968544+0000","last_clean":"2024-05-08T10:55:32.968544+0000","last_became_active":"2024-05-08T10:55:30.970961+0000","last_became_peered":"2024-05-08T10:55:30.970961+0000","last_unstale":"2024-05-08T10:55:32.968544+0000","last_undegraded":"2024-05-08T10:55:32.968544+0000","last_fullsized":"2024-05-08T10:55:32.968544+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_clean_scrub_stamp":"2024-05-08T10:55:29.942582+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:08:46.518874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-08T10:55:31.979875+0000","last_change":"2024-05-08T10:55:31.977953+0000","last_active":"2024-05-08T10:55:31.979875+0000","last_peered":"2024-05-08T10:55:31.979875+0000","last_clean":"2024-05-08T10:55:31.979875+0000","last_became_active":"2024-05-08T10:55:31.977673+0000","last_became_peered":"2024-05-08T10:55:31.977673+0000","last_unstale":"2024-05-08T10:55:31.979875+0000","last_undegraded":"2024-05-08T10:55:31.979875+0000","last_fullsized":"2024-05-08T10:55:31.979875+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:27:14.269593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:55:32.968185+0000","last_change":"2024-05-08T10:55:30.971407+0000","last_active":"2024-05-08T10:55:32.968185+0000","last_peered":"2024-05-08T10:55:32.968185+0000","last_clean":"2024-05-08T10:55:32.968185+0000","last_became_active":"2024-05-08T10:55:30.971083+0000","last_became_peered":"2024-05-08T10:55:30.971083+0000","last_unstale":"2024-05-08T10:55:32.968185+0000","last_undegraded":"2024-05-08T10:55:32.968185+0000","last_fullsized":"2024-05-08T10:55:32.968185+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_clean_scrub_stamp":"2024-05-08T10:55:29.942582+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:37:12.171456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:55:32.968211+0000","last_change":"2024-05-08T10:55:31.974238+0000","last_active":"2024-05-08T10:55:32.968211+0000","last_peered":"2024-05-08T10:55:32.968211+0000","last_clean":"2024-05-08T10:55:32.968211+0000","last_became_active":"2024-05-08T10:55:31.973040+0000","last_became_peered":"2024-05-08T10:55:31.973040+0000","last_unstale":"2024-05-08T10:55:32.968211+0000","last_undegraded":"2024-05-08T10:55:32.968211+0000","last_fullsized":"2024-05-08T10:55:32.968211+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:41:08.704848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-08T10:55:31.976387+0000","last_change":"2024-05-08T10:55:30.969841+0000","last_active":"2024-05-08T10:55:31.976387+0000","last_peered":"2024-05-08T10:55:31.976387+0000","last_clean":"2024-05-08T10:55:31.976387+0000","last_became_active":"2024-05-08T10:55:30.969109+0000","last_became_peered":"2024-05-08T10:55:30.969109+0000","last_unstale":"2024-05-08T10:55:31.976387+0000","last_undegraded":"2024-05-08T10:55:31.976387+0000","last_fullsized":"2024-05-08T10:55:31.976387+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_clean_scrub_stamp":"2024-05-08T10:55:29.942582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:24:55.483556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:55:33.211488+0000","last_change":"2024-05-08T10:55:31.978924+0000","last_active":"2024-05-08T10:55:33.211488+0000","last_peered":"2024-05-08T10:55:33.211488+0000","last_clean":"2024-05-08T10:55:33.211488+0000","last_became_active":"2024-05-08T10:55:31.978691+0000","last_became_peered":"2024-05-08T10:55:31.978691+0000","last_unstale":"2024-05-08T10:55:33.211488+0000","last_undegraded":"2024-05-08T10:55:33.211488+0000","last_fullsized":"2024-05-08T10:55:33.211488+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:38:03.229028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:55:32.967945+0000","last_change":"2024-05-08T10:55:30.967214+0000","last_active":"2024-05-08T10:55:32.967945+0000","last_peered":"2024-05-08T10:55:32.967945+0000","last_clean":"2024-05-08T10:55:32.967945+0000","last_became_active":"2024-05-08T10:55:30.966910+0000","last_became_peered":"2024-05-08T10:55:30.966910+0000","last_unstale":"2024-05-08T10:55:32.967945+0000","last_undegraded":"2024-05-08T10:55:32.967945+0000","last_fullsized":"2024-05-08T10:55:32.967945+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_clean_scrub_stamp":"2024-05-08T10:55:29.942582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:35:04.069896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-08T10:55:31.996555+0000","last_change":"2024-05-08T10:55:31.991797+0000","last_active":"2024-05-08T10:55:31.996555+0000","last_peered":"2024-05-08T10:55:31.996555+0000","last_clean":"2024-05-08T10:55:31.996555+0000","last_became_active":"2024-05-08T10:55:31.991581+0000","last_became_peered":"2024-05-08T10:55:31.991581+0000","last_unstale":"2024-05-08T10:55:31.996555+0000","last_undegraded":"2024-05-08T10:55:31.996555+0000","last_fullsized":"2024-05-08T10:55:31.996555+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:59:19.363053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-08T10:55:31.988520+0000","last_change":"2024-05-08T10:55:30.969461+0000","last_active":"2024-05-08T10:55:31.988520+0000","last_peered":"2024-05-08T10:55:31.988520+0000","last_clean":"2024-05-08T10:55:31.988520+0000","last_became_active":"2024-05-08T10:55:30.969169+0000","last_became_peered":"2024-05-08T10:55:30.969169+0000","last_unstale":"2024-05-08T10:55:31.988520+0000","last_undegraded":"2024-05-08T10:55:31.988520+0000","last_fullsized":"2024-05-08T10:55:31.988520+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_clean_scrub_stamp":"2024-05-08T10:55:29.942582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:27:13.264899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-08T10:55:31.997891+0000","last_change":"2024-05-08T10:55:31.996170+0000","last_active":"2024-05-08T10:55:31.997891+0000","last_peered":"2024-05-08T10:55:31.997891+0000","last_clean":"2024-05-08T10:55:31.997891+0000","last_became_active":"2024-05-08T10:55:31.995838+0000","last_became_peered":"2024-05-08T10:55:31.995838+0000","last_unstale":"2024-05-08T10:55:31.997891+0000","last_undegraded":"2024-05-08T10:55:31.997891+0000","last_fullsized":"2024-05-08T10:55:31.997891+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:50:58.157369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:55:32.964101+0000","last_change":"2024-05-08T10:55:30.967650+0000","last_active":"2024-05-08T10:55:32.964101+0000","last_peered":"2024-05-08T10:55:32.964101+0000","last_clean":"2024-05-08T10:55:32.964101+0000","last_became_active":"2024-05-08T10:55:30.967358+0000","last_became_peered":"2024-05-08T10:55:30.967358+0000","last_unstale":"2024-05-08T10:55:32.964101+0000","last_undegraded":"2024-05-08T10:55:32.964101+0000","last_fullsized":"2024-05-08T10:55:32.964101+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_clean_scrub_stamp":"2024-05-08T10:55:29.942582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:56:32.022288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-08T10:55:31.993750+0000","last_change":"2024-05-08T10:55:31.989272+0000","last_active":"2024-05-08T10:55:31.993750+0000","last_peered":"2024-05-08T10:55:31.993750+0000","last_clean":"2024-05-08T10:55:31.993750+0000","last_became_active":"2024-05-08T10:55:31.988935+0000","last_became_peered":"2024-05-08T10:55:31.988935+0000","last_unstale":"2024-05-08T10:55:31.993750+0000","last_undegraded":"2024-05-08T10:55:31.993750+0000","last_fullsized":"2024-05-08T10:55:31.993750+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:38:03.229028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"30'3","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-08T10:55:31.994194+0000","last_change":"2024-05-08T10:55:30.967033+0000","last_active":"2024-05-08T10:55:31.994194+0000","last_peered":"2024-05-08T10:55:31.994194+0000","last_clean":"2024-05-08T10:55:31.994194+0000","last_became_active":"2024-05-08T10:55:30.966732+0000","last_became_peered":"2024-05-08T10:55:30.966732+0000","last_unstale":"2024-05-08T10:55:31.994194+0000","last_undegraded":"2024-05-08T10:55:31.994194+0000","last_fullsized":"2024-05-08T10:55:31.994194+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_clean_scrub_stamp":"2024-05-08T10:55:29.942582+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:42:54.841747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-08T10:55:31.990026+0000","last_change":"2024-05-08T10:55:31.986934+0000","last_active":"2024-05-08T10:55:31.990026+0000","last_peered":"2024-05-08T10:55:31.990026+0000","last_clean":"2024-05-08T10:55:31.990026+0000","last_became_active":"2024-05-08T10:55:31.986727+0000","last_became_peered":"2024-05-08T10:55:31.986727+0000","last_unstale":"2024-05-08T10:55:31.990026+0000","last_undegraded":"2024-05-08T10:55:31.990026+0000","last_fullsized":"2024-05-08T10:55:31.990026+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:09:15.928496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"30'6","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-08T10:55:32.001350+0000","last_change":"2024-05-08T10:55:30.970265+0000","last_active":"2024-05-08T10:55:32.001350+0000","last_peered":"2024-05-08T10:55:32.001350+0000","last_clean":"2024-05-08T10:55:32.001350+0000","last_became_active":"2024-05-08T10:55:30.969993+0000","last_became_peered":"2024-05-08T10:55:30.969993+0000","last_unstale":"2024-05-08T10:55:32.001350+0000","last_undegraded":"2024-05-08T10:55:32.001350+0000","last_fullsized":"2024-05-08T10:55:32.001350+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_clean_scrub_stamp":"2024-05-08T10:55:29.942582+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:12:43.114384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:55:33.211597+0000","last_change":"2024-05-08T10:55:31.979560+0000","last_active":"2024-05-08T10:55:33.211597+0000","last_peered":"2024-05-08T10:55:33.211597+0000","last_clean":"2024-05-08T10:55:33.211597+0000","last_became_active":"2024-05-08T10:55:31.979319+0000","last_became_peered":"2024-05-08T10:55:31.979319+0000","last_unstale":"2024-05-08T10:55:33.211597+0000","last_undegraded":"2024-05-08T10:55:33.211597+0000","last_fullsized":"2024-05-08T10:55:33.211597+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:36:15.119109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:55:32.968582+0000","last_change":"2024-05-08T10:55:30.969742+0000","last_active":"2024-05-08T10:55:32.968582+0000","last_peered":"2024-05-08T10:55:32.968582+0000","last_clean":"2024-05-08T10:55:32.968582+0000","last_became_active":"2024-05-08T10:55:30.969458+0000","last_became_peered":"2024-05-08T10:55:30.969458+0000","last_unstale":"2024-05-08T10:55:32.968582+0000","last_undegraded":"2024-05-08T10:55:32.968582+0000","last_fullsized":"2024-05-08T10:55:32.968582+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_clean_scrub_stamp":"2024-05-08T10:55:29.942582+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:29:32.015440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-08T10:55:31.994287+0000","last_change":"2024-05-08T10:55:31.991707+0000","last_active":"2024-05-08T10:55:31.994287+0000","last_peered":"2024-05-08T10:55:31.994287+0000","last_clean":"2024-05-08T10:55:31.994287+0000","last_became_active":"2024-05-08T10:55:31.989253+0000","last_became_peered":"2024-05-08T10:55:31.989253+0000","last_unstale":"2024-05-08T10:55:31.994287+0000","last_undegraded":"2024-05-08T10:55:31.994287+0000","last_fullsized":"2024-05-08T10:55:31.994287+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:59:19.363053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:55:33.211457+0000","last_change":"2024-05-08T10:55:30.968845+0000","last_active":"2024-05-08T10:55:33.211457+0000","last_peered":"2024-05-08T10:55:33.211457+0000","last_clean":"2024-05-08T10:55:33.211457+0000","last_became_active":"2024-05-08T10:55:30.968574+0000","last_became_peered":"2024-05-08T10:55:30.968574+0000","last_unstale":"2024-05-08T10:55:33.211457+0000","last_undegraded":"2024-05-08T10:55:33.211457+0000","last_fullsized":"2024-05-08T10:55:33.211457+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_clean_scrub_stamp":"2024-05-08T10:55:29.942582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:07:40.628169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-08T10:55:31.988064+0000","last_change":"2024-05-08T10:55:31.982655+0000","last_active":"2024-05-08T10:55:31.988064+0000","last_peered":"2024-05-08T10:55:31.988064+0000","last_clean":"2024-05-08T10:55:31.988064+0000","last_became_active":"2024-05-08T10:55:31.982412+0000","last_became_peered":"2024-05-08T10:55:31.982412+0000","last_unstale":"2024-05-08T10:55:31.988064+0000","last_undegraded":"2024-05-08T10:55:31.988064+0000","last_fullsized":"2024-05-08T10:55:31.988064+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:27:14.269593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-08T10:55:31.978967+0000","last_change":"2024-05-08T10:55:30.970076+0000","last_active":"2024-05-08T10:55:31.978967+0000","last_peered":"2024-05-08T10:55:31.978967+0000","last_clean":"2024-05-08T10:55:31.978967+0000","last_became_active":"2024-05-08T10:55:30.969542+0000","last_became_peered":"2024-05-08T10:55:30.969542+0000","last_unstale":"2024-05-08T10:55:31.978967+0000","last_undegraded":"2024-05-08T10:55:31.978967+0000","last_fullsized":"2024-05-08T10:55:31.978967+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_clean_scrub_stamp":"2024-05-08T10:55:29.942582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:47:45.591007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:55:32.967780+0000","last_change":"2024-05-08T10:55:31.975985+0000","last_active":"2024-05-08T10:55:32.967780+0000","last_peered":"2024-05-08T10:55:32.967780+0000","last_clean":"2024-05-08T10:55:32.967780+0000","last_became_active":"2024-05-08T10:55:31.974929+0000","last_became_peered":"2024-05-08T10:55:31.974929+0000","last_unstale":"2024-05-08T10:55:32.967780+0000","last_undegraded":"2024-05-08T10:55:32.967780+0000","last_fullsized":"2024-05-08T10:55:32.967780+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:12:44.119078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"30'8","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-08T10:55:31.997774+0000","last_change":"2024-05-08T10:55:30.969532+0000","last_active":"2024-05-08T10:55:31.997774+0000","last_peered":"2024-05-08T10:55:31.997774+0000","last_clean":"2024-05-08T10:55:31.997774+0000","last_became_active":"2024-05-08T10:55:30.969149+0000","last_became_peered":"2024-05-08T10:55:30.969149+0000","last_unstale":"2024-05-08T10:55:31.997774+0000","last_undegraded":"2024-05-08T10:55:31.997774+0000","last_fullsized":"2024-05-08T10:55:31.997774+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_clean_scrub_stamp":"2024-05-08T10:55:29.942582+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:57:30.314840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:55:32.968225+0000","last_change":"2024-05-08T10:55:31.980279+0000","last_active":"2024-05-08T10:55:32.968225+0000","last_peered":"2024-05-08T10:55:32.968225+0000","last_clean":"2024-05-08T10:55:32.968225+0000","last_became_active":"2024-05-08T10:55:31.980015+0000","last_became_peered":"2024-05-08T10:55:31.980015+0000","last_unstale":"2024-05-08T10:55:32.968225+0000","last_undegraded":"2024-05-08T10:55:32.968225+0000","last_fullsized":"2024-05-08T10:55:32.968225+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:42:55.846441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:55:33.212070+0000","last_change":"2024-05-08T10:55:30.971280+0000","last_active":"2024-05-08T10:55:33.212070+0000","last_peered":"2024-05-08T10:55:33.212070+0000","last_clean":"2024-05-08T10:55:33.212070+0000","last_became_active":"2024-05-08T10:55:30.971008+0000","last_became_peered":"2024-05-08T10:55:30.971008+0000","last_unstale":"2024-05-08T10:55:33.212070+0000","last_undegraded":"2024-05-08T10:55:33.212070+0000","last_fullsized":"2024-05-08T10:55:33.212070+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_clean_scrub_stamp":"2024-05-08T10:55:29.942582+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:56:13.033163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-08T10:55:31.983662+0000","last_change":"2024-05-08T10:55:31.980555+0000","last_active":"2024-05-08T10:55:31.983662+0000","last_peered":"2024-05-08T10:55:31.983662+0000","last_clean":"2024-05-08T10:55:31.983662+0000","last_became_active":"2024-05-08T10:55:31.979468+0000","last_became_peered":"2024-05-08T10:55:31.979468+0000","last_unstale":"2024-05-08T10:55:31.983662+0000","last_undegraded":"2024-05-08T10:55:31.983662+0000","last_fullsized":"2024-05-08T10:55:31.983662+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:23:02.622942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:55:32.968353+0000","last_change":"2024-05-08T10:55:30.967592+0000","last_active":"2024-05-08T10:55:32.968353+0000","last_peered":"2024-05-08T10:55:32.968353+0000","last_clean":"2024-05-08T10:55:32.968353+0000","last_became_active":"2024-05-08T10:55:30.967316+0000","last_became_peered":"2024-05-08T10:55:30.967316+0000","last_unstale":"2024-05-08T10:55:32.968353+0000","last_undegraded":"2024-05-08T10:55:32.968353+0000","last_fullsized":"2024-05-08T10:55:32.968353+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_clean_scrub_stamp":"2024-05-08T10:55:29.942582+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:36:34.036607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:55:33.211626+0000","last_change":"2024-05-08T10:55:31.977733+0000","last_active":"2024-05-08T10:55:33.211626+0000","last_peered":"2024-05-08T10:55:33.211626+0000","last_clean":"2024-05-08T10:55:33.211626+0000","last_became_active":"2024-05-08T10:55:31.977471+0000","last_became_peered":"2024-05-08T10:55:31.977471+0000","last_unstale":"2024-05-08T10:55:33.211626+0000","last_undegraded":"2024-05-08T10:55:33.211626+0000","last_fullsized":"2024-05-08T10:55:33.211626+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:52:02.128364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:55:32.968204+0000","last_change":"2024-05-08T10:55:30.965926+0000","last_active":"2024-05-08T10:55:32.968204+0000","last_peered":"2024-05-08T10:55:32.968204+0000","last_clean":"2024-05-08T10:55:32.968204+0000","last_became_active":"2024-05-08T10:55:30.965216+0000","last_became_peered":"2024-05-08T10:55:30.965216+0000","last_unstale":"2024-05-08T10:55:32.968204+0000","last_undegraded":"2024-05-08T10:55:32.968204+0000","last_fullsized":"2024-05-08T10:55:32.968204+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_clean_scrub_stamp":"2024-05-08T10:55:29.942582+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:18:34.186526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-08T10:55:31.987534+0000","last_change":"2024-05-08T10:55:31.982769+0000","last_active":"2024-05-08T10:55:31.987534+0000","last_peered":"2024-05-08T10:55:31.987534+0000","last_clean":"2024-05-08T10:55:31.987534+0000","last_became_active":"2024-05-08T10:55:31.982388+0000","last_became_peered":"2024-05-08T10:55:31.982388+0000","last_unstale":"2024-05-08T10:55:31.987534+0000","last_undegraded":"2024-05-08T10:55:31.987534+0000","last_fullsized":"2024-05-08T10:55:31.987534+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:20:50.057246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:55:32.968099+0000","last_change":"2024-05-08T10:55:30.968732+0000","last_active":"2024-05-08T10:55:32.968099+0000","last_peered":"2024-05-08T10:55:32.968099+0000","last_clean":"2024-05-08T10:55:32.968099+0000","last_became_active":"2024-05-08T10:55:30.968471+0000","last_became_peered":"2024-05-08T10:55:30.968471+0000","last_unstale":"2024-05-08T10:55:32.968099+0000","last_undegraded":"2024-05-08T10:55:32.968099+0000","last_fullsized":"2024-05-08T10:55:32.968099+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_clean_scrub_stamp":"2024-05-08T10:55:29.942582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:23:27.771830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-08T10:55:31.991302+0000","last_change":"2024-05-08T10:55:31.984230+0000","last_active":"2024-05-08T10:55:31.991302+0000","last_peered":"2024-05-08T10:55:31.991302+0000","last_clean":"2024-05-08T10:55:31.991302+0000","last_became_active":"2024-05-08T10:55:31.983977+0000","last_became_peered":"2024-05-08T10:55:31.983977+0000","last_unstale":"2024-05-08T10:55:31.991302+0000","last_undegraded":"2024-05-08T10:55:31.991302+0000","last_fullsized":"2024-05-08T10:55:31.991302+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:29:30.853874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:55:32.964132+0000","last_change":"2024-05-08T10:55:30.967852+0000","last_active":"2024-05-08T10:55:32.964132+0000","last_peered":"2024-05-08T10:55:32.964132+0000","last_clean":"2024-05-08T10:55:32.964132+0000","last_became_active":"2024-05-08T10:55:30.967577+0000","last_became_peered":"2024-05-08T10:55:30.967577+0000","last_unstale":"2024-05-08T10:55:32.964132+0000","last_undegraded":"2024-05-08T10:55:32.964132+0000","last_fullsized":"2024-05-08T10:55:32.964132+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_clean_scrub_stamp":"2024-05-08T10:55:29.942582+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:08:27.036086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-08T10:55:31.991336+0000","last_change":"2024-05-08T10:55:31.983585+0000","last_active":"2024-05-08T10:55:31.991336+0000","last_peered":"2024-05-08T10:55:31.991336+0000","last_clean":"2024-05-08T10:55:31.991336+0000","last_became_active":"2024-05-08T10:55:31.983312+0000","last_became_peered":"2024-05-08T10:55:31.983312+0000","last_unstale":"2024-05-08T10:55:31.991336+0000","last_undegraded":"2024-05-08T10:55:31.991336+0000","last_fullsized":"2024-05-08T10:55:31.991336+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:51:19.300646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:55:32.967461+0000","last_change":"2024-05-08T10:55:30.968065+0000","last_active":"2024-05-08T10:55:32.967461+0000","last_peered":"2024-05-08T10:55:32.967461+0000","last_clean":"2024-05-08T10:55:32.967461+0000","last_became_active":"2024-05-08T10:55:30.967793+0000","last_became_peered":"2024-05-08T10:55:30.967793+0000","last_unstale":"2024-05-08T10:55:32.967461+0000","last_undegraded":"2024-05-08T10:55:32.967461+0000","last_fullsized":"2024-05-08T10:55:32.967461+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_clean_scrub_stamp":"2024-05-08T10:55:29.942582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:05:27.784379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-08T10:55:31.992633+0000","last_change":"2024-05-08T10:55:31.987384+0000","last_active":"2024-05-08T10:55:31.992633+0000","last_peered":"2024-05-08T10:55:31.992633+0000","last_clean":"2024-05-08T10:55:31.992633+0000","last_became_active":"2024-05-08T10:55:31.987100+0000","last_became_peered":"2024-05-08T10:55:31.987100+0000","last_unstale":"2024-05-08T10:55:31.992633+0000","last_undegraded":"2024-05-08T10:55:31.992633+0000","last_fullsized":"2024-05-08T10:55:31.992633+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:18:35.191221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:55:32.968099+0000","last_change":"2024-05-08T10:55:30.972012+0000","last_active":"2024-05-08T10:55:32.968099+0000","last_peered":"2024-05-08T10:55:32.968099+0000","last_clean":"2024-05-08T10:55:32.968099+0000","last_became_active":"2024-05-08T10:55:30.971700+0000","last_became_peered":"2024-05-08T10:55:30.971700+0000","last_unstale":"2024-05-08T10:55:32.968099+0000","last_undegraded":"2024-05-08T10:55:32.968099+0000","last_fullsized":"2024-05-08T10:55:32.968099+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_clean_scrub_stamp":"2024-05-08T10:55:29.942582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:28:13.510616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-08T10:55:31.982914+0000","last_change":"2024-05-08T10:55:31.980168+0000","last_active":"2024-05-08T10:55:31.982914+0000","last_peered":"2024-05-08T10:55:31.982914+0000","last_clean":"2024-05-08T10:55:31.982914+0000","last_became_active":"2024-05-08T10:55:31.979850+0000","last_became_peered":"2024-05-08T10:55:31.979850+0000","last_unstale":"2024-05-08T10:55:31.982914+0000","last_undegraded":"2024-05-08T10:55:31.982914+0000","last_fullsized":"2024-05-08T10:55:31.982914+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:47:46.595701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-08T10:55:31.970785+0000","last_change":"2024-05-08T10:55:30.969793+0000","last_active":"2024-05-08T10:55:31.970785+0000","last_peered":"2024-05-08T10:55:31.970785+0000","last_clean":"2024-05-08T10:55:31.970785+0000","last_became_active":"2024-05-08T10:55:30.969422+0000","last_became_peered":"2024-05-08T10:55:30.969422+0000","last_unstale":"2024-05-08T10:55:31.970785+0000","last_undegraded":"2024-05-08T10:55:31.970785+0000","last_fullsized":"2024-05-08T10:55:31.970785+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_clean_scrub_stamp":"2024-05-08T10:55:29.942582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:47:45.591007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-08T10:55:31.987023+0000","last_change":"2024-05-08T10:55:31.982553+0000","last_active":"2024-05-08T10:55:31.987023+0000","last_peered":"2024-05-08T10:55:31.987023+0000","last_clean":"2024-05-08T10:55:31.987023+0000","last_became_active":"2024-05-08T10:55:31.982222+0000","last_became_peered":"2024-05-08T10:55:31.982222+0000","last_unstale":"2024-05-08T10:55:31.987023+0000","last_undegraded":"2024-05-08T10:55:31.987023+0000","last_fullsized":"2024-05-08T10:55:31.987023+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:14:50.313346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:55:33.212136+0000","last_change":"2024-05-08T10:55:30.970264+0000","last_active":"2024-05-08T10:55:33.212136+0000","last_peered":"2024-05-08T10:55:33.212136+0000","last_clean":"2024-05-08T10:55:33.212136+0000","last_became_active":"2024-05-08T10:55:30.969979+0000","last_became_peered":"2024-05-08T10:55:30.969979+0000","last_unstale":"2024-05-08T10:55:33.212136+0000","last_undegraded":"2024-05-08T10:55:33.212136+0000","last_fullsized":"2024-05-08T10:55:33.212136+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_clean_scrub_stamp":"2024-05-08T10:55:29.942582+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:16:20.054239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-08T10:55:31.988206+0000","last_change":"2024-05-08T10:55:31.986509+0000","last_active":"2024-05-08T10:55:31.988206+0000","last_peered":"2024-05-08T10:55:31.988206+0000","last_clean":"2024-05-08T10:55:31.988206+0000","last_became_active":"2024-05-08T10:55:31.986225+0000","last_became_peered":"2024-05-08T10:55:31.986225+0000","last_unstale":"2024-05-08T10:55:31.988206+0000","last_undegraded":"2024-05-08T10:55:31.988206+0000","last_fullsized":"2024-05-08T10:55:31.988206+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:36:15.119109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"31'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:55:33.976109+0000","last_change":"2024-05-08T10:55:30.962478+0000","last_active":"2024-05-08T10:55:33.976109+0000","last_peered":"2024-05-08T10:55:33.976109+0000","last_clean":"2024-05-08T10:55:33.976109+0000","last_became_active":"2024-05-08T10:55:30.962200+0000","last_became_peered":"2024-05-08T10:55:30.962200+0000","last_unstale":"2024-05-08T10:55:33.976109+0000","last_undegraded":"2024-05-08T10:55:33.976109+0000","last_fullsized":"2024-05-08T10:55:33.976109+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_clean_scrub_stamp":"2024-05-08T10:55:29.942582+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:08:10.479814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:55:32.963963+0000","last_change":"2024-05-08T10:55:31.973253+0000","last_active":"2024-05-08T10:55:32.963963+0000","last_peered":"2024-05-08T10:55:32.963963+0000","last_clean":"2024-05-08T10:55:32.963963+0000","last_became_active":"2024-05-08T10:55:31.972860+0000","last_became_peered":"2024-05-08T10:55:31.972860+0000","last_unstale":"2024-05-08T10:55:32.963963+0000","last_undegraded":"2024-05-08T10:55:32.963963+0000","last_fullsized":"2024-05-08T10:55:32.963963+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:12:44.119078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:55:33.211686+0000","last_change":"2024-05-08T10:55:30.964984+0000","last_active":"2024-05-08T10:55:33.211686+0000","last_peered":"2024-05-08T10:55:33.211686+0000","last_clean":"2024-05-08T10:55:33.211686+0000","last_became_active":"2024-05-08T10:55:30.964688+0000","last_became_peered":"2024-05-08T10:55:30.964688+0000","last_unstale":"2024-05-08T10:55:33.211686+0000","last_undegraded":"2024-05-08T10:55:33.211686+0000","last_fullsized":"2024-05-08T10:55:33.211686+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_clean_scrub_stamp":"2024-05-08T10:55:29.942582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:56:32.022288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:55:32.967471+0000","last_change":"2024-05-08T10:55:31.972921+0000","last_active":"2024-05-08T10:55:32.967471+0000","last_peered":"2024-05-08T10:55:32.967471+0000","last_clean":"2024-05-08T10:55:32.967471+0000","last_became_active":"2024-05-08T10:55:31.972615+0000","last_became_peered":"2024-05-08T10:55:31.972615+0000","last_unstale":"2024-05-08T10:55:32.967471+0000","last_undegraded":"2024-05-08T10:55:32.967471+0000","last_fullsized":"2024-05-08T10:55:32.967471+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:57:31.319535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:55:32.964231+0000","last_change":"2024-05-08T10:55:30.965561+0000","last_active":"2024-05-08T10:55:32.964231+0000","last_peered":"2024-05-08T10:55:32.964231+0000","last_clean":"2024-05-08T10:55:32.964231+0000","last_became_active":"2024-05-08T10:55:30.965293+0000","last_became_peered":"2024-05-08T10:55:30.965293+0000","last_unstale":"2024-05-08T10:55:32.964231+0000","last_undegraded":"2024-05-08T10:55:32.964231+0000","last_fullsized":"2024-05-08T10:55:32.964231+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_clean_scrub_stamp":"2024-05-08T10:55:29.942582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:07:40.628169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:55:32.964092+0000","last_change":"2024-05-08T10:55:31.975741+0000","last_active":"2024-05-08T10:55:32.964092+0000","last_peered":"2024-05-08T10:55:32.964092+0000","last_clean":"2024-05-08T10:55:32.964092+0000","last_became_active":"2024-05-08T10:55:31.975447+0000","last_became_peered":"2024-05-08T10:55:31.975447+0000","last_unstale":"2024-05-08T10:55:32.964092+0000","last_undegraded":"2024-05-08T10:55:32.964092+0000","last_fullsized":"2024-05-08T10:55:32.964092+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:02:15.212512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:55:33.211556+0000","last_change":"2024-05-08T10:55:30.970228+0000","last_active":"2024-05-08T10:55:33.211556+0000","last_peered":"2024-05-08T10:55:33.211556+0000","last_clean":"2024-05-08T10:55:33.211556+0000","last_became_active":"2024-05-08T10:55:30.969961+0000","last_became_peered":"2024-05-08T10:55:30.969961+0000","last_unstale":"2024-05-08T10:55:33.211556+0000","last_undegraded":"2024-05-08T10:55:33.211556+0000","last_fullsized":"2024-05-08T10:55:33.211556+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_clean_scrub_stamp":"2024-05-08T10:55:29.942582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:08:27.036086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-08T10:55:31.992219+0000","last_change":"2024-05-08T10:55:31.988966+0000","last_active":"2024-05-08T10:55:31.992219+0000","last_peered":"2024-05-08T10:55:31.992219+0000","last_clean":"2024-05-08T10:55:31.992219+0000","last_became_active":"2024-05-08T10:55:31.986644+0000","last_became_peered":"2024-05-08T10:55:31.986644+0000","last_unstale":"2024-05-08T10:55:31.992219+0000","last_undegraded":"2024-05-08T10:55:31.992219+0000","last_fullsized":"2024-05-08T10:55:31.992219+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:02:15.212512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:55:32.968368+0000","last_change":"2024-05-08T10:55:30.965221+0000","last_active":"2024-05-08T10:55:32.968368+0000","last_peered":"2024-05-08T10:55:32.968368+0000","last_clean":"2024-05-08T10:55:32.968368+0000","last_became_active":"2024-05-08T10:55:30.964939+0000","last_became_peered":"2024-05-08T10:55:30.964939+0000","last_unstale":"2024-05-08T10:55:32.968368+0000","last_undegraded":"2024-05-08T10:55:32.968368+0000","last_fullsized":"2024-05-08T10:55:32.968368+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_clean_scrub_stamp":"2024-05-08T10:55:29.942582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:49:36.250358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:55:32.967989+0000","last_change":"2024-05-08T10:55:31.993010+0000","last_active":"2024-05-08T10:55:32.967989+0000","last_peered":"2024-05-08T10:55:32.967989+0000","last_clean":"2024-05-08T10:55:32.967989+0000","last_became_active":"2024-05-08T10:55:31.992707+0000","last_became_peered":"2024-05-08T10:55:31.992707+0000","last_unstale":"2024-05-08T10:55:32.967989+0000","last_undegraded":"2024-05-08T10:55:32.967989+0000","last_fullsized":"2024-05-08T10:55:32.967989+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:24:56.488251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-08T10:55:31.976498+0000","last_change":"2024-05-08T10:55:30.965624+0000","last_active":"2024-05-08T10:55:31.976498+0000","last_peered":"2024-05-08T10:55:31.976498+0000","last_clean":"2024-05-08T10:55:31.976498+0000","last_became_active":"2024-05-08T10:55:30.965314+0000","last_became_peered":"2024-05-08T10:55:30.965314+0000","last_unstale":"2024-05-08T10:55:31.976498+0000","last_undegraded":"2024-05-08T10:55:31.976498+0000","last_fullsized":"2024-05-08T10:55:31.976498+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_clean_scrub_stamp":"2024-05-08T10:55:29.942582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:41:07.700154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-08T10:55:31.993938+0000","last_change":"2024-05-08T10:55:31.987465+0000","last_active":"2024-05-08T10:55:31.993938+0000","last_peered":"2024-05-08T10:55:31.993938+0000","last_clean":"2024-05-08T10:55:31.993938+0000","last_became_active":"2024-05-08T10:55:31.987171+0000","last_became_peered":"2024-05-08T10:55:31.987171+0000","last_unstale":"2024-05-08T10:55:31.993938+0000","last_undegraded":"2024-05-08T10:55:31.993938+0000","last_fullsized":"2024-05-08T10:55:31.993938+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:23:02.622942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:55:32.967372+0000","last_change":"2024-05-08T10:55:30.974505+0000","last_active":"2024-05-08T10:55:32.967372+0000","last_peered":"2024-05-08T10:55:32.967372+0000","last_clean":"2024-05-08T10:55:32.967372+0000","last_became_active":"2024-05-08T10:55:30.974223+0000","last_became_peered":"2024-05-08T10:55:30.974223+0000","last_unstale":"2024-05-08T10:55:32.967372+0000","last_undegraded":"2024-05-08T10:55:32.967372+0000","last_fullsized":"2024-05-08T10:55:32.967372+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_clean_scrub_stamp":"2024-05-08T10:55:29.942582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:06:38.281420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":187,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-08T10:55:31.972121+0000","last_change":"2024-05-08T10:54:40.015226+0000","last_active":"2024-05-08T10:55:31.972121+0000","last_peered":"2024-05-08T10:55:31.972121+0000","last_clean":"2024-05-08T10:55:31.972121+0000","last_became_active":"2024-05-08T10:54:40.014219+0000","last_became_peered":"2024-05-08T10:54:40.014219+0000","last_unstale":"2024-05-08T10:55:31.972121+0000","last_undegraded":"2024-05-08T10:55:31.972121+0000","last_fullsized":"2024-05-08T10:55:31.972121+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:38.989328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:38.989328+0000","last_clean_scrub_stamp":"2024-05-08T10:54:38.989328+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:10:59.668786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343904,"statfs":{"total":96636764160,"available":96608157696,"internally_reserved":0,"allocated":933888,"data_stored":718284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":356352,"data_stored":134742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":344064,"data_stored":128498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":356352,"data_stored":134230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":352256,"data_stored":129460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":339968,"data_stored":127896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":352256,"data_stored":129460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27940,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343900,"statfs":{"total":96636764160,"available":96608153600,"internally_reserved":0,"allocated":942080,"data_stored":724494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T10:55:34.991 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T10:55:35.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.136+0000 7fe76c142640 1 Processor -- start 2024-05-08T10:55:35.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.136+0000 7fe76c142640 1 -- start start 2024-05-08T10:55:35.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.137+0000 7fe76c142640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fe7640b4c60 0x7fe76415e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:35.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.137+0000 7fe76c142640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7640d4910 con 0x7fe7640d0540 2024-05-08T10:55:35.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.137+0000 7fe76c142640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7640d25e0 con 0x7fe7640d0920 2024-05-08T10:55:35.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.137+0000 7fe76c142640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7640d46c0 con 0x7fe7640b4c60 2024-05-08T10:55:35.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.137+0000 7fe76a6df640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fe7640b4c60 0x7fe76415e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:35.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.137+0000 7fe769ede640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fe7640d0540 0x7fe76415dbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:54008/0 (socket says 172.21.15.33:54008) 2024-05-08T10:55:35.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.137+0000 7fe769ede640 1 -- 172.21.15.33:0/164375022 learned_addr learned my addr 172.21.15.33:0/164375022 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-05-08T10:55:35.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.137+0000 7fe76a6df640 1 -- 172.21.15.33:0/164375022 >> v1:172.21.15.174:6789/0 conn(0x7fe7640d0920 legacy=0x7fe7640ce7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:35.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.137+0000 7fe76a6df640 1 -- 172.21.15.33:0/164375022 >> v1:172.21.15.33:6789/0 conn(0x7fe7640d0540 legacy=0x7fe76415dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:35.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.137+0000 7fe76a6df640 1 -- 172.21.15.33:0/164375022 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7640b4730 con 0x7fe7640b4c60 2024-05-08T10:55:35.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.138+0000 7fe76a6df640 1 --2- 172.21.15.33:0/164375022 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe7640b4c60 0x7fe76415e2e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fe75c009d90 tx=0x7fe75c02a580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa6aab66f88f13c6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:35.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.138+0000 7fe768edc640 1 -- 172.21.15.33:0/164375022 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe75c007740 con 0x7fe7640b4c60 2024-05-08T10:55:35.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.138+0000 7fe768edc640 1 -- 172.21.15.33:0/164375022 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe75c0078e0 con 0x7fe7640b4c60 2024-05-08T10:55:35.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.138+0000 7fe768edc640 1 -- 172.21.15.33:0/164375022 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe75c007cb0 con 0x7fe7640b4c60 2024-05-08T10:55:35.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.139+0000 7fe76c142640 1 -- 172.21.15.33:0/164375022 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe7640b4c60 msgr2=0x7fe76415e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:35.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.139+0000 7fe76c142640 1 --2- 172.21.15.33:0/164375022 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe7640b4c60 0x7fe76415e2e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fe75c009d90 tx=0x7fe75c02a580 comp rx=0 tx=0).stop 2024-05-08T10:55:35.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.139+0000 7fe76c142640 1 -- 172.21.15.33:0/164375022 shutdown_connections 2024-05-08T10:55:35.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.139+0000 7fe76c142640 1 --2- 172.21.15.33:0/164375022 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe7640b4c60 0x7fe76415e2e0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:35.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.139+0000 7fe76c142640 1 -- 172.21.15.33:0/164375022 >> 172.21.15.33:0/164375022 conn(0x7fe7640d3ba0 msgr2=0x7fe7640d3fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:35.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.139+0000 7fe76c142640 1 -- 172.21.15.33:0/164375022 shutdown_connections 2024-05-08T10:55:35.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.139+0000 7fe76c142640 1 -- 172.21.15.33:0/164375022 wait complete. 2024-05-08T10:55:35.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.140+0000 7fe76c142640 1 Processor -- start 2024-05-08T10:55:35.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.140+0000 7fe76c142640 1 -- start start 2024-05-08T10:55:35.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.141+0000 7fe76c142640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe7640b4c60 0x7fe7640caee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:35.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.141+0000 7fe76c142640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe7640d0540 0x7fe76414dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:35.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.141+0000 7fe76c142640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe7640d0920 0x7fe7641f2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:35.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.141+0000 7fe76c142640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7640d2950 con 0x7fe7640d0540 2024-05-08T10:55:35.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.141+0000 7fe76c142640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7640d2390 con 0x7fe7640b4c60 2024-05-08T10:55:35.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.141+0000 7fe76c142640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7640ceec0 con 0x7fe7640d0920 2024-05-08T10:55:35.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.141+0000 7fe7696dd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe7640d0540 0x7fe76414dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:35.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.141+0000 7fe7696dd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe7640d0540 0x7fe76414dd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33954/0 (socket says 172.21.15.33:33954) 2024-05-08T10:55:35.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.141+0000 7fe7696dd640 1 -- 172.21.15.33:0/1671156962 learned_addr learned my addr 172.21.15.33:0/1671156962 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:35.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.141+0000 7fe769ede640 1 --2- 172.21.15.33:0/1671156962 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe7640b4c60 0x7fe7640caee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:35.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.141+0000 7fe76a6df640 1 --2- 172.21.15.33:0/1671156962 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe7640d0920 0x7fe7641f2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:35.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.141+0000 7fe7696dd640 1 -- 172.21.15.33:0/1671156962 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe7640d0920 msgr2=0x7fe7641f2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:35.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.141+0000 7fe7696dd640 1 --2- 172.21.15.33:0/1671156962 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe7640d0920 0x7fe7641f2ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:35.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.141+0000 7fe7696dd640 1 -- 172.21.15.33:0/1671156962 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe7640b4c60 msgr2=0x7fe7640caee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:35.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.141+0000 7fe7696dd640 1 --2- 172.21.15.33:0/1671156962 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe7640b4c60 0x7fe7640caee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:35.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.141+0000 7fe7696dd640 1 -- 172.21.15.33:0/1671156962 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe76414e890 con 0x7fe7640d0540 2024-05-08T10:55:35.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.141+0000 7fe7696dd640 1 --2- 172.21.15.33:0/1671156962 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe7640d0540 0x7fe76414dd90 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fe75400b3f0 tx=0x7fe75400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:35.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.142+0000 7fe75a7fc640 1 -- 172.21.15.33:0/1671156962 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe754015020 con 0x7fe7640d0540 2024-05-08T10:55:35.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.142+0000 7fe75a7fc640 1 -- 172.21.15.33:0/1671156962 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe754011830 con 0x7fe7640d0540 2024-05-08T10:55:35.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.142+0000 7fe76c142640 1 -- 172.21.15.33:0/1671156962 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe76414eb70 con 0x7fe7640d0540 2024-05-08T10:55:35.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.142+0000 7fe75a7fc640 1 -- 172.21.15.33:0/1671156962 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe754011c20 con 0x7fe7640d0540 2024-05-08T10:55:35.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.142+0000 7fe76c142640 1 -- 172.21.15.33:0/1671156962 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe76406b720 con 0x7fe7640d0540 2024-05-08T10:55:35.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.143+0000 7fe76c142640 1 -- 172.21.15.33:0/1671156962 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe764067440 con 0x7fe7640d0540 2024-05-08T10:55:35.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.143+0000 7fe75a7fc640 1 -- 172.21.15.33:0/1671156962 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe754018020 con 0x7fe7640d0540 2024-05-08T10:55:35.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.143+0000 7fe75a7fc640 1 --2- 172.21.15.33:0/1671156962 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fe74806b4d0 0x7fe74806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:35.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.144+0000 7fe75a7fc640 1 -- 172.21.15.33:0/1671156962 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe754089c60 con 0x7fe7640d0540 2024-05-08T10:55:35.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.144+0000 7fe769ede640 1 --2- 172.21.15.33:0/1671156962 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fe74806b4d0 0x7fe74806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:35.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.144+0000 7fe769ede640 1 --2- 172.21.15.33:0/1671156962 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fe74806b4d0 0x7fe74806d990 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe760007fd0 tx=0x7fe760007e80 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:35.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.148+0000 7fe75a7fc640 1 -- 172.21.15.33:0/1671156962 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe75401f030 con 0x7fe7640d0540 2024-05-08T10:55:35.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.328+0000 7fe76c142640 1 -- 172.21.15.33:0/1671156962 --> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe764072f70 con 0x7fe74806b4d0 2024-05-08T10:55:35.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.335+0000 7fe75a7fc640 1 -- 172.21.15.33:0/1671156962 <== mgr.4103 v2:172.21.15.174:6832/261355069 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251909 (secure 0 0 0) 0x7fe764072f70 con 0x7fe74806b4d0 2024-05-08T10:55:35.334 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:55:35.340 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-05-08T10:55:35.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.338+0000 7fe76c142640 1 -- 172.21.15.33:0/1671156962 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fe74806b4d0 msgr2=0x7fe74806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:35.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.338+0000 7fe76c142640 1 --2- 172.21.15.33:0/1671156962 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fe74806b4d0 0x7fe74806d990 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe760007fd0 tx=0x7fe760007e80 comp rx=0 tx=0).stop 2024-05-08T10:55:35.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.338+0000 7fe76c142640 1 -- 172.21.15.33:0/1671156962 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe7640d0540 msgr2=0x7fe76414dd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:35.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.338+0000 7fe76c142640 1 --2- 172.21.15.33:0/1671156962 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe7640d0540 0x7fe76414dd90 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fe75400b3f0 tx=0x7fe75400b8b0 comp rx=0 tx=0).stop 2024-05-08T10:55:35.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.338+0000 7fe76c142640 1 -- 172.21.15.33:0/1671156962 shutdown_connections 2024-05-08T10:55:35.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.338+0000 7fe76c142640 1 --2- 172.21.15.33:0/1671156962 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fe74806b4d0 0x7fe74806d990 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:35.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.338+0000 7fe76c142640 1 --2- 172.21.15.33:0/1671156962 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe7640d0920 0x7fe7641f2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:35.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.338+0000 7fe76c142640 1 --2- 172.21.15.33:0/1671156962 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe7640d0540 0x7fe76414dd90 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:35.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.338+0000 7fe76c142640 1 --2- 172.21.15.33:0/1671156962 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe7640b4c60 0x7fe7640caee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:35.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.338+0000 7fe76c142640 1 -- 172.21.15.33:0/1671156962 >> 172.21.15.33:0/1671156962 conn(0x7fe7640d3ba0 msgr2=0x7fe7640d2ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:35.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.338+0000 7fe76c142640 1 -- 172.21.15.33:0/1671156962 shutdown_connections 2024-05-08T10:55:35.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.338+0000 7fe76c142640 1 -- 172.21.15.33:0/1671156962 wait complete. 2024-05-08T10:55:35.346 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":52,"stamp":"2024-05-08T10:55:34.954333+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":123,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220080,"kb_used_data":3884,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754640,"statfs":{"total":773094113280,"available":772868751360,"internally_reserved":0,"allocated":3977216,"data_stored":2227064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.006262"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:55:32.967544+0000","last_change":"2024-05-08T10:55:31.978914+0000","last_active":"2024-05-08T10:55:32.967544+0000","last_peered":"2024-05-08T10:55:32.967544+0000","last_clean":"2024-05-08T10:55:32.967544+0000","last_became_active":"2024-05-08T10:55:31.978665+0000","last_became_peered":"2024-05-08T10:55:31.978665+0000","last_unstale":"2024-05-08T10:55:32.967544+0000","last_undegraded":"2024-05-08T10:55:32.967544+0000","last_fullsized":"2024-05-08T10:55:32.967544+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:47:46.595701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-08T10:55:31.994363+0000","last_change":"2024-05-08T10:55:31.991465+0000","last_active":"2024-05-08T10:55:31.994363+0000","last_peered":"2024-05-08T10:55:31.994363+0000","last_clean":"2024-05-08T10:55:31.994363+0000","last_became_active":"2024-05-08T10:55:31.990866+0000","last_became_peered":"2024-05-08T10:55:31.990866+0000","last_unstale":"2024-05-08T10:55:31.994363+0000","last_undegraded":"2024-05-08T10:55:31.994363+0000","last_fullsized":"2024-05-08T10:55:31.994363+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:09:15.928496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-08T10:55:31.988236+0000","last_change":"2024-05-08T10:55:31.986842+0000","last_active":"2024-05-08T10:55:31.988236+0000","last_peered":"2024-05-08T10:55:31.988236+0000","last_clean":"2024-05-08T10:55:31.988236+0000","last_became_active":"2024-05-08T10:55:31.986573+0000","last_became_peered":"2024-05-08T10:55:31.986573+0000","last_unstale":"2024-05-08T10:55:31.988236+0000","last_undegraded":"2024-05-08T10:55:31.988236+0000","last_fullsized":"2024-05-08T10:55:31.988236+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:52:02.128364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:55:33.211574+0000","last_change":"2024-05-08T10:55:31.973747+0000","last_active":"2024-05-08T10:55:33.211574+0000","last_peered":"2024-05-08T10:55:33.211574+0000","last_clean":"2024-05-08T10:55:33.211574+0000","last_became_active":"2024-05-08T10:55:31.973421+0000","last_became_peered":"2024-05-08T10:55:31.973421+0000","last_unstale":"2024-05-08T10:55:33.211574+0000","last_undegraded":"2024-05-08T10:55:33.211574+0000","last_fullsized":"2024-05-08T10:55:33.211574+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:23:02.622942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-08T10:55:31.998152+0000","last_change":"2024-05-08T10:55:31.994158+0000","last_active":"2024-05-08T10:55:31.998152+0000","last_peered":"2024-05-08T10:55:31.998152+0000","last_clean":"2024-05-08T10:55:31.998152+0000","last_became_active":"2024-05-08T10:55:31.993877+0000","last_became_peered":"2024-05-08T10:55:31.993877+0000","last_unstale":"2024-05-08T10:55:31.998152+0000","last_undegraded":"2024-05-08T10:55:31.998152+0000","last_fullsized":"2024-05-08T10:55:31.998152+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:36:35.041302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-08T10:55:31.994272+0000","last_change":"2024-05-08T10:55:31.990305+0000","last_active":"2024-05-08T10:55:31.994272+0000","last_peered":"2024-05-08T10:55:31.994272+0000","last_clean":"2024-05-08T10:55:31.994272+0000","last_became_active":"2024-05-08T10:55:31.990018+0000","last_became_peered":"2024-05-08T10:55:31.990018+0000","last_unstale":"2024-05-08T10:55:31.994272+0000","last_undegraded":"2024-05-08T10:55:31.994272+0000","last_fullsized":"2024-05-08T10:55:31.994272+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:23:02.622942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-08T10:55:31.993980+0000","last_change":"2024-05-08T10:55:31.987682+0000","last_active":"2024-05-08T10:55:31.993980+0000","last_peered":"2024-05-08T10:55:31.993980+0000","last_clean":"2024-05-08T10:55:31.993980+0000","last_became_active":"2024-05-08T10:55:31.987394+0000","last_became_peered":"2024-05-08T10:55:31.987394+0000","last_unstale":"2024-05-08T10:55:31.993980+0000","last_undegraded":"2024-05-08T10:55:31.993980+0000","last_fullsized":"2024-05-08T10:55:31.993980+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:52:02.128364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-08T10:55:31.993800+0000","last_change":"2024-05-08T10:55:31.986776+0000","last_active":"2024-05-08T10:55:31.993800+0000","last_peered":"2024-05-08T10:55:31.993800+0000","last_clean":"2024-05-08T10:55:31.993800+0000","last_became_active":"2024-05-08T10:55:31.986548+0000","last_became_peered":"2024-05-08T10:55:31.986548+0000","last_unstale":"2024-05-08T10:55:31.993800+0000","last_undegraded":"2024-05-08T10:55:31.993800+0000","last_fullsized":"2024-05-08T10:55:31.993800+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:38:03.229028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:55:32.968521+0000","last_change":"2024-05-08T10:55:31.978010+0000","last_active":"2024-05-08T10:55:32.968521+0000","last_peered":"2024-05-08T10:55:32.968521+0000","last_clean":"2024-05-08T10:55:32.968521+0000","last_became_active":"2024-05-08T10:55:31.976950+0000","last_became_peered":"2024-05-08T10:55:31.976950+0000","last_unstale":"2024-05-08T10:55:32.968521+0000","last_undegraded":"2024-05-08T10:55:32.968521+0000","last_fullsized":"2024-05-08T10:55:32.968521+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:02:15.212512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:55:33.211890+0000","last_change":"2024-05-08T10:55:31.992971+0000","last_active":"2024-05-08T10:55:33.211890+0000","last_peered":"2024-05-08T10:55:33.211890+0000","last_clean":"2024-05-08T10:55:33.211890+0000","last_became_active":"2024-05-08T10:55:31.992675+0000","last_became_peered":"2024-05-08T10:55:31.992675+0000","last_unstale":"2024-05-08T10:55:33.211890+0000","last_undegraded":"2024-05-08T10:55:33.211890+0000","last_fullsized":"2024-05-08T10:55:33.211890+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:09:15.928496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-08T10:55:31.993838+0000","last_change":"2024-05-08T10:55:31.986091+0000","last_active":"2024-05-08T10:55:31.993838+0000","last_peered":"2024-05-08T10:55:31.993838+0000","last_clean":"2024-05-08T10:55:31.993838+0000","last_became_active":"2024-05-08T10:55:31.985747+0000","last_became_peered":"2024-05-08T10:55:31.985747+0000","last_unstale":"2024-05-08T10:55:31.993838+0000","last_undegraded":"2024-05-08T10:55:31.993838+0000","last_fullsized":"2024-05-08T10:55:31.993838+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:02:15.212512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-08T10:55:31.996821+0000","last_change":"2024-05-08T10:55:31.995472+0000","last_active":"2024-05-08T10:55:31.996821+0000","last_peered":"2024-05-08T10:55:31.996821+0000","last_clean":"2024-05-08T10:55:31.996821+0000","last_became_active":"2024-05-08T10:55:31.995235+0000","last_became_peered":"2024-05-08T10:55:31.995235+0000","last_unstale":"2024-05-08T10:55:31.996821+0000","last_undegraded":"2024-05-08T10:55:31.996821+0000","last_fullsized":"2024-05-08T10:55:31.996821+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:33:06.222369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-08T10:55:31.992508+0000","last_change":"2024-05-08T10:55:31.984841+0000","last_active":"2024-05-08T10:55:31.992508+0000","last_peered":"2024-05-08T10:55:31.992508+0000","last_clean":"2024-05-08T10:55:31.992508+0000","last_became_active":"2024-05-08T10:55:31.984570+0000","last_became_peered":"2024-05-08T10:55:31.984570+0000","last_unstale":"2024-05-08T10:55:31.992508+0000","last_undegraded":"2024-05-08T10:55:31.992508+0000","last_fullsized":"2024-05-08T10:55:31.992508+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:09:29.846612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-08T10:55:31.994292+0000","last_change":"2024-05-08T10:55:31.990910+0000","last_active":"2024-05-08T10:55:31.994292+0000","last_peered":"2024-05-08T10:55:31.994292+0000","last_clean":"2024-05-08T10:55:31.994292+0000","last_became_active":"2024-05-08T10:55:31.990592+0000","last_became_peered":"2024-05-08T10:55:31.990592+0000","last_unstale":"2024-05-08T10:55:31.994292+0000","last_undegraded":"2024-05-08T10:55:31.994292+0000","last_fullsized":"2024-05-08T10:55:31.994292+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:36:15.119109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-08T10:55:31.978573+0000","last_change":"2024-05-08T10:55:31.974182+0000","last_active":"2024-05-08T10:55:31.978573+0000","last_peered":"2024-05-08T10:55:31.978573+0000","last_clean":"2024-05-08T10:55:31.978573+0000","last_became_active":"2024-05-08T10:55:31.973915+0000","last_became_peered":"2024-05-08T10:55:31.973915+0000","last_unstale":"2024-05-08T10:55:31.978573+0000","last_undegraded":"2024-05-08T10:55:31.978573+0000","last_fullsized":"2024-05-08T10:55:31.978573+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:12:44.119078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-08T10:55:31.999729+0000","last_change":"2024-05-08T10:55:31.993836+0000","last_active":"2024-05-08T10:55:31.999729+0000","last_peered":"2024-05-08T10:55:31.999729+0000","last_clean":"2024-05-08T10:55:31.999729+0000","last_became_active":"2024-05-08T10:55:31.993530+0000","last_became_peered":"2024-05-08T10:55:31.993530+0000","last_unstale":"2024-05-08T10:55:31.999729+0000","last_undegraded":"2024-05-08T10:55:31.999729+0000","last_fullsized":"2024-05-08T10:55:31.999729+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:09:15.928496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-08T10:55:31.993959+0000","last_change":"2024-05-08T10:55:31.987635+0000","last_active":"2024-05-08T10:55:31.993959+0000","last_peered":"2024-05-08T10:55:31.993959+0000","last_clean":"2024-05-08T10:55:31.993959+0000","last_became_active":"2024-05-08T10:55:31.987334+0000","last_became_peered":"2024-05-08T10:55:31.987334+0000","last_unstale":"2024-05-08T10:55:31.993959+0000","last_undegraded":"2024-05-08T10:55:31.993959+0000","last_fullsized":"2024-05-08T10:55:31.993959+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:36:15.119109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-08T10:55:31.998172+0000","last_change":"2024-05-08T10:55:31.997100+0000","last_active":"2024-05-08T10:55:31.998172+0000","last_peered":"2024-05-08T10:55:31.998172+0000","last_clean":"2024-05-08T10:55:31.998172+0000","last_became_active":"2024-05-08T10:55:31.996808+0000","last_became_peered":"2024-05-08T10:55:31.996808+0000","last_unstale":"2024-05-08T10:55:31.998172+0000","last_undegraded":"2024-05-08T10:55:31.998172+0000","last_fullsized":"2024-05-08T10:55:31.998172+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:32:02.931086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-08T10:55:31.997751+0000","last_change":"2024-05-08T10:55:31.995549+0000","last_active":"2024-05-08T10:55:31.997751+0000","last_peered":"2024-05-08T10:55:31.997751+0000","last_clean":"2024-05-08T10:55:31.997751+0000","last_became_active":"2024-05-08T10:55:31.995287+0000","last_became_peered":"2024-05-08T10:55:31.995287+0000","last_unstale":"2024-05-08T10:55:31.997751+0000","last_undegraded":"2024-05-08T10:55:31.997751+0000","last_fullsized":"2024-05-08T10:55:31.997751+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:33:06.222369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-08T10:55:31.992484+0000","last_change":"2024-05-08T10:55:31.985442+0000","last_active":"2024-05-08T10:55:31.992484+0000","last_peered":"2024-05-08T10:55:31.992484+0000","last_clean":"2024-05-08T10:55:31.992484+0000","last_became_active":"2024-05-08T10:55:31.985036+0000","last_became_peered":"2024-05-08T10:55:31.985036+0000","last_unstale":"2024-05-08T10:55:31.992484+0000","last_undegraded":"2024-05-08T10:55:31.992484+0000","last_fullsized":"2024-05-08T10:55:31.992484+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:41:44.252830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:55:32.968439+0000","last_change":"2024-05-08T10:55:31.983340+0000","last_active":"2024-05-08T10:55:32.968439+0000","last_peered":"2024-05-08T10:55:32.968439+0000","last_clean":"2024-05-08T10:55:32.968439+0000","last_became_active":"2024-05-08T10:55:31.983053+0000","last_became_peered":"2024-05-08T10:55:31.983053+0000","last_unstale":"2024-05-08T10:55:32.968439+0000","last_undegraded":"2024-05-08T10:55:32.968439+0000","last_fullsized":"2024-05-08T10:55:32.968439+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:12:44.119078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:55:32.968231+0000","last_change":"2024-05-08T10:55:31.992929+0000","last_active":"2024-05-08T10:55:32.968231+0000","last_peered":"2024-05-08T10:55:32.968231+0000","last_clean":"2024-05-08T10:55:32.968231+0000","last_became_active":"2024-05-08T10:55:31.992684+0000","last_became_peered":"2024-05-08T10:55:31.992684+0000","last_unstale":"2024-05-08T10:55:32.968231+0000","last_undegraded":"2024-05-08T10:55:32.968231+0000","last_fullsized":"2024-05-08T10:55:32.968231+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:47:46.595701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:55:32.963937+0000","last_change":"2024-05-08T10:55:31.983176+0000","last_active":"2024-05-08T10:55:32.963937+0000","last_peered":"2024-05-08T10:55:32.963937+0000","last_clean":"2024-05-08T10:55:32.963937+0000","last_became_active":"2024-05-08T10:55:31.982873+0000","last_became_peered":"2024-05-08T10:55:31.982873+0000","last_unstale":"2024-05-08T10:55:32.963937+0000","last_undegraded":"2024-05-08T10:55:32.963937+0000","last_fullsized":"2024-05-08T10:55:32.963937+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:42:55.846441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-08T10:55:31.983631+0000","last_change":"2024-05-08T10:55:31.979644+0000","last_active":"2024-05-08T10:55:31.983631+0000","last_peered":"2024-05-08T10:55:31.983631+0000","last_clean":"2024-05-08T10:55:31.983631+0000","last_became_active":"2024-05-08T10:55:31.979353+0000","last_became_peered":"2024-05-08T10:55:31.979353+0000","last_unstale":"2024-05-08T10:55:31.983631+0000","last_undegraded":"2024-05-08T10:55:31.983631+0000","last_fullsized":"2024-05-08T10:55:31.983631+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:02:15.212512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:55:33.212014+0000","last_change":"2024-05-08T10:55:31.977475+0000","last_active":"2024-05-08T10:55:33.212014+0000","last_peered":"2024-05-08T10:55:33.212014+0000","last_clean":"2024-05-08T10:55:33.212014+0000","last_became_active":"2024-05-08T10:55:31.977200+0000","last_became_peered":"2024-05-08T10:55:31.977200+0000","last_unstale":"2024-05-08T10:55:33.212014+0000","last_undegraded":"2024-05-08T10:55:33.212014+0000","last_fullsized":"2024-05-08T10:55:33.212014+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:50:58.157369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-08T10:55:31.994343+0000","last_change":"2024-05-08T10:55:31.991225+0000","last_active":"2024-05-08T10:55:31.994343+0000","last_peered":"2024-05-08T10:55:31.994343+0000","last_clean":"2024-05-08T10:55:31.994343+0000","last_became_active":"2024-05-08T10:55:31.990558+0000","last_became_peered":"2024-05-08T10:55:31.990558+0000","last_unstale":"2024-05-08T10:55:31.994343+0000","last_undegraded":"2024-05-08T10:55:31.994343+0000","last_fullsized":"2024-05-08T10:55:31.994343+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:52:02.128364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:55:33.211926+0000","last_change":"2024-05-08T10:55:31.978283+0000","last_active":"2024-05-08T10:55:33.211926+0000","last_peered":"2024-05-08T10:55:33.211926+0000","last_clean":"2024-05-08T10:55:33.211926+0000","last_became_active":"2024-05-08T10:55:31.977884+0000","last_became_peered":"2024-05-08T10:55:31.977884+0000","last_unstale":"2024-05-08T10:55:33.211926+0000","last_undegraded":"2024-05-08T10:55:33.211926+0000","last_fullsized":"2024-05-08T10:55:33.211926+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:33:06.222369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-08T10:55:31.983569+0000","last_change":"2024-05-08T10:55:31.980186+0000","last_active":"2024-05-08T10:55:31.983569+0000","last_peered":"2024-05-08T10:55:31.983569+0000","last_clean":"2024-05-08T10:55:31.983569+0000","last_became_active":"2024-05-08T10:55:31.979866+0000","last_became_peered":"2024-05-08T10:55:31.979866+0000","last_unstale":"2024-05-08T10:55:31.983569+0000","last_undegraded":"2024-05-08T10:55:31.983569+0000","last_fullsized":"2024-05-08T10:55:31.983569+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:38:03.229028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:55:32.968505+0000","last_change":"2024-05-08T10:55:31.984060+0000","last_active":"2024-05-08T10:55:32.968505+0000","last_peered":"2024-05-08T10:55:32.968505+0000","last_clean":"2024-05-08T10:55:32.968505+0000","last_became_active":"2024-05-08T10:55:31.983777+0000","last_became_peered":"2024-05-08T10:55:31.983777+0000","last_unstale":"2024-05-08T10:55:32.968505+0000","last_undegraded":"2024-05-08T10:55:32.968505+0000","last_fullsized":"2024-05-08T10:55:32.968505+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:27:14.269593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-08T10:55:31.982950+0000","last_change":"2024-05-08T10:55:31.980152+0000","last_active":"2024-05-08T10:55:31.982950+0000","last_peered":"2024-05-08T10:55:31.982950+0000","last_clean":"2024-05-08T10:55:31.982950+0000","last_became_active":"2024-05-08T10:55:31.979907+0000","last_became_peered":"2024-05-08T10:55:31.979907+0000","last_unstale":"2024-05-08T10:55:31.982950+0000","last_undegraded":"2024-05-08T10:55:31.982950+0000","last_fullsized":"2024-05-08T10:55:31.982950+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:41:08.704848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:55:32.967530+0000","last_change":"2024-05-08T10:55:31.978733+0000","last_active":"2024-05-08T10:55:32.967530+0000","last_peered":"2024-05-08T10:55:32.967530+0000","last_clean":"2024-05-08T10:55:32.967530+0000","last_became_active":"2024-05-08T10:55:31.978436+0000","last_became_peered":"2024-05-08T10:55:31.978436+0000","last_unstale":"2024-05-08T10:55:32.967530+0000","last_undegraded":"2024-05-08T10:55:32.967530+0000","last_fullsized":"2024-05-08T10:55:32.967530+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:41:08.704848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-08T10:55:31.988052+0000","last_change":"2024-05-08T10:55:31.982578+0000","last_active":"2024-05-08T10:55:31.988052+0000","last_peered":"2024-05-08T10:55:31.988052+0000","last_clean":"2024-05-08T10:55:31.988052+0000","last_became_active":"2024-05-08T10:55:31.982281+0000","last_became_peered":"2024-05-08T10:55:31.982281+0000","last_unstale":"2024-05-08T10:55:31.988052+0000","last_undegraded":"2024-05-08T10:55:31.988052+0000","last_fullsized":"2024-05-08T10:55:31.988052+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:12:44.119078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:55:32.964000+0000","last_change":"2024-05-08T10:55:31.978960+0000","last_active":"2024-05-08T10:55:32.964000+0000","last_peered":"2024-05-08T10:55:32.964000+0000","last_clean":"2024-05-08T10:55:32.964000+0000","last_became_active":"2024-05-08T10:55:31.978709+0000","last_became_peered":"2024-05-08T10:55:31.978709+0000","last_unstale":"2024-05-08T10:55:32.964000+0000","last_undegraded":"2024-05-08T10:55:32.964000+0000","last_fullsized":"2024-05-08T10:55:32.964000+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:27:14.269593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"30'4","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:55:32.967638+0000","last_change":"2024-05-08T10:55:30.972242+0000","last_active":"2024-05-08T10:55:32.967638+0000","last_peered":"2024-05-08T10:55:32.967638+0000","last_clean":"2024-05-08T10:55:32.967638+0000","last_became_active":"2024-05-08T10:55:30.971924+0000","last_became_peered":"2024-05-08T10:55:30.971924+0000","last_unstale":"2024-05-08T10:55:32.967638+0000","last_undegraded":"2024-05-08T10:55:32.967638+0000","last_fullsized":"2024-05-08T10:55:32.967638+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_clean_scrub_stamp":"2024-05-08T10:55:29.942582+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:16:20.054239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:55:32.967666+0000","last_change":"2024-05-08T10:55:31.976597+0000","last_active":"2024-05-08T10:55:32.967666+0000","last_peered":"2024-05-08T10:55:32.967666+0000","last_clean":"2024-05-08T10:55:32.967666+0000","last_became_active":"2024-05-08T10:55:31.975889+0000","last_became_peered":"2024-05-08T10:55:31.975889+0000","last_unstale":"2024-05-08T10:55:32.967666+0000","last_undegraded":"2024-05-08T10:55:32.967666+0000","last_fullsized":"2024-05-08T10:55:32.967666+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:42:55.846441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:55:32.964115+0000","last_change":"2024-05-08T10:55:30.966601+0000","last_active":"2024-05-08T10:55:32.964115+0000","last_peered":"2024-05-08T10:55:32.964115+0000","last_clean":"2024-05-08T10:55:32.964115+0000","last_became_active":"2024-05-08T10:55:30.966336+0000","last_became_peered":"2024-05-08T10:55:30.966336+0000","last_unstale":"2024-05-08T10:55:32.964115+0000","last_undegraded":"2024-05-08T10:55:32.964115+0000","last_fullsized":"2024-05-08T10:55:32.964115+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_clean_scrub_stamp":"2024-05-08T10:55:29.942582+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:56:13.033163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:55:32.968058+0000","last_change":"2024-05-08T10:55:31.992974+0000","last_active":"2024-05-08T10:55:32.968058+0000","last_peered":"2024-05-08T10:55:32.968058+0000","last_clean":"2024-05-08T10:55:32.968058+0000","last_became_active":"2024-05-08T10:55:31.992719+0000","last_became_peered":"2024-05-08T10:55:31.992719+0000","last_unstale":"2024-05-08T10:55:32.968058+0000","last_undegraded":"2024-05-08T10:55:32.968058+0000","last_fullsized":"2024-05-08T10:55:32.968058+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:57:31.319535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"30'2","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-08T10:55:31.997839+0000","last_change":"2024-05-08T10:55:30.970885+0000","last_active":"2024-05-08T10:55:31.997839+0000","last_peered":"2024-05-08T10:55:31.997839+0000","last_clean":"2024-05-08T10:55:31.997839+0000","last_became_active":"2024-05-08T10:55:30.970621+0000","last_became_peered":"2024-05-08T10:55:30.970621+0000","last_unstale":"2024-05-08T10:55:31.997839+0000","last_undegraded":"2024-05-08T10:55:31.997839+0000","last_fullsized":"2024-05-08T10:55:31.997839+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_clean_scrub_stamp":"2024-05-08T10:55:29.942582+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:42:54.841747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:55:33.211923+0000","last_change":"2024-05-08T10:55:31.978178+0000","last_active":"2024-05-08T10:55:33.211923+0000","last_peered":"2024-05-08T10:55:33.211923+0000","last_clean":"2024-05-08T10:55:33.211923+0000","last_became_active":"2024-05-08T10:55:31.977499+0000","last_became_peered":"2024-05-08T10:55:31.977499+0000","last_unstale":"2024-05-08T10:55:33.211923+0000","last_undegraded":"2024-05-08T10:55:33.211923+0000","last_fullsized":"2024-05-08T10:55:33.211923+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:59:19.363053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"30'2","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-08T10:55:31.989412+0000","last_change":"2024-05-08T10:55:30.964915+0000","last_active":"2024-05-08T10:55:31.989412+0000","last_peered":"2024-05-08T10:55:31.989412+0000","last_clean":"2024-05-08T10:55:31.989412+0000","last_became_active":"2024-05-08T10:55:30.964636+0000","last_became_peered":"2024-05-08T10:55:30.964636+0000","last_unstale":"2024-05-08T10:55:31.989412+0000","last_undegraded":"2024-05-08T10:55:31.989412+0000","last_fullsized":"2024-05-08T10:55:31.989412+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_clean_scrub_stamp":"2024-05-08T10:55:29.942582+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:34:57.616494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-08T10:55:31.986037+0000","last_change":"2024-05-08T10:55:31.980718+0000","last_active":"2024-05-08T10:55:31.986037+0000","last_peered":"2024-05-08T10:55:31.986037+0000","last_clean":"2024-05-08T10:55:31.986037+0000","last_became_active":"2024-05-08T10:55:31.980454+0000","last_became_peered":"2024-05-08T10:55:31.980454+0000","last_unstale":"2024-05-08T10:55:31.986037+0000","last_undegraded":"2024-05-08T10:55:31.986037+0000","last_fullsized":"2024-05-08T10:55:31.986037+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:42:55.846441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:55:32.968544+0000","last_change":"2024-05-08T10:55:30.971285+0000","last_active":"2024-05-08T10:55:32.968544+0000","last_peered":"2024-05-08T10:55:32.968544+0000","last_clean":"2024-05-08T10:55:32.968544+0000","last_became_active":"2024-05-08T10:55:30.970961+0000","last_became_peered":"2024-05-08T10:55:30.970961+0000","last_unstale":"2024-05-08T10:55:32.968544+0000","last_undegraded":"2024-05-08T10:55:32.968544+0000","last_fullsized":"2024-05-08T10:55:32.968544+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_clean_scrub_stamp":"2024-05-08T10:55:29.942582+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:08:46.518874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-08T10:55:31.979875+0000","last_change":"2024-05-08T10:55:31.977953+0000","last_active":"2024-05-08T10:55:31.979875+0000","last_peered":"2024-05-08T10:55:31.979875+0000","last_clean":"2024-05-08T10:55:31.979875+0000","last_became_active":"2024-05-08T10:55:31.977673+0000","last_became_peered":"2024-05-08T10:55:31.977673+0000","last_unstale":"2024-05-08T10:55:31.979875+0000","last_undegraded":"2024-05-08T10:55:31.979875+0000","last_fullsized":"2024-05-08T10:55:31.979875+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:27:14.269593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:55:32.968185+0000","last_change":"2024-05-08T10:55:30.971407+0000","last_active":"2024-05-08T10:55:32.968185+0000","last_peered":"2024-05-08T10:55:32.968185+0000","last_clean":"2024-05-08T10:55:32.968185+0000","last_became_active":"2024-05-08T10:55:30.971083+0000","last_became_peered":"2024-05-08T10:55:30.971083+0000","last_unstale":"2024-05-08T10:55:32.968185+0000","last_undegraded":"2024-05-08T10:55:32.968185+0000","last_fullsized":"2024-05-08T10:55:32.968185+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_clean_scrub_stamp":"2024-05-08T10:55:29.942582+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:37:12.171456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:55:32.968211+0000","last_change":"2024-05-08T10:55:31.974238+0000","last_active":"2024-05-08T10:55:32.968211+0000","last_peered":"2024-05-08T10:55:32.968211+0000","last_clean":"2024-05-08T10:55:32.968211+0000","last_became_active":"2024-05-08T10:55:31.973040+0000","last_became_peered":"2024-05-08T10:55:31.973040+0000","last_unstale":"2024-05-08T10:55:32.968211+0000","last_undegraded":"2024-05-08T10:55:32.968211+0000","last_fullsized":"2024-05-08T10:55:32.968211+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:41:08.704848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-08T10:55:31.976387+0000","last_change":"2024-05-08T10:55:30.969841+0000","last_active":"2024-05-08T10:55:31.976387+0000","last_peered":"2024-05-08T10:55:31.976387+0000","last_clean":"2024-05-08T10:55:31.976387+0000","last_became_active":"2024-05-08T10:55:30.969109+0000","last_became_peered":"2024-05-08T10:55:30.969109+0000","last_unstale":"2024-05-08T10:55:31.976387+0000","last_undegraded":"2024-05-08T10:55:31.976387+0000","last_fullsized":"2024-05-08T10:55:31.976387+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_clean_scrub_stamp":"2024-05-08T10:55:29.942582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:24:55.483556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:55:33.211488+0000","last_change":"2024-05-08T10:55:31.978924+0000","last_active":"2024-05-08T10:55:33.211488+0000","last_peered":"2024-05-08T10:55:33.211488+0000","last_clean":"2024-05-08T10:55:33.211488+0000","last_became_active":"2024-05-08T10:55:31.978691+0000","last_became_peered":"2024-05-08T10:55:31.978691+0000","last_unstale":"2024-05-08T10:55:33.211488+0000","last_undegraded":"2024-05-08T10:55:33.211488+0000","last_fullsized":"2024-05-08T10:55:33.211488+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:38:03.229028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:55:32.967945+0000","last_change":"2024-05-08T10:55:30.967214+0000","last_active":"2024-05-08T10:55:32.967945+0000","last_peered":"2024-05-08T10:55:32.967945+0000","last_clean":"2024-05-08T10:55:32.967945+0000","last_became_active":"2024-05-08T10:55:30.966910+0000","last_became_peered":"2024-05-08T10:55:30.966910+0000","last_unstale":"2024-05-08T10:55:32.967945+0000","last_undegraded":"2024-05-08T10:55:32.967945+0000","last_fullsized":"2024-05-08T10:55:32.967945+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_clean_scrub_stamp":"2024-05-08T10:55:29.942582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:35:04.069896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-08T10:55:31.996555+0000","last_change":"2024-05-08T10:55:31.991797+0000","last_active":"2024-05-08T10:55:31.996555+0000","last_peered":"2024-05-08T10:55:31.996555+0000","last_clean":"2024-05-08T10:55:31.996555+0000","last_became_active":"2024-05-08T10:55:31.991581+0000","last_became_peered":"2024-05-08T10:55:31.991581+0000","last_unstale":"2024-05-08T10:55:31.996555+0000","last_undegraded":"2024-05-08T10:55:31.996555+0000","last_fullsized":"2024-05-08T10:55:31.996555+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:59:19.363053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-08T10:55:31.988520+0000","last_change":"2024-05-08T10:55:30.969461+0000","last_active":"2024-05-08T10:55:31.988520+0000","last_peered":"2024-05-08T10:55:31.988520+0000","last_clean":"2024-05-08T10:55:31.988520+0000","last_became_active":"2024-05-08T10:55:30.969169+0000","last_became_peered":"2024-05-08T10:55:30.969169+0000","last_unstale":"2024-05-08T10:55:31.988520+0000","last_undegraded":"2024-05-08T10:55:31.988520+0000","last_fullsized":"2024-05-08T10:55:31.988520+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_clean_scrub_stamp":"2024-05-08T10:55:29.942582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:27:13.264899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-08T10:55:31.997891+0000","last_change":"2024-05-08T10:55:31.996170+0000","last_active":"2024-05-08T10:55:31.997891+0000","last_peered":"2024-05-08T10:55:31.997891+0000","last_clean":"2024-05-08T10:55:31.997891+0000","last_became_active":"2024-05-08T10:55:31.995838+0000","last_became_peered":"2024-05-08T10:55:31.995838+0000","last_unstale":"2024-05-08T10:55:31.997891+0000","last_undegraded":"2024-05-08T10:55:31.997891+0000","last_fullsized":"2024-05-08T10:55:31.997891+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:50:58.157369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:55:32.964101+0000","last_change":"2024-05-08T10:55:30.967650+0000","last_active":"2024-05-08T10:55:32.964101+0000","last_peered":"2024-05-08T10:55:32.964101+0000","last_clean":"2024-05-08T10:55:32.964101+0000","last_became_active":"2024-05-08T10:55:30.967358+0000","last_became_peered":"2024-05-08T10:55:30.967358+0000","last_unstale":"2024-05-08T10:55:32.964101+0000","last_undegraded":"2024-05-08T10:55:32.964101+0000","last_fullsized":"2024-05-08T10:55:32.964101+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_clean_scrub_stamp":"2024-05-08T10:55:29.942582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:56:32.022288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-08T10:55:31.993750+0000","last_change":"2024-05-08T10:55:31.989272+0000","last_active":"2024-05-08T10:55:31.993750+0000","last_peered":"2024-05-08T10:55:31.993750+0000","last_clean":"2024-05-08T10:55:31.993750+0000","last_became_active":"2024-05-08T10:55:31.988935+0000","last_became_peered":"2024-05-08T10:55:31.988935+0000","last_unstale":"2024-05-08T10:55:31.993750+0000","last_undegraded":"2024-05-08T10:55:31.993750+0000","last_fullsized":"2024-05-08T10:55:31.993750+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:38:03.229028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"30'3","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-08T10:55:31.994194+0000","last_change":"2024-05-08T10:55:30.967033+0000","last_active":"2024-05-08T10:55:31.994194+0000","last_peered":"2024-05-08T10:55:31.994194+0000","last_clean":"2024-05-08T10:55:31.994194+0000","last_became_active":"2024-05-08T10:55:30.966732+0000","last_became_peered":"2024-05-08T10:55:30.966732+0000","last_unstale":"2024-05-08T10:55:31.994194+0000","last_undegraded":"2024-05-08T10:55:31.994194+0000","last_fullsized":"2024-05-08T10:55:31.994194+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_clean_scrub_stamp":"2024-05-08T10:55:29.942582+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:42:54.841747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-08T10:55:31.990026+0000","last_change":"2024-05-08T10:55:31.986934+0000","last_active":"2024-05-08T10:55:31.990026+0000","last_peered":"2024-05-08T10:55:31.990026+0000","last_clean":"2024-05-08T10:55:31.990026+0000","last_became_active":"2024-05-08T10:55:31.986727+0000","last_became_peered":"2024-05-08T10:55:31.986727+0000","last_unstale":"2024-05-08T10:55:31.990026+0000","last_undegraded":"2024-05-08T10:55:31.990026+0000","last_fullsized":"2024-05-08T10:55:31.990026+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:09:15.928496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"30'6","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-08T10:55:32.001350+0000","last_change":"2024-05-08T10:55:30.970265+0000","last_active":"2024-05-08T10:55:32.001350+0000","last_peered":"2024-05-08T10:55:32.001350+0000","last_clean":"2024-05-08T10:55:32.001350+0000","last_became_active":"2024-05-08T10:55:30.969993+0000","last_became_peered":"2024-05-08T10:55:30.969993+0000","last_unstale":"2024-05-08T10:55:32.001350+0000","last_undegraded":"2024-05-08T10:55:32.001350+0000","last_fullsized":"2024-05-08T10:55:32.001350+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_clean_scrub_stamp":"2024-05-08T10:55:29.942582+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:12:43.114384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:55:33.211597+0000","last_change":"2024-05-08T10:55:31.979560+0000","last_active":"2024-05-08T10:55:33.211597+0000","last_peered":"2024-05-08T10:55:33.211597+0000","last_clean":"2024-05-08T10:55:33.211597+0000","last_became_active":"2024-05-08T10:55:31.979319+0000","last_became_peered":"2024-05-08T10:55:31.979319+0000","last_unstale":"2024-05-08T10:55:33.211597+0000","last_undegraded":"2024-05-08T10:55:33.211597+0000","last_fullsized":"2024-05-08T10:55:33.211597+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:36:15.119109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:55:32.968582+0000","last_change":"2024-05-08T10:55:30.969742+0000","last_active":"2024-05-08T10:55:32.968582+0000","last_peered":"2024-05-08T10:55:32.968582+0000","last_clean":"2024-05-08T10:55:32.968582+0000","last_became_active":"2024-05-08T10:55:30.969458+0000","last_became_peered":"2024-05-08T10:55:30.969458+0000","last_unstale":"2024-05-08T10:55:32.968582+0000","last_undegraded":"2024-05-08T10:55:32.968582+0000","last_fullsized":"2024-05-08T10:55:32.968582+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_clean_scrub_stamp":"2024-05-08T10:55:29.942582+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:29:32.015440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-08T10:55:31.994287+0000","last_change":"2024-05-08T10:55:31.991707+0000","last_active":"2024-05-08T10:55:31.994287+0000","last_peered":"2024-05-08T10:55:31.994287+0000","last_clean":"2024-05-08T10:55:31.994287+0000","last_became_active":"2024-05-08T10:55:31.989253+0000","last_became_peered":"2024-05-08T10:55:31.989253+0000","last_unstale":"2024-05-08T10:55:31.994287+0000","last_undegraded":"2024-05-08T10:55:31.994287+0000","last_fullsized":"2024-05-08T10:55:31.994287+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:59:19.363053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:55:33.211457+0000","last_change":"2024-05-08T10:55:30.968845+0000","last_active":"2024-05-08T10:55:33.211457+0000","last_peered":"2024-05-08T10:55:33.211457+0000","last_clean":"2024-05-08T10:55:33.211457+0000","last_became_active":"2024-05-08T10:55:30.968574+0000","last_became_peered":"2024-05-08T10:55:30.968574+0000","last_unstale":"2024-05-08T10:55:33.211457+0000","last_undegraded":"2024-05-08T10:55:33.211457+0000","last_fullsized":"2024-05-08T10:55:33.211457+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_clean_scrub_stamp":"2024-05-08T10:55:29.942582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:07:40.628169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-08T10:55:31.988064+0000","last_change":"2024-05-08T10:55:31.982655+0000","last_active":"2024-05-08T10:55:31.988064+0000","last_peered":"2024-05-08T10:55:31.988064+0000","last_clean":"2024-05-08T10:55:31.988064+0000","last_became_active":"2024-05-08T10:55:31.982412+0000","last_became_peered":"2024-05-08T10:55:31.982412+0000","last_unstale":"2024-05-08T10:55:31.988064+0000","last_undegraded":"2024-05-08T10:55:31.988064+0000","last_fullsized":"2024-05-08T10:55:31.988064+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:27:14.269593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-08T10:55:31.978967+0000","last_change":"2024-05-08T10:55:30.970076+0000","last_active":"2024-05-08T10:55:31.978967+0000","last_peered":"2024-05-08T10:55:31.978967+0000","last_clean":"2024-05-08T10:55:31.978967+0000","last_became_active":"2024-05-08T10:55:30.969542+0000","last_became_peered":"2024-05-08T10:55:30.969542+0000","last_unstale":"2024-05-08T10:55:31.978967+0000","last_undegraded":"2024-05-08T10:55:31.978967+0000","last_fullsized":"2024-05-08T10:55:31.978967+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_clean_scrub_stamp":"2024-05-08T10:55:29.942582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:47:45.591007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:55:32.967780+0000","last_change":"2024-05-08T10:55:31.975985+0000","last_active":"2024-05-08T10:55:32.967780+0000","last_peered":"2024-05-08T10:55:32.967780+0000","last_clean":"2024-05-08T10:55:32.967780+0000","last_became_active":"2024-05-08T10:55:31.974929+0000","last_became_peered":"2024-05-08T10:55:31.974929+0000","last_unstale":"2024-05-08T10:55:32.967780+0000","last_undegraded":"2024-05-08T10:55:32.967780+0000","last_fullsized":"2024-05-08T10:55:32.967780+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:12:44.119078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"30'8","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-08T10:55:31.997774+0000","last_change":"2024-05-08T10:55:30.969532+0000","last_active":"2024-05-08T10:55:31.997774+0000","last_peered":"2024-05-08T10:55:31.997774+0000","last_clean":"2024-05-08T10:55:31.997774+0000","last_became_active":"2024-05-08T10:55:30.969149+0000","last_became_peered":"2024-05-08T10:55:30.969149+0000","last_unstale":"2024-05-08T10:55:31.997774+0000","last_undegraded":"2024-05-08T10:55:31.997774+0000","last_fullsized":"2024-05-08T10:55:31.997774+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_clean_scrub_stamp":"2024-05-08T10:55:29.942582+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:57:30.314840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:55:32.968225+0000","last_change":"2024-05-08T10:55:31.980279+0000","last_active":"2024-05-08T10:55:32.968225+0000","last_peered":"2024-05-08T10:55:32.968225+0000","last_clean":"2024-05-08T10:55:32.968225+0000","last_became_active":"2024-05-08T10:55:31.980015+0000","last_became_peered":"2024-05-08T10:55:31.980015+0000","last_unstale":"2024-05-08T10:55:32.968225+0000","last_undegraded":"2024-05-08T10:55:32.968225+0000","last_fullsized":"2024-05-08T10:55:32.968225+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:42:55.846441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:55:33.212070+0000","last_change":"2024-05-08T10:55:30.971280+0000","last_active":"2024-05-08T10:55:33.212070+0000","last_peered":"2024-05-08T10:55:33.212070+0000","last_clean":"2024-05-08T10:55:33.212070+0000","last_became_active":"2024-05-08T10:55:30.971008+0000","last_became_peered":"2024-05-08T10:55:30.971008+0000","last_unstale":"2024-05-08T10:55:33.212070+0000","last_undegraded":"2024-05-08T10:55:33.212070+0000","last_fullsized":"2024-05-08T10:55:33.212070+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_clean_scrub_stamp":"2024-05-08T10:55:29.942582+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:56:13.033163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-08T10:55:31.983662+0000","last_change":"2024-05-08T10:55:31.980555+0000","last_active":"2024-05-08T10:55:31.983662+0000","last_peered":"2024-05-08T10:55:31.983662+0000","last_clean":"2024-05-08T10:55:31.983662+0000","last_became_active":"2024-05-08T10:55:31.979468+0000","last_became_peered":"2024-05-08T10:55:31.979468+0000","last_unstale":"2024-05-08T10:55:31.983662+0000","last_undegraded":"2024-05-08T10:55:31.983662+0000","last_fullsized":"2024-05-08T10:55:31.983662+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:23:02.622942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:55:32.968353+0000","last_change":"2024-05-08T10:55:30.967592+0000","last_active":"2024-05-08T10:55:32.968353+0000","last_peered":"2024-05-08T10:55:32.968353+0000","last_clean":"2024-05-08T10:55:32.968353+0000","last_became_active":"2024-05-08T10:55:30.967316+0000","last_became_peered":"2024-05-08T10:55:30.967316+0000","last_unstale":"2024-05-08T10:55:32.968353+0000","last_undegraded":"2024-05-08T10:55:32.968353+0000","last_fullsized":"2024-05-08T10:55:32.968353+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_clean_scrub_stamp":"2024-05-08T10:55:29.942582+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:36:34.036607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:55:33.211626+0000","last_change":"2024-05-08T10:55:31.977733+0000","last_active":"2024-05-08T10:55:33.211626+0000","last_peered":"2024-05-08T10:55:33.211626+0000","last_clean":"2024-05-08T10:55:33.211626+0000","last_became_active":"2024-05-08T10:55:31.977471+0000","last_became_peered":"2024-05-08T10:55:31.977471+0000","last_unstale":"2024-05-08T10:55:33.211626+0000","last_undegraded":"2024-05-08T10:55:33.211626+0000","last_fullsized":"2024-05-08T10:55:33.211626+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:52:02.128364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:55:32.968204+0000","last_change":"2024-05-08T10:55:30.965926+0000","last_active":"2024-05-08T10:55:32.968204+0000","last_peered":"2024-05-08T10:55:32.968204+0000","last_clean":"2024-05-08T10:55:32.968204+0000","last_became_active":"2024-05-08T10:55:30.965216+0000","last_became_peered":"2024-05-08T10:55:30.965216+0000","last_unstale":"2024-05-08T10:55:32.968204+0000","last_undegraded":"2024-05-08T10:55:32.968204+0000","last_fullsized":"2024-05-08T10:55:32.968204+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_clean_scrub_stamp":"2024-05-08T10:55:29.942582+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:18:34.186526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-08T10:55:31.987534+0000","last_change":"2024-05-08T10:55:31.982769+0000","last_active":"2024-05-08T10:55:31.987534+0000","last_peered":"2024-05-08T10:55:31.987534+0000","last_clean":"2024-05-08T10:55:31.987534+0000","last_became_active":"2024-05-08T10:55:31.982388+0000","last_became_peered":"2024-05-08T10:55:31.982388+0000","last_unstale":"2024-05-08T10:55:31.987534+0000","last_undegraded":"2024-05-08T10:55:31.987534+0000","last_fullsized":"2024-05-08T10:55:31.987534+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:20:50.057246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:55:32.968099+0000","last_change":"2024-05-08T10:55:30.968732+0000","last_active":"2024-05-08T10:55:32.968099+0000","last_peered":"2024-05-08T10:55:32.968099+0000","last_clean":"2024-05-08T10:55:32.968099+0000","last_became_active":"2024-05-08T10:55:30.968471+0000","last_became_peered":"2024-05-08T10:55:30.968471+0000","last_unstale":"2024-05-08T10:55:32.968099+0000","last_undegraded":"2024-05-08T10:55:32.968099+0000","last_fullsized":"2024-05-08T10:55:32.968099+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_clean_scrub_stamp":"2024-05-08T10:55:29.942582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:23:27.771830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-08T10:55:31.991302+0000","last_change":"2024-05-08T10:55:31.984230+0000","last_active":"2024-05-08T10:55:31.991302+0000","last_peered":"2024-05-08T10:55:31.991302+0000","last_clean":"2024-05-08T10:55:31.991302+0000","last_became_active":"2024-05-08T10:55:31.983977+0000","last_became_peered":"2024-05-08T10:55:31.983977+0000","last_unstale":"2024-05-08T10:55:31.991302+0000","last_undegraded":"2024-05-08T10:55:31.991302+0000","last_fullsized":"2024-05-08T10:55:31.991302+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:29:30.853874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:55:32.964132+0000","last_change":"2024-05-08T10:55:30.967852+0000","last_active":"2024-05-08T10:55:32.964132+0000","last_peered":"2024-05-08T10:55:32.964132+0000","last_clean":"2024-05-08T10:55:32.964132+0000","last_became_active":"2024-05-08T10:55:30.967577+0000","last_became_peered":"2024-05-08T10:55:30.967577+0000","last_unstale":"2024-05-08T10:55:32.964132+0000","last_undegraded":"2024-05-08T10:55:32.964132+0000","last_fullsized":"2024-05-08T10:55:32.964132+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_clean_scrub_stamp":"2024-05-08T10:55:29.942582+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:08:27.036086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-08T10:55:31.991336+0000","last_change":"2024-05-08T10:55:31.983585+0000","last_active":"2024-05-08T10:55:31.991336+0000","last_peered":"2024-05-08T10:55:31.991336+0000","last_clean":"2024-05-08T10:55:31.991336+0000","last_became_active":"2024-05-08T10:55:31.983312+0000","last_became_peered":"2024-05-08T10:55:31.983312+0000","last_unstale":"2024-05-08T10:55:31.991336+0000","last_undegraded":"2024-05-08T10:55:31.991336+0000","last_fullsized":"2024-05-08T10:55:31.991336+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:51:19.300646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:55:32.967461+0000","last_change":"2024-05-08T10:55:30.968065+0000","last_active":"2024-05-08T10:55:32.967461+0000","last_peered":"2024-05-08T10:55:32.967461+0000","last_clean":"2024-05-08T10:55:32.967461+0000","last_became_active":"2024-05-08T10:55:30.967793+0000","last_became_peered":"2024-05-08T10:55:30.967793+0000","last_unstale":"2024-05-08T10:55:32.967461+0000","last_undegraded":"2024-05-08T10:55:32.967461+0000","last_fullsized":"2024-05-08T10:55:32.967461+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_clean_scrub_stamp":"2024-05-08T10:55:29.942582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:05:27.784379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-08T10:55:31.992633+0000","last_change":"2024-05-08T10:55:31.987384+0000","last_active":"2024-05-08T10:55:31.992633+0000","last_peered":"2024-05-08T10:55:31.992633+0000","last_clean":"2024-05-08T10:55:31.992633+0000","last_became_active":"2024-05-08T10:55:31.987100+0000","last_became_peered":"2024-05-08T10:55:31.987100+0000","last_unstale":"2024-05-08T10:55:31.992633+0000","last_undegraded":"2024-05-08T10:55:31.992633+0000","last_fullsized":"2024-05-08T10:55:31.992633+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:18:35.191221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:55:32.968099+0000","last_change":"2024-05-08T10:55:30.972012+0000","last_active":"2024-05-08T10:55:32.968099+0000","last_peered":"2024-05-08T10:55:32.968099+0000","last_clean":"2024-05-08T10:55:32.968099+0000","last_became_active":"2024-05-08T10:55:30.971700+0000","last_became_peered":"2024-05-08T10:55:30.971700+0000","last_unstale":"2024-05-08T10:55:32.968099+0000","last_undegraded":"2024-05-08T10:55:32.968099+0000","last_fullsized":"2024-05-08T10:55:32.968099+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_clean_scrub_stamp":"2024-05-08T10:55:29.942582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:28:13.510616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-08T10:55:31.982914+0000","last_change":"2024-05-08T10:55:31.980168+0000","last_active":"2024-05-08T10:55:31.982914+0000","last_peered":"2024-05-08T10:55:31.982914+0000","last_clean":"2024-05-08T10:55:31.982914+0000","last_became_active":"2024-05-08T10:55:31.979850+0000","last_became_peered":"2024-05-08T10:55:31.979850+0000","last_unstale":"2024-05-08T10:55:31.982914+0000","last_undegraded":"2024-05-08T10:55:31.982914+0000","last_fullsized":"2024-05-08T10:55:31.982914+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:47:46.595701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-08T10:55:31.970785+0000","last_change":"2024-05-08T10:55:30.969793+0000","last_active":"2024-05-08T10:55:31.970785+0000","last_peered":"2024-05-08T10:55:31.970785+0000","last_clean":"2024-05-08T10:55:31.970785+0000","last_became_active":"2024-05-08T10:55:30.969422+0000","last_became_peered":"2024-05-08T10:55:30.969422+0000","last_unstale":"2024-05-08T10:55:31.970785+0000","last_undegraded":"2024-05-08T10:55:31.970785+0000","last_fullsized":"2024-05-08T10:55:31.970785+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_clean_scrub_stamp":"2024-05-08T10:55:29.942582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:47:45.591007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-08T10:55:31.987023+0000","last_change":"2024-05-08T10:55:31.982553+0000","last_active":"2024-05-08T10:55:31.987023+0000","last_peered":"2024-05-08T10:55:31.987023+0000","last_clean":"2024-05-08T10:55:31.987023+0000","last_became_active":"2024-05-08T10:55:31.982222+0000","last_became_peered":"2024-05-08T10:55:31.982222+0000","last_unstale":"2024-05-08T10:55:31.987023+0000","last_undegraded":"2024-05-08T10:55:31.987023+0000","last_fullsized":"2024-05-08T10:55:31.987023+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:14:50.313346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:55:33.212136+0000","last_change":"2024-05-08T10:55:30.970264+0000","last_active":"2024-05-08T10:55:33.212136+0000","last_peered":"2024-05-08T10:55:33.212136+0000","last_clean":"2024-05-08T10:55:33.212136+0000","last_became_active":"2024-05-08T10:55:30.969979+0000","last_became_peered":"2024-05-08T10:55:30.969979+0000","last_unstale":"2024-05-08T10:55:33.212136+0000","last_undegraded":"2024-05-08T10:55:33.212136+0000","last_fullsized":"2024-05-08T10:55:33.212136+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_clean_scrub_stamp":"2024-05-08T10:55:29.942582+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:16:20.054239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-08T10:55:31.988206+0000","last_change":"2024-05-08T10:55:31.986509+0000","last_active":"2024-05-08T10:55:31.988206+0000","last_peered":"2024-05-08T10:55:31.988206+0000","last_clean":"2024-05-08T10:55:31.988206+0000","last_became_active":"2024-05-08T10:55:31.986225+0000","last_became_peered":"2024-05-08T10:55:31.986225+0000","last_unstale":"2024-05-08T10:55:31.988206+0000","last_undegraded":"2024-05-08T10:55:31.988206+0000","last_fullsized":"2024-05-08T10:55:31.988206+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:36:15.119109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"31'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:55:33.976109+0000","last_change":"2024-05-08T10:55:30.962478+0000","last_active":"2024-05-08T10:55:33.976109+0000","last_peered":"2024-05-08T10:55:33.976109+0000","last_clean":"2024-05-08T10:55:33.976109+0000","last_became_active":"2024-05-08T10:55:30.962200+0000","last_became_peered":"2024-05-08T10:55:30.962200+0000","last_unstale":"2024-05-08T10:55:33.976109+0000","last_undegraded":"2024-05-08T10:55:33.976109+0000","last_fullsized":"2024-05-08T10:55:33.976109+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_clean_scrub_stamp":"2024-05-08T10:55:29.942582+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:08:10.479814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:55:32.963963+0000","last_change":"2024-05-08T10:55:31.973253+0000","last_active":"2024-05-08T10:55:32.963963+0000","last_peered":"2024-05-08T10:55:32.963963+0000","last_clean":"2024-05-08T10:55:32.963963+0000","last_became_active":"2024-05-08T10:55:31.972860+0000","last_became_peered":"2024-05-08T10:55:31.972860+0000","last_unstale":"2024-05-08T10:55:32.963963+0000","last_undegraded":"2024-05-08T10:55:32.963963+0000","last_fullsized":"2024-05-08T10:55:32.963963+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:12:44.119078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:55:33.211686+0000","last_change":"2024-05-08T10:55:30.964984+0000","last_active":"2024-05-08T10:55:33.211686+0000","last_peered":"2024-05-08T10:55:33.211686+0000","last_clean":"2024-05-08T10:55:33.211686+0000","last_became_active":"2024-05-08T10:55:30.964688+0000","last_became_peered":"2024-05-08T10:55:30.964688+0000","last_unstale":"2024-05-08T10:55:33.211686+0000","last_undegraded":"2024-05-08T10:55:33.211686+0000","last_fullsized":"2024-05-08T10:55:33.211686+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_clean_scrub_stamp":"2024-05-08T10:55:29.942582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:56:32.022288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:55:32.967471+0000","last_change":"2024-05-08T10:55:31.972921+0000","last_active":"2024-05-08T10:55:32.967471+0000","last_peered":"2024-05-08T10:55:32.967471+0000","last_clean":"2024-05-08T10:55:32.967471+0000","last_became_active":"2024-05-08T10:55:31.972615+0000","last_became_peered":"2024-05-08T10:55:31.972615+0000","last_unstale":"2024-05-08T10:55:32.967471+0000","last_undegraded":"2024-05-08T10:55:32.967471+0000","last_fullsized":"2024-05-08T10:55:32.967471+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:57:31.319535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:55:32.964231+0000","last_change":"2024-05-08T10:55:30.965561+0000","last_active":"2024-05-08T10:55:32.964231+0000","last_peered":"2024-05-08T10:55:32.964231+0000","last_clean":"2024-05-08T10:55:32.964231+0000","last_became_active":"2024-05-08T10:55:30.965293+0000","last_became_peered":"2024-05-08T10:55:30.965293+0000","last_unstale":"2024-05-08T10:55:32.964231+0000","last_undegraded":"2024-05-08T10:55:32.964231+0000","last_fullsized":"2024-05-08T10:55:32.964231+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_clean_scrub_stamp":"2024-05-08T10:55:29.942582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:07:40.628169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:55:32.964092+0000","last_change":"2024-05-08T10:55:31.975741+0000","last_active":"2024-05-08T10:55:32.964092+0000","last_peered":"2024-05-08T10:55:32.964092+0000","last_clean":"2024-05-08T10:55:32.964092+0000","last_became_active":"2024-05-08T10:55:31.975447+0000","last_became_peered":"2024-05-08T10:55:31.975447+0000","last_unstale":"2024-05-08T10:55:32.964092+0000","last_undegraded":"2024-05-08T10:55:32.964092+0000","last_fullsized":"2024-05-08T10:55:32.964092+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:02:15.212512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:55:33.211556+0000","last_change":"2024-05-08T10:55:30.970228+0000","last_active":"2024-05-08T10:55:33.211556+0000","last_peered":"2024-05-08T10:55:33.211556+0000","last_clean":"2024-05-08T10:55:33.211556+0000","last_became_active":"2024-05-08T10:55:30.969961+0000","last_became_peered":"2024-05-08T10:55:30.969961+0000","last_unstale":"2024-05-08T10:55:33.211556+0000","last_undegraded":"2024-05-08T10:55:33.211556+0000","last_fullsized":"2024-05-08T10:55:33.211556+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_clean_scrub_stamp":"2024-05-08T10:55:29.942582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:08:27.036086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-08T10:55:31.992219+0000","last_change":"2024-05-08T10:55:31.988966+0000","last_active":"2024-05-08T10:55:31.992219+0000","last_peered":"2024-05-08T10:55:31.992219+0000","last_clean":"2024-05-08T10:55:31.992219+0000","last_became_active":"2024-05-08T10:55:31.986644+0000","last_became_peered":"2024-05-08T10:55:31.986644+0000","last_unstale":"2024-05-08T10:55:31.992219+0000","last_undegraded":"2024-05-08T10:55:31.992219+0000","last_fullsized":"2024-05-08T10:55:31.992219+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:02:15.212512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:55:32.968368+0000","last_change":"2024-05-08T10:55:30.965221+0000","last_active":"2024-05-08T10:55:32.968368+0000","last_peered":"2024-05-08T10:55:32.968368+0000","last_clean":"2024-05-08T10:55:32.968368+0000","last_became_active":"2024-05-08T10:55:30.964939+0000","last_became_peered":"2024-05-08T10:55:30.964939+0000","last_unstale":"2024-05-08T10:55:32.968368+0000","last_undegraded":"2024-05-08T10:55:32.968368+0000","last_fullsized":"2024-05-08T10:55:32.968368+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_clean_scrub_stamp":"2024-05-08T10:55:29.942582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:49:36.250358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:55:32.967989+0000","last_change":"2024-05-08T10:55:31.993010+0000","last_active":"2024-05-08T10:55:32.967989+0000","last_peered":"2024-05-08T10:55:32.967989+0000","last_clean":"2024-05-08T10:55:32.967989+0000","last_became_active":"2024-05-08T10:55:31.992707+0000","last_became_peered":"2024-05-08T10:55:31.992707+0000","last_unstale":"2024-05-08T10:55:32.967989+0000","last_undegraded":"2024-05-08T10:55:32.967989+0000","last_fullsized":"2024-05-08T10:55:32.967989+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:24:56.488251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-08T10:55:31.976498+0000","last_change":"2024-05-08T10:55:30.965624+0000","last_active":"2024-05-08T10:55:31.976498+0000","last_peered":"2024-05-08T10:55:31.976498+0000","last_clean":"2024-05-08T10:55:31.976498+0000","last_became_active":"2024-05-08T10:55:30.965314+0000","last_became_peered":"2024-05-08T10:55:30.965314+0000","last_unstale":"2024-05-08T10:55:31.976498+0000","last_undegraded":"2024-05-08T10:55:31.976498+0000","last_fullsized":"2024-05-08T10:55:31.976498+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_clean_scrub_stamp":"2024-05-08T10:55:29.942582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:41:07.700154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-08T10:55:31.993938+0000","last_change":"2024-05-08T10:55:31.987465+0000","last_active":"2024-05-08T10:55:31.993938+0000","last_peered":"2024-05-08T10:55:31.993938+0000","last_clean":"2024-05-08T10:55:31.993938+0000","last_became_active":"2024-05-08T10:55:31.987171+0000","last_became_peered":"2024-05-08T10:55:31.987171+0000","last_unstale":"2024-05-08T10:55:31.993938+0000","last_undegraded":"2024-05-08T10:55:31.993938+0000","last_fullsized":"2024-05-08T10:55:31.993938+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:30.947276+0000","last_clean_scrub_stamp":"2024-05-08T10:55:30.947276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:23:02.622942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T10:55:32.967372+0000","last_change":"2024-05-08T10:55:30.974505+0000","last_active":"2024-05-08T10:55:32.967372+0000","last_peered":"2024-05-08T10:55:32.967372+0000","last_clean":"2024-05-08T10:55:32.967372+0000","last_became_active":"2024-05-08T10:55:30.974223+0000","last_became_peered":"2024-05-08T10:55:30.974223+0000","last_unstale":"2024-05-08T10:55:32.967372+0000","last_undegraded":"2024-05-08T10:55:32.967372+0000","last_fullsized":"2024-05-08T10:55:32.967372+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:55:29.942582+0000","last_clean_scrub_stamp":"2024-05-08T10:55:29.942582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:06:38.281420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":187,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-08T10:55:31.972121+0000","last_change":"2024-05-08T10:54:40.015226+0000","last_active":"2024-05-08T10:55:31.972121+0000","last_peered":"2024-05-08T10:55:31.972121+0000","last_clean":"2024-05-08T10:55:31.972121+0000","last_became_active":"2024-05-08T10:54:40.014219+0000","last_became_peered":"2024-05-08T10:54:40.014219+0000","last_unstale":"2024-05-08T10:55:31.972121+0000","last_undegraded":"2024-05-08T10:55:31.972121+0000","last_fullsized":"2024-05-08T10:55:31.972121+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:38.989328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:38.989328+0000","last_clean_scrub_stamp":"2024-05-08T10:54:38.989328+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:10:59.668786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343904,"statfs":{"total":96636764160,"available":96608157696,"internally_reserved":0,"allocated":933888,"data_stored":718284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":356352,"data_stored":134742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":344064,"data_stored":128498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":356352,"data_stored":134230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":352256,"data_stored":129460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":339968,"data_stored":127896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":352256,"data_stored":129460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27940,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343900,"statfs":{"total":96636764160,"available":96608153600,"internally_reserved":0,"allocated":942080,"data_stored":724494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T10:55:35.350 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-08T10:55:35.350 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-05-08T10:55:35.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.501+0000 7f1d8f83a640 1 Processor -- start 2024-05-08T10:55:35.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.501+0000 7f1d8f83a640 1 -- start start 2024-05-08T10:55:35.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.502+0000 7f1d8f83a640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1d880cc930 0x7f1d880b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:35.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.502+0000 7f1d8f83a640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1d880b39f0 0x7f1d88165950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:35.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.502+0000 7f1d8f83a640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d8815c440 con 0x7f1d881565c0 2024-05-08T10:55:35.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.502+0000 7f1d8f83a640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d880b3e40 con 0x7f1d880b39f0 2024-05-08T10:55:35.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.502+0000 7f1d8f83a640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d880b2ab0 con 0x7f1d880cc930 2024-05-08T10:55:35.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.502+0000 7f1d8cdd5640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1d880cc930 0x7f1d880b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:35.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.502+0000 7f1d8ddd7640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1d880b39f0 0x7f1d88165950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:35.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.502+0000 7f1d8d5d6640 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f1d881565c0 0x7f1d880cc220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.33:59334/0 (socket says 172.21.15.33:59334) 2024-05-08T10:55:35.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.502+0000 7f1d8ddd7640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1d880b39f0 0x7f1d88165950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.33:36748/0 (socket says 172.21.15.33:36748) 2024-05-08T10:55:35.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.502+0000 7f1d8d5d6640 1 -- 172.21.15.33:0/2724649049 learned_addr learned my addr 172.21.15.33:0/2724649049 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-05-08T10:55:35.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.502+0000 7f1d8cdd5640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1d880cc930 0x7f1d880b34b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.33:57786/0 (socket says 172.21.15.33:57786) 2024-05-08T10:55:35.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.503+0000 7f1d8ddd7640 1 -- 172.21.15.33:0/2724649049 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1d880cc930 msgr2=0x7f1d880b34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:35.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.503+0000 7f1d8ddd7640 1 --2- 172.21.15.33:0/2724649049 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1d880cc930 0x7f1d880b34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:35.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.503+0000 7f1d8ddd7640 1 -- 172.21.15.33:0/2724649049 >> v1:172.21.15.174:6789/0 conn(0x7f1d881565c0 legacy=0x7f1d880cc220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:35.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.503+0000 7f1d87fff640 1 -- 172.21.15.33:0/2724649049 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 471432568 0 0) 0x7f1d8815c440 con 0x7f1d881565c0 2024-05-08T10:55:35.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.503+0000 7f1d8ddd7640 1 -- 172.21.15.33:0/2724649049 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d8815c720 con 0x7f1d880b39f0 2024-05-08T10:55:35.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.504+0000 7f1d8ddd7640 1 --2- 172.21.15.33:0/2724649049 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1d880b39f0 0x7f1d88165950 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1d78009d90 tx=0x7f1d7802a5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e2f983594a708e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:35.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.504+0000 7f1d87fff640 1 -- 172.21.15.33:0/2724649049 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d78031600 con 0x7f1d880b39f0 2024-05-08T10:55:35.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.504+0000 7f1d87fff640 1 -- 172.21.15.33:0/2724649049 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d780317a0 con 0x7f1d880b39f0 2024-05-08T10:55:35.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.504+0000 7f1d87fff640 1 -- 172.21.15.33:0/2724649049 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d78031b70 con 0x7f1d880b39f0 2024-05-08T10:55:35.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.504+0000 7f1d8f83a640 1 -- 172.21.15.33:0/2724649049 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1d880b39f0 msgr2=0x7f1d88165950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:35.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.504+0000 7f1d8f83a640 1 --2- 172.21.15.33:0/2724649049 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1d880b39f0 0x7f1d88165950 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1d78009d90 tx=0x7f1d7802a5d0 comp rx=0 tx=0).stop 2024-05-08T10:55:35.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.504+0000 7f1d8f83a640 1 -- 172.21.15.33:0/2724649049 shutdown_connections 2024-05-08T10:55:35.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.504+0000 7f1d8f83a640 1 --2- 172.21.15.33:0/2724649049 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1d880b39f0 0x7f1d88165950 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:35.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.504+0000 7f1d8f83a640 1 --2- 172.21.15.33:0/2724649049 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1d880cc930 0x7f1d880b34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:35.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.504+0000 7f1d8f83a640 1 -- 172.21.15.33:0/2724649049 >> 172.21.15.33:0/2724649049 conn(0x7f1d880b1400 msgr2=0x7f1d880b1810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:35.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.504+0000 7f1d8f83a640 1 -- 172.21.15.33:0/2724649049 shutdown_connections 2024-05-08T10:55:35.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.504+0000 7f1d8f83a640 1 -- 172.21.15.33:0/2724649049 wait complete. 2024-05-08T10:55:35.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.506+0000 7f1d8f83a640 1 Processor -- start 2024-05-08T10:55:35.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.506+0000 7f1d8f83a640 1 -- start start 2024-05-08T10:55:35.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.506+0000 7f1d8f83a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1d880b39f0 0x7f1d881f0f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:35.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.506+0000 7f1d8f83a640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1d880cc930 0x7f1d881554c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:35.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.506+0000 7f1d8f83a640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1d881565c0 0x7f1d88155a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:35.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.506+0000 7f1d8f83a640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d8815d200 con 0x7f1d880b39f0 2024-05-08T10:55:35.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.506+0000 7f1d8f83a640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d8815cce0 con 0x7f1d880cc930 2024-05-08T10:55:35.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.506+0000 7f1d8f83a640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d880b4090 con 0x7f1d881565c0 2024-05-08T10:55:35.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.507+0000 7f1d8d5d6640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1d880b39f0 0x7f1d881f0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:35.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.507+0000 7f1d8d5d6640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1d880b39f0 0x7f1d881f0f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33964/0 (socket says 172.21.15.33:33964) 2024-05-08T10:55:35.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.507+0000 7f1d8d5d6640 1 -- 172.21.15.33:0/3110309494 learned_addr learned my addr 172.21.15.33:0/3110309494 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:35.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.507+0000 7f1d8ddd7640 1 --2- 172.21.15.33:0/3110309494 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1d881565c0 0x7f1d88155a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:35.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.507+0000 7f1d8cdd5640 1 --2- 172.21.15.33:0/3110309494 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1d880cc930 0x7f1d881554c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:35.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.507+0000 7f1d8d5d6640 1 -- 172.21.15.33:0/3110309494 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1d881565c0 msgr2=0x7f1d88155a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:35.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.507+0000 7f1d8d5d6640 1 --2- 172.21.15.33:0/3110309494 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1d881565c0 0x7f1d88155a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:35.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.507+0000 7f1d8d5d6640 1 -- 172.21.15.33:0/3110309494 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1d880cc930 msgr2=0x7f1d881554c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:35.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.507+0000 7f1d8d5d6640 1 --2- 172.21.15.33:0/3110309494 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1d880cc930 0x7f1d881554c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:35.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.507+0000 7f1d8d5d6640 1 -- 172.21.15.33:0/3110309494 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d88154130 con 0x7f1d880b39f0 2024-05-08T10:55:35.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.507+0000 7f1d8d5d6640 1 --2- 172.21.15.33:0/3110309494 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1d880b39f0 0x7f1d881f0f20 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f1d8000c430 tx=0x7f1d8000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:35.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.507+0000 7f1d85ffb640 1 -- 172.21.15.33:0/3110309494 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d800074e0 con 0x7f1d880b39f0 2024-05-08T10:55:35.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.507+0000 7f1d85ffb640 1 -- 172.21.15.33:0/3110309494 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d800047e0 con 0x7f1d880b39f0 2024-05-08T10:55:35.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.507+0000 7f1d85ffb640 1 -- 172.21.15.33:0/3110309494 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d80004bd0 con 0x7f1d880b39f0 2024-05-08T10:55:35.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.507+0000 7f1d8f83a640 1 -- 172.21.15.33:0/3110309494 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d88154410 con 0x7f1d880b39f0 2024-05-08T10:55:35.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.508+0000 7f1d8f83a640 1 -- 172.21.15.33:0/3110309494 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d881549d0 con 0x7f1d880b39f0 2024-05-08T10:55:35.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.509+0000 7f1d8f83a640 1 -- 172.21.15.33:0/3110309494 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d88154bd0 con 0x7f1d880b39f0 2024-05-08T10:55:35.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.509+0000 7f1d85ffb640 1 -- 172.21.15.33:0/3110309494 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1d80011070 con 0x7f1d880b39f0 2024-05-08T10:55:35.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.509+0000 7f1d85ffb640 1 --2- 172.21.15.33:0/3110309494 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f1d7406b4d0 0x7f1d7406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:35.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.509+0000 7f1d85ffb640 1 -- 172.21.15.33:0/3110309494 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1d80089ec0 con 0x7f1d880b39f0 2024-05-08T10:55:35.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.510+0000 7f1d8cdd5640 1 --2- 172.21.15.33:0/3110309494 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f1d7406b4d0 0x7f1d7406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:35.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.510+0000 7f1d8cdd5640 1 --2- 172.21.15.33:0/3110309494 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f1d7406b4d0 0x7f1d7406d990 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f1d8815f720 tx=0x7f1d7c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:35.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.513+0000 7f1d85ffb640 1 -- 172.21.15.33:0/3110309494 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1d80058d40 con 0x7f1d880b39f0 2024-05-08T10:55:35.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.763+0000 7f1d8f83a640 1 -- 172.21.15.33:0/3110309494 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f1d88069d20 con 0x7f1d880b39f0 2024-05-08T10:55:35.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.765+0000 7f1d85ffb640 1 -- 172.21.15.33:0/3110309494 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+147 (secure 0 0 0) 0x7f1d80058640 con 0x7f1d880b39f0 2024-05-08T10:55:35.762 INFO:teuthology.orchestra.run.smithi033.stdout:[client.0] 2024-05-08T10:55:35.763 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQDBWTtmiYY5HBAAoTHjrWKd55wAZZl3OfJ2Zw== 2024-05-08T10:55:35.763 INFO:teuthology.orchestra.run.smithi033.stdout: caps mds = "allow" 2024-05-08T10:55:35.763 INFO:teuthology.orchestra.run.smithi033.stdout: caps mon = "allow r" 2024-05-08T10:55:35.763 INFO:teuthology.orchestra.run.smithi033.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-05-08T10:55:35.763 INFO:teuthology.orchestra.run.smithi033.stderr:updated caps for client.0 2024-05-08T10:55:35.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.767+0000 7f1d8f83a640 1 -- 172.21.15.33:0/3110309494 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f1d7406b4d0 msgr2=0x7f1d7406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:35.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.767+0000 7f1d8f83a640 1 --2- 172.21.15.33:0/3110309494 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f1d7406b4d0 0x7f1d7406d990 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f1d8815f720 tx=0x7f1d7c008040 comp rx=0 tx=0).stop 2024-05-08T10:55:35.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.767+0000 7f1d8f83a640 1 -- 172.21.15.33:0/3110309494 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1d880b39f0 msgr2=0x7f1d881f0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:35.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.767+0000 7f1d8f83a640 1 --2- 172.21.15.33:0/3110309494 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1d880b39f0 0x7f1d881f0f20 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f1d8000c430 tx=0x7f1d8000c8f0 comp rx=0 tx=0).stop 2024-05-08T10:55:35.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.767+0000 7f1d8f83a640 1 -- 172.21.15.33:0/3110309494 shutdown_connections 2024-05-08T10:55:35.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.767+0000 7f1d8f83a640 1 --2- 172.21.15.33:0/3110309494 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f1d7406b4d0 0x7f1d7406d990 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:35.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.767+0000 7f1d8f83a640 1 --2- 172.21.15.33:0/3110309494 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1d881565c0 0x7f1d88155a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:35.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.767+0000 7f1d8f83a640 1 --2- 172.21.15.33:0/3110309494 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1d880cc930 0x7f1d881554c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:35.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.767+0000 7f1d8f83a640 1 --2- 172.21.15.33:0/3110309494 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1d880b39f0 0x7f1d881f0f20 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:35.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.767+0000 7f1d8f83a640 1 -- 172.21.15.33:0/3110309494 >> 172.21.15.33:0/3110309494 conn(0x7f1d880b1400 msgr2=0x7f1d88072140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:35.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.767+0000 7f1d8f83a640 1 -- 172.21.15.33:0/3110309494 shutdown_connections 2024-05-08T10:55:35.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.767+0000 7f1d8f83a640 1 -- 172.21.15.33:0/3110309494 wait complete. 2024-05-08T10:55:35.776 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T10:55:35.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.883+0000 7f2f14d34640 1 Processor -- start 2024-05-08T10:55:35.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.883+0000 7f2f14d34640 1 -- start start 2024-05-08T10:55:35.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.884+0000 7f2f14d34640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f2f100d0920 0x7f2f1015e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:35.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.884+0000 7f2f14d34640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f100d4910 con 0x7f2f100b4c60 2024-05-08T10:55:35.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.884+0000 7f2f14d34640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f100d25e0 con 0x7f2f100d0540 2024-05-08T10:55:35.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.884+0000 7f2f14d34640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f100d46c0 con 0x7f2f100d0920 2024-05-08T10:55:35.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.884+0000 7f2f0ed9d640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f2f100b4c60 0x7f2f100ce7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:55440/0 (socket says 172.21.15.33:55440) 2024-05-08T10:55:35.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.884+0000 7f2f0ed9d640 1 -- 172.21.15.33:0/998817395 learned_addr learned my addr 172.21.15.33:0/998817395 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-05-08T10:55:35.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.884+0000 7f2f07fff640 1 --2- 172.21.15.33:0/998817395 >> v2:172.21.15.174:3300/0 conn(0x7f2f100d0920 0x7f2f1015e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:35.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.884+0000 7f2f0dd9b640 1 -- 172.21.15.33:0/998817395 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1198323644 0 0) 0x7f2f100d4910 con 0x7f2f100b4c60 2024-05-08T10:55:35.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.884+0000 7f2f0dd9b640 1 -- 172.21.15.33:0/998817395 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2efc003520 con 0x7f2f100b4c60 2024-05-08T10:55:35.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.884+0000 7f2f07fff640 1 -- 172.21.15.33:0/998817395 >> v1:172.21.15.174:6789/0 conn(0x7f2f100d0540 legacy=0x7f2f1015dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:35.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.884+0000 7f2f0dd9b640 1 -- 172.21.15.33:0/998817395 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 455766525 0 0) 0x7f2f100d25e0 con 0x7f2f100d0540 2024-05-08T10:55:35.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.884+0000 7f2f07fff640 1 -- 172.21.15.33:0/998817395 >> v1:172.21.15.33:6789/0 conn(0x7f2f100b4c60 legacy=0x7f2f100ce7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:35.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.884+0000 7f2f07fff640 1 -- 172.21.15.33:0/998817395 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f100b4730 con 0x7f2f100d0920 2024-05-08T10:55:35.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.885+0000 7f2f07fff640 1 --2- 172.21.15.33:0/998817395 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2f100d0920 0x7f2f1015e2e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2ef80097a0 tx=0x7f2ef802a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ebc9866c482df15 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:35.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.885+0000 7f2f0dd9b640 1 -- 172.21.15.33:0/998817395 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef8037070 con 0x7f2f100d0920 2024-05-08T10:55:35.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.885+0000 7f2f0dd9b640 1 -- 172.21.15.33:0/998817395 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ef8032440 con 0x7f2f100d0920 2024-05-08T10:55:35.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.885+0000 7f2f0dd9b640 1 -- 172.21.15.33:0/998817395 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef802ae60 con 0x7f2f100d0920 2024-05-08T10:55:35.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.886+0000 7f2f14d34640 1 -- 172.21.15.33:0/998817395 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2f100d0920 msgr2=0x7f2f1015e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:35.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.886+0000 7f2f14d34640 1 --2- 172.21.15.33:0/998817395 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2f100d0920 0x7f2f1015e2e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2ef80097a0 tx=0x7f2ef802a110 comp rx=0 tx=0).stop 2024-05-08T10:55:35.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.886+0000 7f2f14d34640 1 -- 172.21.15.33:0/998817395 shutdown_connections 2024-05-08T10:55:35.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.886+0000 7f2f14d34640 1 --2- 172.21.15.33:0/998817395 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2f100d0920 0x7f2f1015e2e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:35.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.886+0000 7f2f14d34640 1 -- 172.21.15.33:0/998817395 >> 172.21.15.33:0/998817395 conn(0x7f2f100d3ba0 msgr2=0x7f2f100d3fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:35.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.886+0000 7f2f14d34640 1 -- 172.21.15.33:0/998817395 shutdown_connections 2024-05-08T10:55:35.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.886+0000 7f2f14d34640 1 -- 172.21.15.33:0/998817395 wait complete. 2024-05-08T10:55:35.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.887+0000 7f2f14d34640 1 Processor -- start 2024-05-08T10:55:35.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.887+0000 7f2f14d34640 1 -- start start 2024-05-08T10:55:35.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.888+0000 7f2f14d34640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2f100b4c60 0x7f2f10151110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:35.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.888+0000 7f2f14d34640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2f100d0540 0x7f2f100cac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:35.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.888+0000 7f2f14d34640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2f100d0920 0x7f2f100cce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:35.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.888+0000 7f2f14d34640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f100d2950 con 0x7f2f100d0920 2024-05-08T10:55:35.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.888+0000 7f2f14d34640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f100d2390 con 0x7f2f100b4c60 2024-05-08T10:55:35.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.888+0000 7f2f14d34640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f100ceec0 con 0x7f2f100d0540 2024-05-08T10:55:35.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.888+0000 7f2f0ed9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2f100d0920 0x7f2f100cce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:35.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.888+0000 7f2f0ed9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2f100d0920 0x7f2f100cce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56276/0 (socket says 172.21.15.33:56276) 2024-05-08T10:55:35.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.888+0000 7f2f0ed9d640 1 -- 172.21.15.33:0/2162356159 learned_addr learned my addr 172.21.15.33:0/2162356159 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:35.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.888+0000 7f2f07fff640 1 --2- 172.21.15.33:0/2162356159 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2f100d0540 0x7f2f100cac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:35.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.888+0000 7f2f0e59c640 1 --2- 172.21.15.33:0/2162356159 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2f100b4c60 0x7f2f10151110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:35.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.889+0000 7f2f0ed9d640 1 -- 172.21.15.33:0/2162356159 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2f100d0540 msgr2=0x7f2f100cac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:35.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.889+0000 7f2f0ed9d640 1 --2- 172.21.15.33:0/2162356159 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2f100d0540 0x7f2f100cac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:35.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.889+0000 7f2f0ed9d640 1 -- 172.21.15.33:0/2162356159 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2f100b4c60 msgr2=0x7f2f10151110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:35.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.889+0000 7f2f0ed9d640 1 --2- 172.21.15.33:0/2162356159 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2f100b4c60 0x7f2f10151110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:35.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.889+0000 7f2f0ed9d640 1 -- 172.21.15.33:0/2162356159 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f100cb5e0 con 0x7f2f100d0920 2024-05-08T10:55:35.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.889+0000 7f2f0ed9d640 1 --2- 172.21.15.33:0/2162356159 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2f100d0920 0x7f2f100cce10 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f2f0800cb40 tx=0x7f2f0800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:35.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.889+0000 7f2f06ffd640 1 -- 172.21.15.33:0/2162356159 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f08017070 con 0x7f2f100d0920 2024-05-08T10:55:35.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.889+0000 7f2f06ffd640 1 -- 172.21.15.33:0/2162356159 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f0800aca0 con 0x7f2f100d0920 2024-05-08T10:55:35.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.889+0000 7f2f14d34640 1 -- 172.21.15.33:0/2162356159 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f100cb8c0 con 0x7f2f100d0920 2024-05-08T10:55:35.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.889+0000 7f2f06ffd640 1 -- 172.21.15.33:0/2162356159 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f08012620 con 0x7f2f100d0920 2024-05-08T10:55:35.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.889+0000 7f2f14d34640 1 -- 172.21.15.33:0/2162356159 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f100cbe80 con 0x7f2f100d0920 2024-05-08T10:55:35.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.890+0000 7f2f14d34640 1 -- 172.21.15.33:0/2162356159 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f10067440 con 0x7f2f100d0920 2024-05-08T10:55:35.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.890+0000 7f2f06ffd640 1 -- 172.21.15.33:0/2162356159 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2f0801a070 con 0x7f2f100d0920 2024-05-08T10:55:35.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.891+0000 7f2f06ffd640 1 --2- 172.21.15.33:0/2162356159 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f2ef006b4d0 0x7f2ef006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:35.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.891+0000 7f2f06ffd640 1 -- 172.21.15.33:0/2162356159 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2f0808a000 con 0x7f2f100d0920 2024-05-08T10:55:35.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.891+0000 7f2f0e59c640 1 --2- 172.21.15.33:0/2162356159 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f2ef006b4d0 0x7f2ef006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:35.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.891+0000 7f2f0e59c640 1 --2- 172.21.15.33:0/2162356159 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f2ef006b4d0 0x7f2ef006d990 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2f00000f60 tx=0x7f2f00009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:35.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:35.895+0000 7f2f06ffd640 1 -- 172.21.15.33:0/2162356159 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2f08058f10 con 0x7f2f100d0920 2024-05-08T10:55:36.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.113+0000 7f2f14d34640 1 -- 172.21.15.33:0/2162356159 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2f10069d20 con 0x7f2f100d0920 2024-05-08T10:55:36.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.114+0000 7f2f06ffd640 1 -- 172.21.15.33:0/2162356159 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4941 (secure 0 0 0) 0x7f2f08058810 con 0x7f2f100d0920 2024-05-08T10:55:36.111 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:55:36.112 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4592,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6836/2731663891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2731663891},{"type":"v1","addr":"172.21.15.174:6836","nonce":2731663891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":4598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/2004985147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6833","nonce":2004985147},{"type":"v1","addr":"172.21.15.33:6835","nonce":2004985147}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4702,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6837/3164144740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6835","nonce":3164144740},{"type":"v1","addr":"172.21.15.174:6837","nonce":3164144740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T10:55:31.311811+0000","modified":"2024-05-08T10:55:33.333600+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4708},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4708":{"gid":4708,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.33:6834/415400390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":415400390},{"type":"v1","addr":"172.21.15.33:6834","nonce":415400390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-05-08T10:55:36.112 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 14 2024-05-08T10:55:36.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.116+0000 7f2f14d34640 1 -- 172.21.15.33:0/2162356159 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f2ef006b4d0 msgr2=0x7f2ef006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:36.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.116+0000 7f2f14d34640 1 --2- 172.21.15.33:0/2162356159 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f2ef006b4d0 0x7f2ef006d990 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2f00000f60 tx=0x7f2f00009040 comp rx=0 tx=0).stop 2024-05-08T10:55:36.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.116+0000 7f2f14d34640 1 -- 172.21.15.33:0/2162356159 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2f100d0920 msgr2=0x7f2f100cce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:36.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.116+0000 7f2f14d34640 1 --2- 172.21.15.33:0/2162356159 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2f100d0920 0x7f2f100cce10 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f2f0800cb40 tx=0x7f2f0800a060 comp rx=0 tx=0).stop 2024-05-08T10:55:36.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.116+0000 7f2f14d34640 1 -- 172.21.15.33:0/2162356159 shutdown_connections 2024-05-08T10:55:36.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.116+0000 7f2f14d34640 1 --2- 172.21.15.33:0/2162356159 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f2ef006b4d0 0x7f2ef006d990 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:36.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.116+0000 7f2f14d34640 1 --2- 172.21.15.33:0/2162356159 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2f100d0920 0x7f2f100cce10 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:36.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.116+0000 7f2f14d34640 1 --2- 172.21.15.33:0/2162356159 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2f100d0540 0x7f2f100cac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:36.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.116+0000 7f2f14d34640 1 --2- 172.21.15.33:0/2162356159 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2f100b4c60 0x7f2f10151110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:36.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.116+0000 7f2f14d34640 1 -- 172.21.15.33:0/2162356159 >> 172.21.15.33:0/2162356159 conn(0x7f2f100d3ba0 msgr2=0x7f2f100d3f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:36.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.116+0000 7f2f14d34640 1 -- 172.21.15.33:0/2162356159 shutdown_connections 2024-05-08T10:55:36.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.116+0000 7f2f14d34640 1 -- 172.21.15.33:0/2162356159 wait complete. 2024-05-08T10:55:36.527 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 14, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-08T10:55:31.311811+0000', 'modified': '2024-05-08T10:55:33.333600+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4708}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4708': {'gid': 4708, 'name': 'c', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.33:6834/415400390', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.33:6832', 'nonce': 415400390}, {'type': 'v1', 'addr': '172.21.15.33:6834', 'nonce': 415400390}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-05-08T10:55:36.527 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-08T10:55:36.527 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-05-08T10:55:36.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.637+0000 7f0e9663f640 1 Processor -- start 2024-05-08T10:55:36.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.637+0000 7f0e9663f640 1 -- start start 2024-05-08T10:55:36.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.638+0000 7f0e9663f640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f0e90144630 0x7f0e900b35d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:36.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.638+0000 7f0e9663f640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f0e900d04d0 0x7f0e9015cd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:36.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.638+0000 7f0e9663f640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e900b4140 con 0x7f0e900b3b10 2024-05-08T10:55:36.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.638+0000 7f0e9663f640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e9015c330 con 0x7f0e90144630 2024-05-08T10:55:36.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.638+0000 7f0e9663f640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e900b4420 con 0x7f0e900d04d0 2024-05-08T10:55:36.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.638+0000 7f0e8ffff640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f0e90144630 0x7f0e900b35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:36.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.638+0000 7f0e8f7fe640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f0e900b3b10 0x7f0e900cfdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:55456/0 (socket says 172.21.15.33:55456) 2024-05-08T10:55:36.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.638+0000 7f0e8f7fe640 1 -- 172.21.15.33:0/2690008719 learned_addr learned my addr 172.21.15.33:0/2690008719 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-05-08T10:55:36.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.638+0000 7f0e94bdc640 1 --2- 172.21.15.33:0/2690008719 >> v2:172.21.15.174:3300/0 conn(0x7f0e900d04d0 0x7f0e9015cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:36.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.638+0000 7f0e8ffff640 1 -- 172.21.15.33:0/2690008719 >> v2:172.21.15.174:3300/0 conn(0x7f0e900d04d0 msgr2=0x7f0e9015cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:36.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.638+0000 7f0e8ffff640 1 --2- 172.21.15.33:0/2690008719 >> v2:172.21.15.174:3300/0 conn(0x7f0e900d04d0 0x7f0e9015cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:36.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.638+0000 7f0e8ffff640 1 -- 172.21.15.33:0/2690008719 >> v1:172.21.15.33:6789/0 conn(0x7f0e900b3b10 legacy=0x7f0e900cfdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:36.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.638+0000 7f0e8ffff640 1 -- 172.21.15.33:0/2690008719 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e9015c580 con 0x7f0e90144630 2024-05-08T10:55:36.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.638+0000 7f0e8effd640 1 -- 172.21.15.33:0/2690008719 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4183760373 0 0) 0x7f0e900b4140 con 0x7f0e900b3b10 2024-05-08T10:55:36.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.639+0000 7f0e8ffff640 1 --2- 172.21.15.33:0/2690008719 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e90144630 0x7f0e900b35d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f0e800097a0 tx=0x7f0e8002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8403ab9989e179d4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:36.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.639+0000 7f0e8effd640 1 -- 172.21.15.33:0/2690008719 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e80037070 con 0x7f0e90144630 2024-05-08T10:55:36.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.639+0000 7f0e8effd640 1 -- 172.21.15.33:0/2690008719 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e80032440 con 0x7f0e90144630 2024-05-08T10:55:36.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.639+0000 7f0e8effd640 1 -- 172.21.15.33:0/2690008719 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e80032810 con 0x7f0e90144630 2024-05-08T10:55:36.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.640+0000 7f0e9663f640 1 -- 172.21.15.33:0/2690008719 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e90144630 msgr2=0x7f0e900b35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:36.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.640+0000 7f0e9663f640 1 --2- 172.21.15.33:0/2690008719 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e90144630 0x7f0e900b35d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f0e800097a0 tx=0x7f0e8002a1e0 comp rx=0 tx=0).stop 2024-05-08T10:55:36.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.640+0000 7f0e9663f640 1 -- 172.21.15.33:0/2690008719 shutdown_connections 2024-05-08T10:55:36.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.640+0000 7f0e9663f640 1 --2- 172.21.15.33:0/2690008719 >> v2:172.21.15.174:3300/0 conn(0x7f0e900d04d0 0x7f0e9015cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:36.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.640+0000 7f0e9663f640 1 --2- 172.21.15.33:0/2690008719 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e90144630 0x7f0e900b35d0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:36.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.640+0000 7f0e9663f640 1 -- 172.21.15.33:0/2690008719 >> 172.21.15.33:0/2690008719 conn(0x7f0e9006afc0 msgr2=0x7f0e9006b3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:36.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.640+0000 7f0e9663f640 1 -- 172.21.15.33:0/2690008719 shutdown_connections 2024-05-08T10:55:36.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.640+0000 7f0e9663f640 1 -- 172.21.15.33:0/2690008719 wait complete. 2024-05-08T10:55:36.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.641+0000 7f0e9663f640 1 Processor -- start 2024-05-08T10:55:36.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.641+0000 7f0e9663f640 1 -- start start 2024-05-08T10:55:36.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.642+0000 7f0e9663f640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e900b3b10 0x7f0e901f6950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:36.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.642+0000 7f0e9663f640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0e900d04d0 0x7f0e900ae840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:36.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.642+0000 7f0e9663f640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0e90144630 0x7f0e900cce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:36.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.642+0000 7f0e9663f640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e9015d2c0 con 0x7f0e900b3b10 2024-05-08T10:55:36.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.642+0000 7f0e9663f640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e900b2be0 con 0x7f0e90144630 2024-05-08T10:55:36.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.642+0000 7f0e9663f640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e9015d440 con 0x7f0e900d04d0 2024-05-08T10:55:36.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.642+0000 7f0e8ffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e900b3b10 0x7f0e901f6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:36.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.642+0000 7f0e8ffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e900b3b10 0x7f0e901f6950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56294/0 (socket says 172.21.15.33:56294) 2024-05-08T10:55:36.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.642+0000 7f0e8ffff640 1 -- 172.21.15.33:0/1107639975 learned_addr learned my addr 172.21.15.33:0/1107639975 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:36.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.642+0000 7f0e94bdc640 1 --2- 172.21.15.33:0/1107639975 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0e90144630 0x7f0e900cce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:36.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.642+0000 7f0e8f7fe640 1 --2- 172.21.15.33:0/1107639975 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0e900d04d0 0x7f0e900ae840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:36.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.642+0000 7f0e8ffff640 1 -- 172.21.15.33:0/1107639975 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0e900d04d0 msgr2=0x7f0e900ae840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:36.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.642+0000 7f0e8ffff640 1 --2- 172.21.15.33:0/1107639975 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0e900d04d0 0x7f0e900ae840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:36.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.642+0000 7f0e8ffff640 1 -- 172.21.15.33:0/1107639975 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0e90144630 msgr2=0x7f0e900cce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:36.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.642+0000 7f0e8ffff640 1 --2- 172.21.15.33:0/1107639975 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0e90144630 0x7f0e900cce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:36.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.642+0000 7f0e8ffff640 1 -- 172.21.15.33:0/1107639975 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e900cd3a0 con 0x7f0e900b3b10 2024-05-08T10:55:36.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.642+0000 7f0e94bdc640 1 --2- 172.21.15.33:0/1107639975 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0e90144630 0x7f0e900cce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:55:36.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.642+0000 7f0e8ffff640 1 --2- 172.21.15.33:0/1107639975 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e900b3b10 0x7f0e901f6950 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f0e80000c00 tx=0x7f0e800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:36.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.643+0000 7f0e8cff9640 1 -- 172.21.15.33:0/1107639975 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e80037040 con 0x7f0e900b3b10 2024-05-08T10:55:36.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.643+0000 7f0e8cff9640 1 -- 172.21.15.33:0/1107639975 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e80042070 con 0x7f0e900b3b10 2024-05-08T10:55:36.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.643+0000 7f0e8cff9640 1 -- 172.21.15.33:0/1107639975 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e80030bb0 con 0x7f0e900b3b10 2024-05-08T10:55:36.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.643+0000 7f0e9663f640 1 -- 172.21.15.33:0/1107639975 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e900cd640 con 0x7f0e900b3b10 2024-05-08T10:55:36.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.643+0000 7f0e9663f640 1 -- 172.21.15.33:0/1107639975 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e900cdc00 con 0x7f0e900b3b10 2024-05-08T10:55:36.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.645+0000 7f0e8cff9640 1 -- 172.21.15.33:0/1107639975 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0e80047460 con 0x7f0e900b3b10 2024-05-08T10:55:36.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.645+0000 7f0e8cff9640 1 --2- 172.21.15.33:0/1107639975 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f0e7c06b4d0 0x7f0e7c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:36.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.645+0000 7f0e8cff9640 1 -- 172.21.15.33:0/1107639975 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0e800aad20 con 0x7f0e900b3b10 2024-05-08T10:55:36.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.645+0000 7f0e8f7fe640 1 --2- 172.21.15.33:0/1107639975 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f0e7c06b4d0 0x7f0e7c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:36.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.646+0000 7f0e99428740 1 Processor -- start 2024-05-08T10:55:36.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.646+0000 7f0e99428740 1 -- start start 2024-05-08T10:55:36.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.646+0000 7f0e8f7fe640 1 --2- 172.21.15.33:0/1107639975 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f0e7c06b4d0 0x7f0e7c06d990 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f0e901f6e90 tx=0x7f0e84007b50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:36.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.647+0000 7f0e99428740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5629b5682030 0x5629b56598a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:36.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.647+0000 7f0e99428740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5629b5682410 0x5629b565e820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:36.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.647+0000 7f0e99428740 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x5629b565ed60 0x5629b565f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:36.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.647+0000 7f0e99428740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629b55c2830 con 0x5629b5682030 2024-05-08T10:55:36.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.647+0000 7f0e99428740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629b556bbe0 con 0x5629b5682410 2024-05-08T10:55:36.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.647+0000 7f0e99428740 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x5629b55be8d0 con 0x5629b565ed60 2024-05-08T10:55:36.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.647+0000 7f0e8ffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5629b5682030 0x5629b56598a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:36.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.647+0000 7f0e8ffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5629b5682030 0x5629b56598a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56308/0 (socket says 172.21.15.33:56308) 2024-05-08T10:55:36.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.647+0000 7f0e8ffff640 1 -- 172.21.15.33:0/318543387 learned_addr learned my addr 172.21.15.33:0/318543387 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:36.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.647+0000 7f0e8f7fe640 1 --2- 172.21.15.33:0/318543387 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5629b5682410 0x5629b565e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:36.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.647+0000 7f0e94bdc640 1 --2- 172.21.15.33:0/318543387 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x5629b565ed60 0x5629b565f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:36.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.647+0000 7f0e8ffff640 1 -- 172.21.15.33:0/318543387 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x5629b565ed60 msgr2=0x5629b565f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:36.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.647+0000 7f0e8ffff640 1 --2- 172.21.15.33:0/318543387 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x5629b565ed60 0x5629b565f1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:36.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.647+0000 7f0e8ffff640 1 -- 172.21.15.33:0/318543387 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5629b5682410 msgr2=0x5629b565e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:36.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.647+0000 7f0e8ffff640 1 --2- 172.21.15.33:0/318543387 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5629b5682410 0x5629b565e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:36.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.647+0000 7f0e8ffff640 1 -- 172.21.15.33:0/318543387 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5629b558a0b0 con 0x5629b5682030 2024-05-08T10:55:36.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.647+0000 7f0e8f7fe640 1 --2- 172.21.15.33:0/318543387 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5629b5682410 0x5629b565e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:55:36.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.647+0000 7f0e8ffff640 1 --2- 172.21.15.33:0/318543387 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5629b5682030 0x5629b56598a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f0e80035040 tx=0x7f0e80078e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e98c85826b0ab20 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:36.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.647+0000 7f0e75ffb640 1 -- 172.21.15.33:0/318543387 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e8007d680 con 0x5629b5682030 2024-05-08T10:55:36.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.647+0000 7f0e75ffb640 1 -- 172.21.15.33:0/318543387 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e80081c40 con 0x5629b5682030 2024-05-08T10:55:36.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.647+0000 7f0e75ffb640 1 -- 172.21.15.33:0/318543387 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e80030d50 con 0x5629b5682030 2024-05-08T10:55:36.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.648+0000 7f0e99428740 1 -- 172.21.15.33:0/318543387 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5629b5682030 msgr2=0x5629b56598a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:36.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.648+0000 7f0e99428740 1 --2- 172.21.15.33:0/318543387 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5629b5682030 0x5629b56598a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f0e80035040 tx=0x7f0e80078e90 comp rx=0 tx=0).stop 2024-05-08T10:55:36.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.648+0000 7f0e99428740 1 -- 172.21.15.33:0/318543387 shutdown_connections 2024-05-08T10:55:36.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.648+0000 7f0e99428740 1 --2- 172.21.15.33:0/318543387 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x5629b565ed60 0x5629b565f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:36.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.648+0000 7f0e99428740 1 --2- 172.21.15.33:0/318543387 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5629b5682410 0x5629b565e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:36.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.648+0000 7f0e99428740 1 --2- 172.21.15.33:0/318543387 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5629b5682030 0x5629b56598a0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:36.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.648+0000 7f0e99428740 1 -- 172.21.15.33:0/318543387 >> 172.21.15.33:0/318543387 conn(0x5629b565bb10 msgr2=0x5629b56a4710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:36.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.648+0000 7f0e99428740 1 -- 172.21.15.33:0/318543387 shutdown_connections 2024-05-08T10:55:36.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.648+0000 7f0e99428740 1 -- 172.21.15.33:0/318543387 wait complete. 2024-05-08T10:55:36.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.649+0000 7f0e99428740 1 -- start start 2024-05-08T10:55:36.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.649+0000 7f0e99428740 1 Processor -- start 2024-05-08T10:55:36.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.650+0000 7f0e99428740 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x5629b5682030 0x5629b5680de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:36.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.650+0000 7f0e99428740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5629b5682410 0x5629b5678f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:36.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.650+0000 7f0e99428740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5629b56b48c0 0x5629b56b5a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:36.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.650+0000 7f0e99428740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629b55c2830 con 0x5629b56b48c0 2024-05-08T10:55:36.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.650+0000 7f0e99428740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629b557f020 con 0x5629b5682410 2024-05-08T10:55:36.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.650+0000 7f0e99428740 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x5629b56b6810 con 0x5629b5682030 2024-05-08T10:55:36.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.650+0000 7f0e99428740 10 client.0 _ll_register_callbacks cb 0x5629b557e9f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T10:55:36.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.650+0000 7f0e94bdc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5629b56b48c0 0x5629b56b5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:36.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.650+0000 7f0e94bdc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5629b56b48c0 0x5629b56b5a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56314/0 (socket says 172.21.15.33:56314) 2024-05-08T10:55:36.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.650+0000 7f0e94bdc640 1 -- 172.21.15.33:0/2696323812 learned_addr learned my addr 172.21.15.33:0/2696323812 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:36.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.650+0000 7f0e8f7fe640 1 --2- 172.21.15.33:0/2696323812 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5629b5682410 0x5629b5678f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:36.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.650+0000 7f0e8ffff640 1 --2- 172.21.15.33:0/2696323812 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x5629b5682030 0x5629b5680de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:36.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.650+0000 7f0e94bdc640 1 -- 172.21.15.33:0/2696323812 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x5629b5682030 msgr2=0x5629b5680de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:36.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.650+0000 7f0e94bdc640 1 --2- 172.21.15.33:0/2696323812 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x5629b5682030 0x5629b5680de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:36.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.650+0000 7f0e94bdc640 1 -- 172.21.15.33:0/2696323812 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5629b5682410 msgr2=0x5629b5678f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:36.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.650+0000 7f0e94bdc640 1 --2- 172.21.15.33:0/2696323812 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5629b5682410 0x5629b5678f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:36.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.650+0000 7f0e94bdc640 1 -- 172.21.15.33:0/2696323812 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5629b557f3f0 con 0x5629b56b48c0 2024-05-08T10:55:36.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.650+0000 7f0e94bdc640 1 --2- 172.21.15.33:0/2696323812 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5629b56b48c0 0x5629b56b5a80 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f0e88007a00 tx=0x7f0e88007ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19b0fd45fec4643d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:36.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.650+0000 7f0e6effd640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-05-08T10:55:36.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.650+0000 7f0e6effd640 1 -- 172.21.15.33:0/2696323812 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e88010a70 con 0x5629b56b48c0 2024-05-08T10:55:36.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.650+0000 7f0e6effd640 1 -- 172.21.15.33:0/2696323812 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0e88010c10 con 0x5629b56b48c0 2024-05-08T10:55:36.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.650+0000 7f0e99428740 1 -- 172.21.15.33:0/2696323812 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0e80081c40 con 0x5629b56b48c0 2024-05-08T10:55:36.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.651+0000 7f0e6effd640 1 -- 172.21.15.33:0/2696323812 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0e88024050 con 0x5629b56b48c0 2024-05-08T10:55:36.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.651+0000 7f0e99428740 10 client.4983 fetch_fsmap learned FSMap version 14 2024-05-08T10:55:36.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.651+0000 7f0e99428740 1 -- 172.21.15.33:0/2696323812 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0x5629b52d72d0 con 0x5629b56b48c0 2024-05-08T10:55:36.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.651+0000 7f0e6effd640 1 -- 172.21.15.33:0/2696323812 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e80081c40 con 0x5629b56b48c0 2024-05-08T10:55:36.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.651+0000 7f0e6effd640 1 -- 172.21.15.33:0/2696323812 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 14) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f0e88027020 con 0x5629b56b48c0 2024-05-08T10:55:36.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.651+0000 7f0e99428740 10 client.4983 fetch_fsmap finished waiting for FSMap version 14 2024-05-08T10:55:36.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.651+0000 7f0e99428740 10 client.4983 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-08T10:55:36.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.651+0000 7f0e99428740 20 client.4983 populate_metadata read hostname 'smithi033' 2024-05-08T10:55:36.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.651+0000 7f0e99428740 1 --2- 172.21.15.33:0/2696323812 >> [v2:172.21.15.33:6832/415400390,v1:172.21.15.33:6834/415400390] conn(0x5629b567ba80 0x5629b56b84b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:36.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.651+0000 7f0e99428740 4 client.4983 mds_command: new command op to 4708 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T10:55:36.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.651+0000 7f0e99428740 1 -- 172.21.15.33:0/2696323812 --> [v2:172.21.15.33:6832/415400390,v1:172.21.15.33:6834/415400390] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5629b55cfd70 con 0x5629b567ba80 2024-05-08T10:55:36.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.651+0000 7f0e8ffff640 1 --2- 172.21.15.33:0/2696323812 >> [v2:172.21.15.33:6832/415400390,v1:172.21.15.33:6834/415400390] conn(0x5629b567ba80 0x5629b56b84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:36.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.651+0000 7f0e6effd640 10 client.4983 ms_handle_connect on v2:172.21.15.33:6832/415400390 2024-05-08T10:55:36.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.651+0000 7f0e8ffff640 1 --2- 172.21.15.33:0/2696323812 >> [v2:172.21.15.33:6832/415400390,v1:172.21.15.33:6834/415400390] conn(0x5629b567ba80 0x5629b56b84b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=85ab04dca6ee91e4 server_cookie=8e036877cb73f7e7 in_seq=0 out_seq=0 2024-05-08T10:55:36.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.652+0000 7f0e6effd640 1 -- 172.21.15.33:0/2696323812 <== mds.0 v2:172.21.15.33:6832/415400390 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5629b55cfd70 con 0x5629b567ba80 2024-05-08T10:55:36.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.652+0000 7f0e6effd640 10 client.4983 handle_command_reply: tid=0 2024-05-08T10:55:36.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.652+0000 7f0e99428740 1 client.4983 shutdown 2024-05-08T10:55:36.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.652+0000 7f0e99428740 1 -- 172.21.15.33:0/2696323812 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5629b56b48c0 msgr2=0x5629b56b5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:36.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.652+0000 7f0e99428740 1 --2- 172.21.15.33:0/2696323812 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5629b56b48c0 0x5629b56b5a80 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f0e88007a00 tx=0x7f0e88007ec0 comp rx=0 tx=0).stop 2024-05-08T10:55:36.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.652+0000 7f0e99428740 1 -- 172.21.15.33:0/2696323812 shutdown_connections 2024-05-08T10:55:36.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.652+0000 7f0e99428740 1 --2- 172.21.15.33:0/2696323812 >> [v2:172.21.15.33:6832/415400390,v1:172.21.15.33:6834/415400390] conn(0x5629b567ba80 0x5629b56b84b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:36.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.652+0000 7f0e99428740 1 --2- 172.21.15.33:0/2696323812 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5629b56b48c0 0x5629b56b5a80 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:36.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.652+0000 7f0e99428740 1 --2- 172.21.15.33:0/2696323812 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5629b5682410 0x5629b5678f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:36.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.652+0000 7f0e99428740 1 --2- 172.21.15.33:0/2696323812 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x5629b5682030 0x5629b5680de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:36.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.652+0000 7f0e6effd640 0 client.4983 ms_handle_reset on v2:172.21.15.33:6832/415400390 2024-05-08T10:55:36.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.652+0000 7f0e99428740 1 -- 172.21.15.33:0/2696323812 >> 172.21.15.33:0/2696323812 conn(0x5629b565ed60 msgr2=0x5629b56595d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:36.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.652+0000 7f0e99428740 1 -- 172.21.15.33:0/2696323812 shutdown_connections 2024-05-08T10:55:36.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.652+0000 7f0e99428740 1 -- 172.21.15.33:0/2696323812 wait complete. 2024-05-08T10:55:36.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.652+0000 7f0e99428740 20 client.4983 trim_cache size 0 max 16384 2024-05-08T10:55:36.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.669+0000 7f0e99428740 1 Processor -- start 2024-05-08T10:55:36.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.669+0000 7f0e99428740 1 -- start start 2024-05-08T10:55:36.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.669+0000 7f0e99428740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5629b5682030 0x5629b5685120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:36.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.669+0000 7f0e99428740 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x5629b5682410 0x5629b56be4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:36.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.669+0000 7f0e99428740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5629b56b48c0 0x5629b56bea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:36.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.669+0000 7f0e99428740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e90156e00 con 0x5629b5682030 2024-05-08T10:55:36.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.669+0000 7f0e99428740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e9006d530 con 0x5629b56b48c0 2024-05-08T10:55:36.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.669+0000 7f0e99428740 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e90156800 con 0x5629b5682410 2024-05-08T10:55:36.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.669+0000 7f0e8ffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5629b5682030 0x5629b5685120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:36.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.669+0000 7f0e8ffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5629b5682030 0x5629b5685120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56324/0 (socket says 172.21.15.33:56324) 2024-05-08T10:55:36.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.669+0000 7f0e8ffff640 1 -- 172.21.15.33:0/1520844374 learned_addr learned my addr 172.21.15.33:0/1520844374 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:36.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.670+0000 7f0e8ffff640 1 -- 172.21.15.33:0/1520844374 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x5629b5682410 msgr2=0x5629b56be4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:36.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.670+0000 7f0e8ffff640 1 --2- 172.21.15.33:0/1520844374 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x5629b5682410 0x5629b56be4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:36.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.670+0000 7f0e8ffff640 1 -- 172.21.15.33:0/1520844374 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5629b56b48c0 msgr2=0x5629b56bea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:36.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.670+0000 7f0e8ffff640 1 --2- 172.21.15.33:0/1520844374 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5629b56b48c0 0x5629b56bea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:36.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.670+0000 7f0e8ffff640 1 -- 172.21.15.33:0/1520844374 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5629b53a16b0 con 0x5629b5682030 2024-05-08T10:55:36.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.670+0000 7f0e8ffff640 1 --2- 172.21.15.33:0/1520844374 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5629b5682030 0x5629b5685120 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f0e800794c0 tx=0x7f0e80048000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19f8cbec52455428 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:36.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.670+0000 7f0e757fa640 1 -- 172.21.15.33:0/1520844374 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e800775d0 con 0x5629b5682030 2024-05-08T10:55:36.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.670+0000 7f0e757fa640 1 -- 172.21.15.33:0/1520844374 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e80077830 con 0x5629b5682030 2024-05-08T10:55:36.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.670+0000 7f0e757fa640 1 -- 172.21.15.33:0/1520844374 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e80075ba0 con 0x5629b5682030 2024-05-08T10:55:36.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.670+0000 7f0e99428740 1 -- 172.21.15.33:0/1520844374 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5629b5682030 msgr2=0x5629b5685120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:36.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.670+0000 7f0e99428740 1 --2- 172.21.15.33:0/1520844374 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5629b5682030 0x5629b5685120 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f0e800794c0 tx=0x7f0e80048000 comp rx=0 tx=0).stop 2024-05-08T10:55:36.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.670+0000 7f0e99428740 1 -- 172.21.15.33:0/1520844374 shutdown_connections 2024-05-08T10:55:36.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.670+0000 7f0e99428740 1 --2- 172.21.15.33:0/1520844374 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5629b56b48c0 0x5629b56bea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:36.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.670+0000 7f0e99428740 1 --2- 172.21.15.33:0/1520844374 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x5629b5682410 0x5629b56be4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:36.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.670+0000 7f0e99428740 1 --2- 172.21.15.33:0/1520844374 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5629b5682030 0x5629b5685120 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:36.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.670+0000 7f0e99428740 1 -- 172.21.15.33:0/1520844374 >> 172.21.15.33:0/1520844374 conn(0x5629b565ed60 msgr2=0x5629b5680ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:36.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.671+0000 7f0e99428740 1 -- 172.21.15.33:0/1520844374 shutdown_connections 2024-05-08T10:55:36.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.671+0000 7f0e99428740 1 -- 172.21.15.33:0/1520844374 wait complete. 2024-05-08T10:55:36.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.671+0000 7f0e99428740 1 -- start start 2024-05-08T10:55:36.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.671+0000 7f0e99428740 1 Processor -- start 2024-05-08T10:55:36.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.672+0000 7f0e99428740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5629b5682030 0x5629b56a4710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:36.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.672+0000 7f0e99428740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5629b5682410 0x5629b570ef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:36.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.672+0000 7f0e99428740 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x5629b56b48c0 0x5629b56be4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:36.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.672+0000 7f0e99428740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629b567b900 con 0x5629b5682030 2024-05-08T10:55:36.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.672+0000 7f0e99428740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629b5679500 con 0x5629b5682410 2024-05-08T10:55:36.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.672+0000 7f0e99428740 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x5629b567bf00 con 0x5629b56b48c0 2024-05-08T10:55:36.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.672+0000 7f0e99428740 10 client.0 _ll_register_callbacks cb 0x7f0e88009790 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T10:55:36.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.672+0000 7f0e8ffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5629b5682030 0x5629b56a4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:36.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.672+0000 7f0e8ffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5629b5682030 0x5629b56a4710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56334/0 (socket says 172.21.15.33:56334) 2024-05-08T10:55:36.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.672+0000 7f0e8ffff640 1 -- 172.21.15.33:0/3679848460 learned_addr learned my addr 172.21.15.33:0/3679848460 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:36.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.672+0000 7f0e8ffff640 1 -- 172.21.15.33:0/3679848460 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x5629b56b48c0 msgr2=0x5629b56be4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:36.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.672+0000 7f0e8ffff640 1 --2- 172.21.15.33:0/3679848460 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x5629b56b48c0 0x5629b56be4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:36.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.672+0000 7f0e8ffff640 1 -- 172.21.15.33:0/3679848460 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5629b5682410 msgr2=0x5629b570ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:36.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.672+0000 7f0e8ffff640 1 --2- 172.21.15.33:0/3679848460 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5629b5682410 0x5629b570ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:36.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.672+0000 7f0e8ffff640 1 -- 172.21.15.33:0/3679848460 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5629b565a080 con 0x5629b5682030 2024-05-08T10:55:36.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.673+0000 7f0e8ffff640 1 --2- 172.21.15.33:0/3679848460 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5629b5682030 0x5629b56a4710 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f0e800097a0 tx=0x7f0e8002a740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6144f3cee6b2d135 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:36.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.673+0000 7f0e6effd640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-05-08T10:55:36.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.673+0000 7f0e6effd640 1 -- 172.21.15.33:0/3679848460 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e80075ba0 con 0x5629b5682030 2024-05-08T10:55:36.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.673+0000 7f0e6effd640 1 -- 172.21.15.33:0/3679848460 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0e80045360 con 0x5629b5682030 2024-05-08T10:55:36.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.673+0000 7f0e99428740 1 -- 172.21.15.33:0/3679848460 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0e80077830 con 0x5629b5682030 2024-05-08T10:55:36.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.673+0000 7f0e6effd640 1 -- 172.21.15.33:0/3679848460 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0e80075d40 con 0x5629b5682030 2024-05-08T10:55:36.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.673+0000 7f0e99428740 10 client.4989 fetch_fsmap learned FSMap version 14 2024-05-08T10:55:36.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.673+0000 7f0e99428740 1 -- 172.21.15.33:0/3679848460 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0x5629b565e5a0 con 0x5629b5682030 2024-05-08T10:55:36.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.673+0000 7f0e6effd640 1 -- 172.21.15.33:0/3679848460 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e80077830 con 0x5629b5682030 2024-05-08T10:55:36.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.673+0000 7f0e6effd640 1 -- 172.21.15.33:0/3679848460 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 14) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f0e8003a030 con 0x5629b5682030 2024-05-08T10:55:36.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.673+0000 7f0e99428740 10 client.4989 fetch_fsmap finished waiting for FSMap version 14 2024-05-08T10:55:36.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.673+0000 7f0e99428740 10 client.4989 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-08T10:55:36.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.673+0000 7f0e99428740 20 client.4989 populate_metadata read hostname 'smithi033' 2024-05-08T10:55:36.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.673+0000 7f0e99428740 1 --2- 172.21.15.33:0/3679848460 >> [v2:172.21.15.33:6832/415400390,v1:172.21.15.33:6834/415400390] conn(0x5629b569a700 0x5629b569aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:36.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.673+0000 7f0e99428740 4 client.4989 mds_command: new command op to 4708 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-08T10:55:36.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.673+0000 7f0e99428740 1 -- 172.21.15.33:0/3679848460 --> [v2:172.21.15.33:6832/415400390,v1:172.21.15.33:6834/415400390] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5629b55ca0c0 con 0x5629b569a700 2024-05-08T10:55:36.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.673+0000 7f0e8f7fe640 1 --2- 172.21.15.33:0/3679848460 >> [v2:172.21.15.33:6832/415400390,v1:172.21.15.33:6834/415400390] conn(0x5629b569a700 0x5629b569aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:36.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.674+0000 7f0e6effd640 10 client.4989 ms_handle_connect on v2:172.21.15.33:6832/415400390 2024-05-08T10:55:36.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.674+0000 7f0e8f7fe640 1 --2- 172.21.15.33:0/3679848460 >> [v2:172.21.15.33:6832/415400390,v1:172.21.15.33:6834/415400390] conn(0x5629b569a700 0x5629b569aae0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=66344460ca1ad679 server_cookie=56ad61aec71c2918 in_seq=0 out_seq=0 2024-05-08T10:55:36.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.674+0000 7f0e6effd640 1 -- 172.21.15.33:0/3679848460 <== mds.0 v2:172.21.15.33:6832/415400390 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x5629b55ca0c0 con 0x5629b569a700 2024-05-08T10:55:36.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.674+0000 7f0e6effd640 10 client.4989 handle_command_reply: tid=0 2024-05-08T10:55:36.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.674+0000 7f0e99428740 1 client.4989 shutdown 2024-05-08T10:55:36.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.674+0000 7f0e99428740 1 -- 172.21.15.33:0/3679848460 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5629b5682030 msgr2=0x5629b56a4710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:36.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.674+0000 7f0e99428740 1 --2- 172.21.15.33:0/3679848460 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5629b5682030 0x5629b56a4710 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f0e800097a0 tx=0x7f0e8002a740 comp rx=0 tx=0).stop 2024-05-08T10:55:36.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.674+0000 7f0e99428740 1 -- 172.21.15.33:0/3679848460 shutdown_connections 2024-05-08T10:55:36.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.674+0000 7f0e99428740 1 --2- 172.21.15.33:0/3679848460 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x5629b56b48c0 0x5629b56be4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:36.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.674+0000 7f0e99428740 1 --2- 172.21.15.33:0/3679848460 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5629b5682410 0x5629b570ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:36.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.674+0000 7f0e99428740 1 --2- 172.21.15.33:0/3679848460 >> [v2:172.21.15.33:6832/415400390,v1:172.21.15.33:6834/415400390] conn(0x5629b569a700 0x5629b569aae0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:36.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.674+0000 7f0e99428740 1 --2- 172.21.15.33:0/3679848460 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5629b5682030 0x5629b56a4710 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:36.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.674+0000 7f0e99428740 1 -- 172.21.15.33:0/3679848460 >> 172.21.15.33:0/3679848460 conn(0x5629b565ed60 msgr2=0x5629b5681840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:36.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.674+0000 7f0e6effd640 0 client.4989 ms_handle_reset on v2:172.21.15.33:6832/415400390 2024-05-08T10:55:36.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.674+0000 7f0e99428740 1 -- 172.21.15.33:0/3679848460 shutdown_connections 2024-05-08T10:55:36.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.674+0000 7f0e99428740 1 -- 172.21.15.33:0/3679848460 wait complete. 2024-05-08T10:55:36.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.674+0000 7f0e99428740 20 client.4989 trim_cache size 0 max 16384 2024-05-08T10:55:36.679 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-05-08T10:55:36.680 INFO:teuthology.orchestra.run.smithi033.stdout: "cluster_fsid": "963217b2-c375-4f5a-95cf-88e199dd38ff", 2024-05-08T10:55:36.680 INFO:teuthology.orchestra.run.smithi033.stdout: "whoami": 0, 2024-05-08T10:55:36.680 INFO:teuthology.orchestra.run.smithi033.stdout: "id": 4708, 2024-05-08T10:55:36.680 INFO:teuthology.orchestra.run.smithi033.stdout: "want_state": "up:active", 2024-05-08T10:55:36.680 INFO:teuthology.orchestra.run.smithi033.stdout: "state": "up:active", 2024-05-08T10:55:36.680 INFO:teuthology.orchestra.run.smithi033.stdout: "fs_name": "cephfs", 2024-05-08T10:55:36.680 INFO:teuthology.orchestra.run.smithi033.stdout: "rank_uptime": 4.7117214509999998, 2024-05-08T10:55:36.680 INFO:teuthology.orchestra.run.smithi033.stdout: "mdsmap_epoch": 14, 2024-05-08T10:55:36.680 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch": 31, 2024-05-08T10:55:36.680 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch_barrier": 31, 2024-05-08T10:55:36.680 INFO:teuthology.orchestra.run.smithi033.stdout: "uptime": 11.741467916 2024-05-08T10:55:36.680 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-05-08T10:55:36.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.675+0000 7f0e9663f640 1 -- 172.21.15.33:0/1107639975 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f0e7c06b4d0 msgr2=0x7f0e7c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:36.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.675+0000 7f0e9663f640 1 --2- 172.21.15.33:0/1107639975 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f0e7c06b4d0 0x7f0e7c06d990 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f0e901f6e90 tx=0x7f0e84007b50 comp rx=0 tx=0).stop 2024-05-08T10:55:36.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.675+0000 7f0e9663f640 1 -- 172.21.15.33:0/1107639975 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e900b3b10 msgr2=0x7f0e901f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:36.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.675+0000 7f0e9663f640 1 --2- 172.21.15.33:0/1107639975 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e900b3b10 0x7f0e901f6950 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f0e80000c00 tx=0x7f0e800046c0 comp rx=0 tx=0).stop 2024-05-08T10:55:36.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.675+0000 7f0e9663f640 1 -- 172.21.15.33:0/1107639975 shutdown_connections 2024-05-08T10:55:36.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.675+0000 7f0e9663f640 1 --2- 172.21.15.33:0/1107639975 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f0e7c06b4d0 0x7f0e7c06d990 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:36.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.675+0000 7f0e9663f640 1 --2- 172.21.15.33:0/1107639975 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0e90144630 0x7f0e900cce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:36.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.675+0000 7f0e9663f640 1 --2- 172.21.15.33:0/1107639975 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0e900d04d0 0x7f0e900ae840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:36.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.675+0000 7f0e9663f640 1 --2- 172.21.15.33:0/1107639975 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e900b3b10 0x7f0e901f6950 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:36.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.675+0000 7f0e9663f640 1 -- 172.21.15.33:0/1107639975 >> 172.21.15.33:0/1107639975 conn(0x7f0e9006afc0 msgr2=0x7f0e90158d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:36.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.675+0000 7f0e9663f640 1 -- 172.21.15.33:0/1107639975 shutdown_connections 2024-05-08T10:55:36.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.675+0000 7f0e9663f640 1 -- 172.21.15.33:0/1107639975 wait complete. 2024-05-08T10:55:36.683 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-08T10:55:36.779 INFO:tasks.ceph.mds.c.smithi033.stderr:2024-05-08T10:55:36.781+0000 7f54cfc3b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-08T10:55:36.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.790+0000 7fc373ac4640 1 Processor -- start 2024-05-08T10:55:36.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.790+0000 7fc373ac4640 1 -- start start 2024-05-08T10:55:36.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.791+0000 7fc373ac4640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fc36c0d0540 0x7fc36c15dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:36.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.791+0000 7fc373ac4640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc36c0d0920 0x7fc36c15e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:36.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.791+0000 7fc373ac4640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc36c0b4c60 0x7fc36c161d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:36.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.791+0000 7fc373ac4640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc36c0d46c0 con 0x7fc36c0d0540 2024-05-08T10:55:36.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.791+0000 7fc373ac4640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc36c0d2390 con 0x7fc36c0d0920 2024-05-08T10:55:36.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.791+0000 7fc373ac4640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc36c0d2950 con 0x7fc36c0b4c60 2024-05-08T10:55:36.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.791+0000 7fc371860640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fc36c0d0540 0x7fc36c15dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:36.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.791+0000 7fc371860640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fc36c0d0540 0x7fc36c15dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56338/0 (socket says 172.21.15.33:56338) 2024-05-08T10:55:36.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.791+0000 7fc371860640 1 -- 172.21.15.33:0/2052733955 learned_addr learned my addr 172.21.15.33:0/2052733955 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:36.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.791+0000 7fc37105f640 1 --2- 172.21.15.33:0/2052733955 >> v2:172.21.15.174:3300/0 conn(0x7fc36c0d0920 0x7fc36c15e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:36.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.791+0000 7fc372061640 1 --2- 172.21.15.33:0/2052733955 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc36c0b4c60 0x7fc36c161d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:36.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.791+0000 7fc371860640 1 -- 172.21.15.33:0/2052733955 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc36c0b4c60 msgr2=0x7fc36c161d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:36.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.791+0000 7fc371860640 1 --2- 172.21.15.33:0/2052733955 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc36c0b4c60 0x7fc36c161d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:36.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.791+0000 7fc371860640 1 -- 172.21.15.33:0/2052733955 >> v2:172.21.15.174:3300/0 conn(0x7fc36c0d0920 msgr2=0x7fc36c15e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:36.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.791+0000 7fc371860640 1 --2- 172.21.15.33:0/2052733955 >> v2:172.21.15.174:3300/0 conn(0x7fc36c0d0920 0x7fc36c15e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:36.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.791+0000 7fc371860640 1 -- 172.21.15.33:0/2052733955 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc36c15e650 con 0x7fc36c0d0540 2024-05-08T10:55:36.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.791+0000 7fc372061640 1 --2- 172.21.15.33:0/2052733955 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc36c0b4c60 0x7fc36c161d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:55:36.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.792+0000 7fc371860640 1 --2- 172.21.15.33:0/2052733955 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc36c0d0540 0x7fc36c15dbd0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc36c073240 tx=0x7fc36802a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65d7d8a6e4438456 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:36.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.792+0000 7fc37085e640 1 -- 172.21.15.33:0/2052733955 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc368037070 con 0x7fc36c0d0540 2024-05-08T10:55:36.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.792+0000 7fc37085e640 1 -- 172.21.15.33:0/2052733955 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc36802ae00 con 0x7fc36c0d0540 2024-05-08T10:55:36.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.792+0000 7fc37085e640 1 -- 172.21.15.33:0/2052733955 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc368032660 con 0x7fc36c0d0540 2024-05-08T10:55:36.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.793+0000 7fc373ac4640 1 -- 172.21.15.33:0/2052733955 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc36c0d0540 msgr2=0x7fc36c15dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:36.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.793+0000 7fc373ac4640 1 --2- 172.21.15.33:0/2052733955 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc36c0d0540 0x7fc36c15dbd0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc36c073240 tx=0x7fc36802a0b0 comp rx=0 tx=0).stop 2024-05-08T10:55:36.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.793+0000 7fc373ac4640 1 -- 172.21.15.33:0/2052733955 shutdown_connections 2024-05-08T10:55:36.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.793+0000 7fc373ac4640 1 --2- 172.21.15.33:0/2052733955 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc36c0b4c60 0x7fc36c161d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:36.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.793+0000 7fc373ac4640 1 --2- 172.21.15.33:0/2052733955 >> v2:172.21.15.174:3300/0 conn(0x7fc36c0d0920 0x7fc36c15e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:36.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.793+0000 7fc373ac4640 1 --2- 172.21.15.33:0/2052733955 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc36c0d0540 0x7fc36c15dbd0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:36.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.793+0000 7fc373ac4640 1 -- 172.21.15.33:0/2052733955 >> 172.21.15.33:0/2052733955 conn(0x7fc36c0d3ba0 msgr2=0x7fc36c0d3fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:36.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.793+0000 7fc373ac4640 1 -- 172.21.15.33:0/2052733955 shutdown_connections 2024-05-08T10:55:36.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.793+0000 7fc373ac4640 1 -- 172.21.15.33:0/2052733955 wait complete. 2024-05-08T10:55:36.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.794+0000 7fc373ac4640 1 Processor -- start 2024-05-08T10:55:36.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.794+0000 7fc373ac4640 1 -- start start 2024-05-08T10:55:36.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.795+0000 7fc373ac4640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc36c0b4c60 0x7fc36c15a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:36.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.795+0000 7fc373ac4640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc36c0d0540 0x7fc36c1f7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:36.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.795+0000 7fc373ac4640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc36c0d0920 0x7fc36c0b6760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:36.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.795+0000 7fc373ac4640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc36c0b4730 con 0x7fc36c0d0540 2024-05-08T10:55:36.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.795+0000 7fc373ac4640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc36c0d25e0 con 0x7fc36c0b4c60 2024-05-08T10:55:36.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.795+0000 7fc373ac4640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc36c0b48b0 con 0x7fc36c0d0920 2024-05-08T10:55:36.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.795+0000 7fc37105f640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc36c0d0540 0x7fc36c1f7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:36.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.795+0000 7fc37105f640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc36c0d0540 0x7fc36c1f7a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56354/0 (socket says 172.21.15.33:56354) 2024-05-08T10:55:36.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.795+0000 7fc37105f640 1 -- 172.21.15.33:0/293778546 learned_addr learned my addr 172.21.15.33:0/293778546 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:36.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.795+0000 7fc372061640 1 --2- 172.21.15.33:0/293778546 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc36c0d0920 0x7fc36c0b6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:36.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.795+0000 7fc371860640 1 --2- 172.21.15.33:0/293778546 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc36c0b4c60 0x7fc36c15a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:36.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.795+0000 7fc37105f640 1 -- 172.21.15.33:0/293778546 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc36c0d0920 msgr2=0x7fc36c0b6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:36.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.795+0000 7fc37105f640 1 --2- 172.21.15.33:0/293778546 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc36c0d0920 0x7fc36c0b6760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:36.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.795+0000 7fc37105f640 1 -- 172.21.15.33:0/293778546 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc36c0b4c60 msgr2=0x7fc36c15a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:36.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.795+0000 7fc37105f640 1 --2- 172.21.15.33:0/293778546 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc36c0b4c60 0x7fc36c15a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:36.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.795+0000 7fc37105f640 1 -- 172.21.15.33:0/293778546 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc36c0cae10 con 0x7fc36c0d0540 2024-05-08T10:55:36.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.795+0000 7fc372061640 1 --2- 172.21.15.33:0/293778546 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc36c0d0920 0x7fc36c0b6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:55:36.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.795+0000 7fc37105f640 1 --2- 172.21.15.33:0/293778546 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc36c0d0540 0x7fc36c1f7a10 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fc36000d800 tx=0x7fc36000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:36.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.796+0000 7fc35e7fc640 1 -- 172.21.15.33:0/293778546 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc360004020 con 0x7fc36c0d0540 2024-05-08T10:55:36.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.796+0000 7fc35e7fc640 1 -- 172.21.15.33:0/293778546 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3600041c0 con 0x7fc36c0d0540 2024-05-08T10:55:36.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.796+0000 7fc35e7fc640 1 -- 172.21.15.33:0/293778546 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc360004390 con 0x7fc36c0d0540 2024-05-08T10:55:36.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.796+0000 7fc373ac4640 1 -- 172.21.15.33:0/293778546 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc36c1f7f50 con 0x7fc36c0d0540 2024-05-08T10:55:36.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.796+0000 7fc373ac4640 1 -- 172.21.15.33:0/293778546 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc36c0cb0b0 con 0x7fc36c0d0540 2024-05-08T10:55:36.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.797+0000 7fc373ac4640 1 -- 172.21.15.33:0/293778546 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc36c069d20 con 0x7fc36c0d0540 2024-05-08T10:55:36.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.797+0000 7fc35e7fc640 1 -- 172.21.15.33:0/293778546 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc36001b020 con 0x7fc36c0d0540 2024-05-08T10:55:36.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.798+0000 7fc35e7fc640 1 --2- 172.21.15.33:0/293778546 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fc35006b4d0 0x7fc35006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:36.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.798+0000 7fc35e7fc640 1 -- 172.21.15.33:0/293778546 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc36008a000 con 0x7fc36c0d0540 2024-05-08T10:55:36.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.798+0000 7fc371860640 1 --2- 172.21.15.33:0/293778546 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fc35006b4d0 0x7fc35006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:36.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.798+0000 7fc371860640 1 --2- 172.21.15.33:0/293778546 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fc35006b4d0 0x7fc35006d990 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc368034000 tx=0x7fc36802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:36.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:36.802+0000 7fc35e7fc640 1 -- 172.21.15.33:0/293778546 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc360058e80 con 0x7fc36c0d0540 2024-05-08T10:55:37.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:37.019+0000 7fc373ac4640 1 -- 172.21.15.33:0/293778546 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc36c072f70 con 0x7fc36c0d0540 2024-05-08T10:55:37.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:37.019+0000 7fc35e7fc640 1 -- 172.21.15.33:0/293778546 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v14) v1 ==== 53+0+73 (secure 0 0 0) 0x7fc360058780 con 0x7fc36c0d0540 2024-05-08T10:55:37.017 INFO:teuthology.orchestra.run.smithi033.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-08T10:55:37.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:37.021+0000 7fc373ac4640 1 -- 172.21.15.33:0/293778546 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fc35006b4d0 msgr2=0x7fc35006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:37.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:37.021+0000 7fc373ac4640 1 --2- 172.21.15.33:0/293778546 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fc35006b4d0 0x7fc35006d990 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc368034000 tx=0x7fc36802e000 comp rx=0 tx=0).stop 2024-05-08T10:55:37.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:37.021+0000 7fc373ac4640 1 -- 172.21.15.33:0/293778546 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc36c0d0540 msgr2=0x7fc36c1f7a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:37.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:37.021+0000 7fc373ac4640 1 --2- 172.21.15.33:0/293778546 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc36c0d0540 0x7fc36c1f7a10 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fc36000d800 tx=0x7fc36000dcc0 comp rx=0 tx=0).stop 2024-05-08T10:55:37.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:37.021+0000 7fc373ac4640 1 -- 172.21.15.33:0/293778546 shutdown_connections 2024-05-08T10:55:37.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:37.021+0000 7fc373ac4640 1 --2- 172.21.15.33:0/293778546 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fc35006b4d0 0x7fc35006d990 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:37.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:37.021+0000 7fc373ac4640 1 --2- 172.21.15.33:0/293778546 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc36c0d0920 0x7fc36c0b6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:37.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:37.021+0000 7fc373ac4640 1 --2- 172.21.15.33:0/293778546 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc36c0d0540 0x7fc36c1f7a10 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:37.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:37.021+0000 7fc373ac4640 1 --2- 172.21.15.33:0/293778546 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc36c0b4c60 0x7fc36c15a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:37.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:37.021+0000 7fc373ac4640 1 -- 172.21.15.33:0/293778546 >> 172.21.15.33:0/293778546 conn(0x7fc36c0d3ba0 msgr2=0x7fc36c0b0780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:37.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:37.021+0000 7fc373ac4640 1 -- 172.21.15.33:0/293778546 shutdown_connections 2024-05-08T10:55:37.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:37.021+0000 7fc373ac4640 1 -- 172.21.15.33:0/293778546 wait complete. 2024-05-08T10:55:37.029 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-08T10:55:37.030 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-08T10:55:37.030 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi033.front.sepia.ceph.com 2024-05-08T10:55:37.030 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-08T10:55:37.030 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-08T10:55:37.030 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-08T10:55:37.030 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-05-08T10:55:37.030 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-08T10:55:37.030 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-08T10:55:37.030 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:55:37.030 DEBUG:teuthology.orchestra.run.smithi033:> ip addr 2024-05-08T10:55:37.047 INFO:teuthology.orchestra.run.smithi033.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-08T10:55:37.047 INFO:teuthology.orchestra.run.smithi033.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-08T10:55:37.047 INFO:teuthology.orchestra.run.smithi033.stdout: inet 127.0.0.1/8 scope host lo 2024-05-08T10:55:37.047 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-05-08T10:55:37.048 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 ::1/128 scope host 2024-05-08T10:55:37.048 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-05-08T10:55:37.048 INFO:teuthology.orchestra.run.smithi033.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-08T10:55:37.048 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 0c:c4:7a:6b:fd:14 brd ff:ff:ff:ff:ff:ff 2024-05-08T10:55:37.048 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp7s0f0 2024-05-08T10:55:37.048 INFO:teuthology.orchestra.run.smithi033.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-08T10:55:37.048 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 0c:c4:7a:6b:fd:15 brd ff:ff:ff:ff:ff:ff 2024-05-08T10:55:37.048 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp7s0f1 2024-05-08T10:55:37.048 INFO:teuthology.orchestra.run.smithi033.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-08T10:55:37.048 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether ac:1f:6b:a5:d2:94 brd ff:ff:ff:ff:ff:ff 2024-05-08T10:55:37.048 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp1s0f0 2024-05-08T10:55:37.048 INFO:teuthology.orchestra.run.smithi033.stdout: inet 172.21.15.33/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-05-08T10:55:37.048 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft 42723sec preferred_lft 42723sec 2024-05-08T10:55:37.048 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::ae1f:6bff:fea5:d294/64 scope link noprefixroute 2024-05-08T10:55:37.049 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-05-08T10:55:37.049 INFO:teuthology.orchestra.run.smithi033.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-08T10:55:37.049 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether ac:1f:6b:a5:d2:95 brd ff:ff:ff:ff:ff:ff 2024-05-08T10:55:37.049 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp1s0f1 2024-05-08T10:55:37.049 INFO:teuthology.orchestra.run.smithi033.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-08T10:55:37.049 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 5e:1d:15:2d:e4:95 brd ff:ff:ff:ff:ff:ff 2024-05-08T10:55:37.049 INFO:teuthology.orchestra.run.smithi033.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-08T10:55:37.049 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-05-08T10:55:37.049 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::acf4:9cff:fe29:3730/64 scope link 2024-05-08T10:55:37.049 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-05-08T10:55:37.049 INFO:teuthology.orchestra.run.smithi033.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-08T10:55:37.049 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 5e:1d:15:2d:e4:95 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-08T10:55:37.049 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::5c1d:15ff:fe2d:e495/64 scope link 2024-05-08T10:55:37.049 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-05-08T10:55:37.050 INFO:teuthology.orchestra.run.smithi033.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-08T10:55:37.050 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether a6:37:ee:26:be:e4 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-08T10:55:37.050 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::a437:eeff:fe26:bee4/64 scope link 2024-05-08T10:55:37.050 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-05-08T10:55:37.050 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:55:37.050 DEBUG:teuthology.orchestra.run.smithi033:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-08T10:55:37.112 INFO:teuthology.orchestra.run.smithi033.stdout:1 2024-05-08T10:55:37.114 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:55:37.114 DEBUG:teuthology.orchestra.run.smithi033:> route 2024-05-08T10:55:37.171 INFO:teuthology.orchestra.run.smithi033.stdout:Kernel IP routing table 2024-05-08T10:55:37.171 INFO:teuthology.orchestra.run.smithi033.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-08T10:55:37.172 INFO:teuthology.orchestra.run.smithi033.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-05-08T10:55:37.172 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-05-08T10:55:37.172 INFO:teuthology.orchestra.run.smithi033.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-08T10:55:37.172 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-08T10:55:37.172 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2024-05-08T10:55:37.172 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-05-08T10:55:37.172 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-05-08T10:55:37.172 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-05-08T10:55:37.172 DEBUG:teuthology.orchestra.run.smithi033:> ') 2024-05-08T10:55:37.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-08T10:55:37.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T10:55:37.302 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:55:37.302 DEBUG:teuthology.orchestra.run.smithi033:> ip netns list 2024-05-08T10:55:37.318 INFO:teuthology.orchestra.run.smithi033.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-08T10:55:37.318 INFO:teuthology.orchestra.run.smithi033.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-08T10:55:37.319 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-08T10:55:37.319 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:55:37.319 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link set brx.0 up 2024-05-08T10:55:37.385 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-08T10:55:37.385 DEBUG:teuthology.orchestra.run.smithi033:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-08T10:55:37.441 INFO:teuthology.orchestra.run.smithi033.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-08T10:55:37.441 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-08T10:55:37.441 DEBUG:teuthology.orchestra.run.smithi033:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-08T10:55:37.496 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-05-08T10:55:37.497 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:55:37.497 DEBUG:teuthology.orchestra.run.smithi033:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-08T10:55:37.581 INFO:teuthology.orchestra.run.smithi033.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-08T10:55:37.581 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-08T10:55:37.589 INFO:teuthology.orchestra.run.smithi033.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-08T10:55:37.589 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-08T10:55:37.589 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: resolved to: "172.21.15.33:3300,172.21.15.174:3300,172.21.15.174:3301" 2024-05-08T10:55:37.589 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: trying mount with new device syntax: 0@963217b2-c375-4f5a-95cf-88e199dd38ff.cephfs=/ 2024-05-08T10:55:37.589 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.33:3300/172.21.15.174:3300/172.21.15.174:3301" will pass to kernel 2024-05-08T10:55:37.590 INFO:teuthology.orchestra.run.smithi033.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-05-08T10:55:37.590 INFO:teuthology.orchestra.run.smithi033.stdout: You just mounted a file system that supports labels which does not 2024-05-08T10:55:37.590 INFO:teuthology.orchestra.run.smithi033.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-08T10:55:37.590 INFO:teuthology.orchestra.run.smithi033.stdout: applications will generate AVC messages and not be allowed access to 2024-05-08T10:55:37.590 INFO:teuthology.orchestra.run.smithi033.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-08T10:55:37.592 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-08T10:55:37.592 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:55:37.592 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-08T10:55:37.618 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-08T10:55:37.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:37 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-08T10:55:37.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T10:55:37.723 INFO:teuthology.orchestra.run.smithi033.stdout:client4998 2024-05-08T10:55:37.723 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-05-08T10:55:37.723 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T10:55:37.739 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:55:37.739 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir mydir) 2024-05-08T10:55:37.802 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:55:37.803 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch mydir/alpha) 2024-05-08T10:55:37.861 DEBUG:teuthology.orchestra.run.smithi033:> stdin-killer -- python3 -c ' 2024-05-08T10:55:37.861 DEBUG:teuthology.orchestra.run.smithi033:> import os 2024-05-08T10:55:37.862 DEBUG:teuthology.orchestra.run.smithi033:> import stat 2024-05-08T10:55:37.862 DEBUG:teuthology.orchestra.run.smithi033:> 2024-05-08T10:55:37.862 DEBUG:teuthology.orchestra.run.smithi033:> print(os.stat("/home/ubuntu/cephtest/mnt.0/mydir").st_ino) 2024-05-08T10:55:37.862 DEBUG:teuthology.orchestra.run.smithi033:> ' 2024-05-08T10:55:37.968 INFO:teuthology.orchestra.run.smithi033.stdout:1099511627776 2024-05-08T10:55:37.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T10:55:37.978 DEBUG:teuthology.orchestra.run.smithi033:> stdin-killer -- python3 -c ' 2024-05-08T10:55:37.978 DEBUG:teuthology.orchestra.run.smithi033:> import os 2024-05-08T10:55:37.978 DEBUG:teuthology.orchestra.run.smithi033:> import stat 2024-05-08T10:55:37.978 DEBUG:teuthology.orchestra.run.smithi033:> 2024-05-08T10:55:37.978 DEBUG:teuthology.orchestra.run.smithi033:> print(os.stat("/home/ubuntu/cephtest/mnt.0/mydir/alpha").st_ino) 2024-05-08T10:55:37.978 DEBUG:teuthology.orchestra.run.smithi033:> ' 2024-05-08T10:55:38.086 INFO:teuthology.orchestra.run.smithi033.stdout:1099511627777 2024-05-08T10:55:38.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T10:55:38.096 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-05-08T10:55:38.096 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T10:55:38.153 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-05-08T10:55:38.153 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T10:55:38.209 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-08T10:55:38.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.356+0000 7f2210909640 1 Processor -- start 2024-05-08T10:55:38.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.356+0000 7f2210909640 1 -- start start 2024-05-08T10:55:38.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.357+0000 7f2210909640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f220c144630 0x7f220c0b35d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:38.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.357+0000 7f2210909640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f220c0b3b10 0x7f220c0cfdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:38.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.357+0000 7f2210909640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f220c0d0300 0x7f220c15e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:38.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.357+0000 7f2210909640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f220c0d0760 con 0x7f220c0b3b10 2024-05-08T10:55:38.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.357+0000 7f2210909640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f220c15c330 con 0x7f220c0d0300 2024-05-08T10:55:38.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.357+0000 7f2210909640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f220c0b4140 con 0x7f220c144630 2024-05-08T10:55:38.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.357+0000 7f2209d9b640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f220c0b3b10 0x7f220c0cfdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:38.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.357+0000 7f2209d9b640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f220c0b3b10 0x7f220c0cfdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56356/0 (socket says 172.21.15.33:56356) 2024-05-08T10:55:38.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.357+0000 7f2209d9b640 1 -- 172.21.15.33:0/4252784729 learned_addr learned my addr 172.21.15.33:0/4252784729 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:38.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.357+0000 7f220ad9d640 1 --2- 172.21.15.33:0/4252784729 >> v2:172.21.15.174:3300/0 conn(0x7f220c0d0300 0x7f220c15e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:38.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.357+0000 7f220a59c640 1 --2- 172.21.15.33:0/4252784729 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f220c144630 0x7f220c0b35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:38.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.357+0000 7f2209d9b640 1 -- 172.21.15.33:0/4252784729 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f220c144630 msgr2=0x7f220c0b35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:38.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.357+0000 7f2209d9b640 1 --2- 172.21.15.33:0/4252784729 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f220c144630 0x7f220c0b35d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:38.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.357+0000 7f2209d9b640 1 -- 172.21.15.33:0/4252784729 >> v2:172.21.15.174:3300/0 conn(0x7f220c0d0300 msgr2=0x7f220c15e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:38.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.357+0000 7f2209d9b640 1 --2- 172.21.15.33:0/4252784729 >> v2:172.21.15.174:3300/0 conn(0x7f220c0d0300 0x7f220c15e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:38.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.357+0000 7f2209d9b640 1 -- 172.21.15.33:0/4252784729 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f220c0b4420 con 0x7f220c0b3b10 2024-05-08T10:55:38.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.357+0000 7f220a59c640 1 --2- 172.21.15.33:0/4252784729 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f220c144630 0x7f220c0b35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:55:38.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.358+0000 7f2209d9b640 1 --2- 172.21.15.33:0/4252784729 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f220c0b3b10 0x7f220c0cfdc0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f220c06e080 tx=0x7f21fc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfa4ca66b938088b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:38.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.358+0000 7f220959a640 1 -- 172.21.15.33:0/4252784729 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21fc037070 con 0x7f220c0b3b10 2024-05-08T10:55:38.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.358+0000 7f220959a640 1 -- 172.21.15.33:0/4252784729 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21fc032440 con 0x7f220c0b3b10 2024-05-08T10:55:38.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.358+0000 7f220959a640 1 -- 172.21.15.33:0/4252784729 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21fc032810 con 0x7f220c0b3b10 2024-05-08T10:55:38.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.359+0000 7f2210909640 1 -- 172.21.15.33:0/4252784729 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f220c0b3b10 msgr2=0x7f220c0cfdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:38.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.359+0000 7f2210909640 1 --2- 172.21.15.33:0/4252784729 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f220c0b3b10 0x7f220c0cfdc0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f220c06e080 tx=0x7f21fc02a1e0 comp rx=0 tx=0).stop 2024-05-08T10:55:38.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.359+0000 7f2210909640 1 -- 172.21.15.33:0/4252784729 shutdown_connections 2024-05-08T10:55:38.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.359+0000 7f2210909640 1 --2- 172.21.15.33:0/4252784729 >> v2:172.21.15.174:3300/0 conn(0x7f220c0d0300 0x7f220c15e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:38.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.359+0000 7f2210909640 1 --2- 172.21.15.33:0/4252784729 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f220c0b3b10 0x7f220c0cfdc0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:38.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.359+0000 7f2210909640 1 --2- 172.21.15.33:0/4252784729 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f220c144630 0x7f220c0b35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:38.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.359+0000 7f2210909640 1 -- 172.21.15.33:0/4252784729 >> 172.21.15.33:0/4252784729 conn(0x7f220c06afc0 msgr2=0x7f220c06b3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:38.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.359+0000 7f2210909640 1 -- 172.21.15.33:0/4252784729 shutdown_connections 2024-05-08T10:55:38.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.359+0000 7f2210909640 1 -- 172.21.15.33:0/4252784729 wait complete. 2024-05-08T10:55:38.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.360+0000 7f2210909640 1 Processor -- start 2024-05-08T10:55:38.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.360+0000 7f2210909640 1 -- start start 2024-05-08T10:55:38.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.361+0000 7f2210909640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f220c0b3b10 0x7f220c1597c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:38.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.361+0000 7f2210909640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f220c0d0300 0x7f220c13a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:38.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.361+0000 7f2210909640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f220c144630 0x7f220c0ceef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:38.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.361+0000 7f2210909640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f220c0b2be0 con 0x7f220c0b3b10 2024-05-08T10:55:38.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.361+0000 7f2210909640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f220c15c860 con 0x7f220c144630 2024-05-08T10:55:38.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.361+0000 7f2210909640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f220c15eca0 con 0x7f220c0d0300 2024-05-08T10:55:38.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.361+0000 7f220a59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f220c0b3b10 0x7f220c1597c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:38.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.361+0000 7f220a59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f220c0b3b10 0x7f220c1597c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56360/0 (socket says 172.21.15.33:56360) 2024-05-08T10:55:38.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.361+0000 7f220a59c640 1 -- 172.21.15.33:0/676238748 learned_addr learned my addr 172.21.15.33:0/676238748 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:38.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.361+0000 7f2209d9b640 1 --2- 172.21.15.33:0/676238748 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f220c0d0300 0x7f220c13a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:38.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.361+0000 7f220ad9d640 1 --2- 172.21.15.33:0/676238748 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f220c144630 0x7f220c0ceef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:38.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.361+0000 7f220a59c640 1 -- 172.21.15.33:0/676238748 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f220c0d0300 msgr2=0x7f220c13a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:38.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.361+0000 7f220a59c640 1 --2- 172.21.15.33:0/676238748 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f220c0d0300 0x7f220c13a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:38.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.361+0000 7f220a59c640 1 -- 172.21.15.33:0/676238748 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f220c144630 msgr2=0x7f220c0ceef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:38.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.361+0000 7f220a59c640 1 --2- 172.21.15.33:0/676238748 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f220c144630 0x7f220c0ceef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:38.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.362+0000 7f220a59c640 1 -- 172.21.15.33:0/676238748 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f220c13aa40 con 0x7f220c0b3b10 2024-05-08T10:55:38.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.362+0000 7f220a59c640 1 --2- 172.21.15.33:0/676238748 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f220c0b3b10 0x7f220c1597c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f21f400c7f0 tx=0x7f21f400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:38.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.362+0000 7f2202ffd640 1 -- 172.21.15.33:0/676238748 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f4015070 con 0x7f220c0b3b10 2024-05-08T10:55:38.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.362+0000 7f2202ffd640 1 -- 172.21.15.33:0/676238748 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21f4007820 con 0x7f220c0b3b10 2024-05-08T10:55:38.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.362+0000 7f2210909640 1 -- 172.21.15.33:0/676238748 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f220c159da0 con 0x7f220c0b3b10 2024-05-08T10:55:38.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.362+0000 7f2202ffd640 1 -- 172.21.15.33:0/676238748 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f4007bd0 con 0x7f220c0b3b10 2024-05-08T10:55:38.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.362+0000 7f2210909640 1 -- 172.21.15.33:0/676238748 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f220c157fc0 con 0x7f220c0b3b10 2024-05-08T10:55:38.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.363+0000 7f2210909640 1 -- 172.21.15.33:0/676238748 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f220c069d20 con 0x7f220c0b3b10 2024-05-08T10:55:38.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.363+0000 7f2202ffd640 1 -- 172.21.15.33:0/676238748 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f21f4018070 con 0x7f220c0b3b10 2024-05-08T10:55:38.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.364+0000 7f2202ffd640 1 --2- 172.21.15.33:0/676238748 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f21ec06b4d0 0x7f21ec06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:38.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.364+0000 7f2202ffd640 1 -- 172.21.15.33:0/676238748 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f21f408a0b0 con 0x7f220c0b3b10 2024-05-08T10:55:38.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.364+0000 7f2209d9b640 1 --2- 172.21.15.33:0/676238748 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f21ec06b4d0 0x7f21ec06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:38.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.365+0000 7f2209d9b640 1 --2- 172.21.15.33:0/676238748 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f21ec06b4d0 0x7f21ec06d990 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f21fc034000 tx=0x7f21fc02e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:38.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.368+0000 7f2202ffd640 1 -- 172.21.15.33:0/676238748 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f21f4058f30 con 0x7f220c0b3b10 2024-05-08T10:55:38.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.565+0000 7f2210909640 1 -- 172.21.15.33:0/676238748 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f220c06e0b0 con 0x7f220c0b3b10 2024-05-08T10:55:38.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.565+0000 7f2202ffd640 1 -- 172.21.15.33:0/676238748 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v31) v1 ==== 80+0+0 (secure 0 0 0) 0x7f21f4058830 con 0x7f220c0b3b10 2024-05-08T10:55:38.563 INFO:teuthology.orchestra.run.smithi033.stderr:listed 0 entries 2024-05-08T10:55:38.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.568+0000 7f2210909640 1 -- 172.21.15.33:0/676238748 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f21ec06b4d0 msgr2=0x7f21ec06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:38.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.568+0000 7f2210909640 1 --2- 172.21.15.33:0/676238748 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f21ec06b4d0 0x7f21ec06d990 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f21fc034000 tx=0x7f21fc02e000 comp rx=0 tx=0).stop 2024-05-08T10:55:38.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.568+0000 7f2210909640 1 -- 172.21.15.33:0/676238748 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f220c0b3b10 msgr2=0x7f220c1597c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:38.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.568+0000 7f2210909640 1 --2- 172.21.15.33:0/676238748 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f220c0b3b10 0x7f220c1597c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f21f400c7f0 tx=0x7f21f400ccb0 comp rx=0 tx=0).stop 2024-05-08T10:55:38.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.568+0000 7f2210909640 1 -- 172.21.15.33:0/676238748 shutdown_connections 2024-05-08T10:55:38.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.568+0000 7f2210909640 1 --2- 172.21.15.33:0/676238748 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f21ec06b4d0 0x7f21ec06d990 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:38.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.568+0000 7f2210909640 1 --2- 172.21.15.33:0/676238748 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f220c144630 0x7f220c0ceef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:38.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.568+0000 7f2210909640 1 --2- 172.21.15.33:0/676238748 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f220c0d0300 0x7f220c13a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:38.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.568+0000 7f2210909640 1 --2- 172.21.15.33:0/676238748 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f220c0b3b10 0x7f220c1597c0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:38.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.568+0000 7f2210909640 1 -- 172.21.15.33:0/676238748 >> 172.21.15.33:0/676238748 conn(0x7f220c06afc0 msgr2=0x7f220c15d160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:38.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.568+0000 7f2210909640 1 -- 172.21.15.33:0/676238748 shutdown_connections 2024-05-08T10:55:38.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.568+0000 7f2210909640 1 -- 172.21.15.33:0/676238748 wait complete. 2024-05-08T10:55:38.575 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-08T10:55:38.575 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:55:38.576 DEBUG:teuthology.orchestra.run.smithi033:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-05-08T10:55:38.632 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi033.front.sepia.ceph.com 2024-05-08T10:55:38.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:55:38.632 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-08T10:55:38.658 DEBUG:teuthology.orchestra.run.smithi033:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata listomapkeys 10000000000.00000000 2024-05-08T10:55:38.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.744+0000 7fe4cd21bf40 1 Processor -- start 2024-05-08T10:55:38.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.744+0000 7fe4cd21bf40 1 -- start start 2024-05-08T10:55:38.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.745+0000 7fe4cd21bf40 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x564f15f79890 0x564f16020c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:38.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.745+0000 7fe4cd21bf40 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564f16022b50 0x564f15f95da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:38.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.745+0000 7fe4cd21bf40 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564f16023470 0x564f15f962e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:38.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.745+0000 7fe4cd21bf40 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f15f4e6b0 con 0x564f16022b50 2024-05-08T10:55:38.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.745+0000 7fe4cd21bf40 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f15ef4b70 con 0x564f16023470 2024-05-08T10:55:38.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.745+0000 7fe4cd21bf40 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x564f15f4e830 con 0x564f15f79890 2024-05-08T10:55:38.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.745+0000 7fe4c3fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564f16022b50 0x564f15f95da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:38.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.745+0000 7fe4c3fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564f16022b50 0x564f15f95da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56376/0 (socket says 172.21.15.33:56376) 2024-05-08T10:55:38.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.745+0000 7fe4c3fff640 1 -- 172.21.15.33:0/2996685180 learned_addr learned my addr 172.21.15.33:0/2996685180 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:38.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.745+0000 7fe4cad1e640 1 --2- 172.21.15.33:0/2996685180 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x564f15f79890 0x564f16020c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:38.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.745+0000 7fe4cb51f640 1 --2- 172.21.15.33:0/2996685180 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564f16023470 0x564f15f962e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:38.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.745+0000 7fe4c3fff640 1 -- 172.21.15.33:0/2996685180 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x564f15f79890 msgr2=0x564f16020c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:38.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.746+0000 7fe4c3fff640 1 --2- 172.21.15.33:0/2996685180 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x564f15f79890 0x564f16020c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:38.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.746+0000 7fe4c3fff640 1 -- 172.21.15.33:0/2996685180 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564f16023470 msgr2=0x564f15f962e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:38.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.746+0000 7fe4c3fff640 1 --2- 172.21.15.33:0/2996685180 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564f16023470 0x564f15f962e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:38.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.746+0000 7fe4c3fff640 1 -- 172.21.15.33:0/2996685180 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564f16022340 con 0x564f16022b50 2024-05-08T10:55:38.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.746+0000 7fe4cb51f640 1 --2- 172.21.15.33:0/2996685180 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564f16023470 0x564f15f962e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:55:38.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.746+0000 7fe4c3fff640 1 --2- 172.21.15.33:0/2996685180 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564f16022b50 0x564f15f95da0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fe4b4046010 tx=0x7fe4b4051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b44f114694b4d805 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:38.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.746+0000 7fe4c9d1c640 1 -- 172.21.15.33:0/2996685180 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b4056030 con 0x564f16022b50 2024-05-08T10:55:38.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.746+0000 7fe4c9d1c640 1 -- 172.21.15.33:0/2996685180 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4b4052ad0 con 0x564f16022b50 2024-05-08T10:55:38.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.746+0000 7fe4c9d1c640 1 -- 172.21.15.33:0/2996685180 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b405b450 con 0x564f16022b50 2024-05-08T10:55:38.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.746+0000 7fe4cd21bf40 1 -- 172.21.15.33:0/2996685180 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564f16022b50 msgr2=0x564f15f95da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:38.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.746+0000 7fe4cd21bf40 1 --2- 172.21.15.33:0/2996685180 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564f16022b50 0x564f15f95da0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fe4b4046010 tx=0x7fe4b4051000 comp rx=0 tx=0).stop 2024-05-08T10:55:38.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.746+0000 7fe4cd21bf40 1 -- 172.21.15.33:0/2996685180 shutdown_connections 2024-05-08T10:55:38.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.746+0000 7fe4cd21bf40 1 --2- 172.21.15.33:0/2996685180 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564f16023470 0x564f15f962e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:38.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.746+0000 7fe4cd21bf40 1 --2- 172.21.15.33:0/2996685180 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564f16022b50 0x564f15f95da0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:38.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.746+0000 7fe4cd21bf40 1 --2- 172.21.15.33:0/2996685180 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x564f15f79890 0x564f16020c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:38.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.746+0000 7fe4cd21bf40 1 -- 172.21.15.33:0/2996685180 >> 172.21.15.33:0/2996685180 conn(0x564f15f78d70 msgr2=0x564f15f95410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:38.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.746+0000 7fe4cd21bf40 1 -- 172.21.15.33:0/2996685180 shutdown_connections 2024-05-08T10:55:38.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.746+0000 7fe4cd21bf40 1 -- 172.21.15.33:0/2996685180 wait complete. 2024-05-08T10:55:38.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.747+0000 7fe4cd21bf40 1 Processor -- start 2024-05-08T10:55:38.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.747+0000 7fe4cd21bf40 1 -- start start 2024-05-08T10:55:38.751 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T10:55:38.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.748+0000 7fe4cd21bf40 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564f15f79890 0x564f1600ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:38.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.748+0000 7fe4cd21bf40 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x564f16022b50 0x564f1601df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:38.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.748+0000 7fe4cd21bf40 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564f16023470 0x564f16017a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:38.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.748+0000 7fe4cd21bf40 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f16021e00 con 0x564f15f79890 2024-05-08T10:55:38.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.748+0000 7fe4cd21bf40 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f15f7cbd0 con 0x564f16023470 2024-05-08T10:55:38.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.748+0000 7fe4cd21bf40 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x564f160220a0 con 0x564f16022b50 2024-05-08T10:55:38.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.748+0000 7fe4cad1e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564f15f79890 0x564f1600ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:38.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.748+0000 7fe4cad1e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564f15f79890 0x564f1600ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56392/0 (socket says 172.21.15.33:56392) 2024-05-08T10:55:38.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.748+0000 7fe4cad1e640 1 -- 172.21.15.33:0/1372934829 learned_addr learned my addr 172.21.15.33:0/1372934829 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:38.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.748+0000 7fe4cb51f640 1 --2- 172.21.15.33:0/1372934829 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564f16023470 0x564f16017a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:38.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.748+0000 7fe4c3fff640 1 --2- 172.21.15.33:0/1372934829 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x564f16022b50 0x564f1601df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:38.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.748+0000 7fe4cad1e640 1 -- 172.21.15.33:0/1372934829 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x564f16022b50 msgr2=0x564f1601df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:38.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.748+0000 7fe4cad1e640 1 --2- 172.21.15.33:0/1372934829 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x564f16022b50 0x564f1601df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:38.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.748+0000 7fe4cad1e640 1 -- 172.21.15.33:0/1372934829 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564f16023470 msgr2=0x564f16017a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:38.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.748+0000 7fe4cad1e640 1 --2- 172.21.15.33:0/1372934829 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564f16023470 0x564f16017a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:38.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.748+0000 7fe4cad1e640 1 -- 172.21.15.33:0/1372934829 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564f1601cf60 con 0x564f15f79890 2024-05-08T10:55:38.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.748+0000 7fe4cad1e640 1 --2- 172.21.15.33:0/1372934829 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564f15f79890 0x564f1600ead0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc009ec0 tx=0x7fe4bc008400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:38.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.749+0000 7fe4c8d1a640 1 -- 172.21.15.33:0/1372934829 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4bc008de0 con 0x564f15f79890 2024-05-08T10:55:38.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.749+0000 7fe4c8d1a640 1 -- 172.21.15.33:0/1372934829 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4bc0143f0 con 0x564f15f79890 2024-05-08T10:55:38.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.749+0000 7fe4cd21bf40 1 -- 172.21.15.33:0/1372934829 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564f1601bc20 con 0x564f15f79890 2024-05-08T10:55:38.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.749+0000 7fe4c8d1a640 1 -- 172.21.15.33:0/1372934829 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4bc0147c0 con 0x564f15f79890 2024-05-08T10:55:38.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.749+0000 7fe4cd21bf40 1 -- 172.21.15.33:0/1372934829 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564f1601c1e0 con 0x564f15f79890 2024-05-08T10:55:38.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.750+0000 7fe4c8d1a640 1 -- 172.21.15.33:0/1372934829 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe4bc01b020 con 0x564f15f79890 2024-05-08T10:55:38.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.751+0000 7fe4c8d1a640 1 --2- 172.21.15.33:0/1372934829 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fe4ac069eb0 0x7fe4ac06c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:38.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.751+0000 7fe4c8d1a640 1 -- 172.21.15.33:0/1372934829 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe4bc0884b0 con 0x564f15f79890 2024-05-08T10:55:38.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.751+0000 7fe4c3fff640 1 --2- 172.21.15.33:0/1372934829 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fe4ac069eb0 0x7fe4ac06c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:38.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.751+0000 7fe4cd21bf40 1 --2- 172.21.15.33:0/1372934829 >> [v2:172.21.15.33:6802/4029047077,v1:172.21.15.33:6804/4029047077] conn(0x564f15f92510 0x564f15f92920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:38.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.751+0000 7fe4cd21bf40 1 -- 172.21.15.33:0/1372934829 --> [v2:172.21.15.33:6802/4029047077,v1:172.21.15.33:6804/4029047077] -- osd_op(unknown.0.0:1 4.10 4:0cf6ad0f:::10000000000.00000000:head [omap-get-keys in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v9 -- 0x564f15f92e60 con 0x564f15f92510 2024-05-08T10:55:38.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.751+0000 7fe4cb51f640 1 --2- 172.21.15.33:0/1372934829 >> [v2:172.21.15.33:6802/4029047077,v1:172.21.15.33:6804/4029047077] conn(0x564f15f92510 0x564f15f92920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:38.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.751+0000 7fe4c3fff640 1 --2- 172.21.15.33:0/1372934829 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fe4ac069eb0 0x7fe4ac06c370 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe4b4005400 tx=0x7fe4b4053000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:38.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.751+0000 7fe4cb51f640 1 --2- 172.21.15.33:0/1372934829 >> [v2:172.21.15.33:6802/4029047077,v1:172.21.15.33:6804/4029047077] conn(0x564f15f92510 0x564f15f92920 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:38.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.752+0000 7fe4cb51f640 1 -- 172.21.15.33:0/1372934829 <== osd.3 v2:172.21.15.33:6802/4029047077 1 ==== osd_op_reply(1 10000000000.00000000 [omap-get-keys] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x7fe4c4010660 con 0x564f15f92510 2024-05-08T10:55:38.754 INFO:teuthology.orchestra.run.smithi033.stderr:error getting omap key set cephfs_metadata/10000000000.00000000: (2) No such file or directory 2024-05-08T10:55:38.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.752+0000 7fe4cd21bf40 1 -- 172.21.15.33:0/1372934829 >> [v2:172.21.15.33:6802/4029047077,v1:172.21.15.33:6804/4029047077] conn(0x564f15f92510 msgr2=0x564f15f92920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:38.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.752+0000 7fe4cd21bf40 1 --2- 172.21.15.33:0/1372934829 >> [v2:172.21.15.33:6802/4029047077,v1:172.21.15.33:6804/4029047077] conn(0x564f15f92510 0x564f15f92920 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:38.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.752+0000 7fe4cd21bf40 1 -- 172.21.15.33:0/1372934829 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fe4ac069eb0 msgr2=0x7fe4ac06c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:38.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.752+0000 7fe4cd21bf40 1 --2- 172.21.15.33:0/1372934829 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fe4ac069eb0 0x7fe4ac06c370 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe4b4005400 tx=0x7fe4b4053000 comp rx=0 tx=0).stop 2024-05-08T10:55:38.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.752+0000 7fe4cd21bf40 1 -- 172.21.15.33:0/1372934829 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564f15f79890 msgr2=0x564f1600ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:38.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.752+0000 7fe4cd21bf40 1 --2- 172.21.15.33:0/1372934829 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564f15f79890 0x564f1600ead0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc009ec0 tx=0x7fe4bc008400 comp rx=0 tx=0).stop 2024-05-08T10:55:38.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.752+0000 7fe4cb51f640 1 -- 172.21.15.33:0/1372934829 reap_dead start 2024-05-08T10:55:38.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.752+0000 7fe4cd21bf40 1 -- 172.21.15.33:0/1372934829 shutdown_connections 2024-05-08T10:55:38.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.752+0000 7fe4cd21bf40 1 -- 172.21.15.33:0/1372934829 >> 172.21.15.33:0/1372934829 conn(0x564f15f78d70 msgr2=0x564f16020200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:38.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.752+0000 7fe4cd21bf40 1 -- 172.21.15.33:0/1372934829 shutdown_connections 2024-05-08T10:55:38.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.752+0000 7fe4cd21bf40 1 -- 172.21.15.33:0/1372934829 wait complete. 2024-05-08T10:55:38.755 ERROR:tasks.cephfs.filesystem:Command failed on smithi033 with status 1: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata listomapkeys 10000000000.00000000' 2024-05-08T10:55:38.755 DEBUG:teuthology.orchestra.run.smithi033:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000001.00000000 parent 2024-05-08T10:55:38.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.839+0000 7f4c7271df40 1 Processor -- start 2024-05-08T10:55:38.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.839+0000 7f4c7271df40 1 -- start start 2024-05-08T10:55:38.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.840+0000 7f4c7271df40 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f65f9e5950 0x55f65fa280d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:38.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.840+0000 7f4c7271df40 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f65fa23210 0x55f65fa11970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:38.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.840+0000 7f4c7271df40 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55f65fa235f0 0x55f65fa29d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:38.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.840+0000 7f4c7271df40 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f65f989b70 con 0x55f65fa23210 2024-05-08T10:55:38.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.840+0000 7f4c7271df40 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f65f98dad0 con 0x55f65f9e5950 2024-05-08T10:55:38.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.840+0000 7f4c7271df40 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f65faba930 con 0x55f65fa235f0 2024-05-08T10:55:38.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.840+0000 7f4c67fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f65fa23210 0x55f65fa11970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:38.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.840+0000 7f4c67fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f65fa23210 0x55f65fa11970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56410/0 (socket says 172.21.15.33:56410) 2024-05-08T10:55:38.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.840+0000 7f4c67fff640 1 -- 172.21.15.33:0/206447324 learned_addr learned my addr 172.21.15.33:0/206447324 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:38.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.841+0000 7f4c67fff640 1 -- 172.21.15.33:0/206447324 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55f65fa235f0 msgr2=0x55f65fa29d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:38.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.841+0000 7f4c67fff640 1 --2- 172.21.15.33:0/206447324 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55f65fa235f0 0x55f65fa29d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:38.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.841+0000 7f4c67fff640 1 -- 172.21.15.33:0/206447324 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f65f9e5950 msgr2=0x55f65fa280d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:38.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.841+0000 7f4c67fff640 1 --2- 172.21.15.33:0/206447324 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f65f9e5950 0x55f65fa280d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:38.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.841+0000 7f4c67fff640 1 -- 172.21.15.33:0/206447324 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f65fa25fe0 con 0x55f65fa23210 2024-05-08T10:55:38.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.841+0000 7f4c67fff640 1 --2- 172.21.15.33:0/206447324 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f65fa23210 0x55f65fa11970 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f4c5800b240 tx=0x7f4c5800b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31ac3564fb1ad472 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:38.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.841+0000 7f4c6f21c640 1 -- 172.21.15.33:0/206447324 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c58008070 con 0x55f65fa23210 2024-05-08T10:55:38.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.841+0000 7f4c6f21c640 1 -- 172.21.15.33:0/206447324 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c5800d500 con 0x55f65fa23210 2024-05-08T10:55:38.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.841+0000 7f4c6f21c640 1 -- 172.21.15.33:0/206447324 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c5800d8d0 con 0x55f65fa23210 2024-05-08T10:55:38.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.841+0000 7f4c7271df40 1 -- 172.21.15.33:0/206447324 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f65fa23210 msgr2=0x55f65fa11970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:38.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.841+0000 7f4c7271df40 1 --2- 172.21.15.33:0/206447324 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f65fa23210 0x55f65fa11970 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f4c5800b240 tx=0x7f4c5800b700 comp rx=0 tx=0).stop 2024-05-08T10:55:38.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.841+0000 7f4c7271df40 1 -- 172.21.15.33:0/206447324 shutdown_connections 2024-05-08T10:55:38.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.841+0000 7f4c7271df40 1 --2- 172.21.15.33:0/206447324 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55f65fa235f0 0x55f65fa29d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:38.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.841+0000 7f4c7271df40 1 --2- 172.21.15.33:0/206447324 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f65fa23210 0x55f65fa11970 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:38.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.841+0000 7f4c7271df40 1 --2- 172.21.15.33:0/206447324 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f65f9e5950 0x55f65fa280d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:38.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.841+0000 7f4c7271df40 1 -- 172.21.15.33:0/206447324 >> 172.21.15.33:0/206447324 conn(0x55f65fa0dd70 msgr2=0x55f65fa0e150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:38.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.841+0000 7f4c7271df40 1 -- 172.21.15.33:0/206447324 shutdown_connections 2024-05-08T10:55:38.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.841+0000 7f4c7271df40 1 -- 172.21.15.33:0/206447324 wait complete. 2024-05-08T10:55:38.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.842+0000 7f4c7271df40 1 Processor -- start 2024-05-08T10:55:38.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.842+0000 7f4c7271df40 1 -- start start 2024-05-08T10:55:38.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.843+0000 7f4c7271df40 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55f65f9e5950 0x55f65fa26780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:38.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.843+0000 7f4c7271df40 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f65fa23210 0x55f65fa26cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:38.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.843+0000 7f4c7271df40 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f65fa235f0 0x55f65fab0b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:38.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.843+0000 7f4c7271df40 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f65fa2c9e0 con 0x55f65fa23210 2024-05-08T10:55:38.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.843+0000 7f4c7271df40 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f65fa2cc40 con 0x55f65fa235f0 2024-05-08T10:55:38.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.843+0000 7f4c7271df40 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f65faacae0 con 0x55f65f9e5950 2024-05-08T10:55:38.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.843+0000 7f4c67fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f65fa23210 0x55f65fa26cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:38.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.843+0000 7f4c67fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f65fa23210 0x55f65fa26cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56416/0 (socket says 172.21.15.33:56416) 2024-05-08T10:55:38.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.843+0000 7f4c67fff640 1 -- 172.21.15.33:0/405547790 learned_addr learned my addr 172.21.15.33:0/405547790 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:38.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.843+0000 7f4c7021e640 1 --2- 172.21.15.33:0/405547790 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55f65f9e5950 0x55f65fa26780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:38.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.843+0000 7f4c70a1f640 1 --2- 172.21.15.33:0/405547790 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f65fa235f0 0x55f65fab0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:38.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.843+0000 7f4c67fff640 1 -- 172.21.15.33:0/405547790 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55f65f9e5950 msgr2=0x55f65fa26780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:38.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.843+0000 7f4c67fff640 1 --2- 172.21.15.33:0/405547790 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55f65f9e5950 0x55f65fa26780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:38.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.843+0000 7f4c67fff640 1 -- 172.21.15.33:0/405547790 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f65fa235f0 msgr2=0x55f65fab0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:38.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.843+0000 7f4c67fff640 1 --2- 172.21.15.33:0/405547790 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f65fa235f0 0x55f65fab0b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:38.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.843+0000 7f4c67fff640 1 -- 172.21.15.33:0/405547790 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f65fa28450 con 0x55f65fa23210 2024-05-08T10:55:38.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.843+0000 7f4c7021e640 1 --2- 172.21.15.33:0/405547790 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55f65f9e5950 0x55f65fa26780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:55:38.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.843+0000 7f4c67fff640 1 --2- 172.21.15.33:0/405547790 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f65fa23210 0x55f65fa26cc0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f4c58000f60 tx=0x7f4c58000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:38.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.843+0000 7f4c6e21a640 1 -- 172.21.15.33:0/405547790 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c58019740 con 0x55f65fa23210 2024-05-08T10:55:38.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.844+0000 7f4c6e21a640 1 -- 172.21.15.33:0/405547790 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c580198e0 con 0x55f65fa23210 2024-05-08T10:55:38.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.844+0000 7f4c7271df40 1 -- 172.21.15.33:0/405547790 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f65fb469e0 con 0x55f65fa23210 2024-05-08T10:55:38.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.844+0000 7f4c6e21a640 1 -- 172.21.15.33:0/405547790 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c58019cd0 con 0x55f65fa23210 2024-05-08T10:55:38.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.844+0000 7f4c7271df40 1 -- 172.21.15.33:0/405547790 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f65faac410 con 0x55f65fa23210 2024-05-08T10:55:38.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.845+0000 7f4c6e21a640 1 -- 172.21.15.33:0/405547790 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4c58017040 con 0x55f65fa23210 2024-05-08T10:55:38.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.846+0000 7f4c6e21a640 1 --2- 172.21.15.33:0/405547790 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f4c50069eb0 0x7f4c5006c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:38.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.846+0000 7f4c6e21a640 1 -- 172.21.15.33:0/405547790 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4c5808b1c0 con 0x55f65fa23210 2024-05-08T10:55:38.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.846+0000 7f4c7021e640 1 --2- 172.21.15.33:0/405547790 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f4c50069eb0 0x7f4c5006c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:38.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.846+0000 7f4c7271df40 1 --2- 172.21.15.33:0/405547790 >> [v2:172.21.15.174:6824/1511860729,v1:172.21.15.174:6825/1511860729] conn(0x55f65faabde0 0x55f65fab28b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:38.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.846+0000 7f4c7271df40 1 -- 172.21.15.33:0/405547790 --> [v2:172.21.15.174:6824/1511860729,v1:172.21.15.174:6825/1511860729] -- osd_op(unknown.0.0:1 5.7 5:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v9 -- 0x55f65fab2df0 con 0x55f65faabde0 2024-05-08T10:55:38.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.846+0000 7f4c70a1f640 1 --2- 172.21.15.33:0/405547790 >> [v2:172.21.15.174:6824/1511860729,v1:172.21.15.174:6825/1511860729] conn(0x55f65faabde0 0x55f65fab28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:38.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.846+0000 7f4c7021e640 1 --2- 172.21.15.33:0/405547790 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f4c50069eb0 0x7f4c5006c370 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4c60057000 tx=0x7f4c60051000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:38.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.847+0000 7f4c70a1f640 1 --2- 172.21.15.33:0/405547790 >> [v2:172.21.15.174:6824/1511860729,v1:172.21.15.174:6825/1511860729] conn(0x55f65faabde0 0x55f65fab28b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:38.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.847+0000 7f4c70a1f640 1 -- 172.21.15.33:0/405547790 <== osd.5 v2:172.21.15.174:6824/1511860729 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x7f4c68001660 con 0x55f65faabde0 2024-05-08T10:55:38.848 INFO:teuthology.orchestra.run.smithi033.stderr:error getting xattr cephfs_data/10000000001.00000000/parent: (2) No such file or directory 2024-05-08T10:55:38.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.847+0000 7f4c7271df40 1 -- 172.21.15.33:0/405547790 >> [v2:172.21.15.174:6824/1511860729,v1:172.21.15.174:6825/1511860729] conn(0x55f65faabde0 msgr2=0x55f65fab28b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:38.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.847+0000 7f4c7271df40 1 --2- 172.21.15.33:0/405547790 >> [v2:172.21.15.174:6824/1511860729,v1:172.21.15.174:6825/1511860729] conn(0x55f65faabde0 0x55f65fab28b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:38.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.847+0000 7f4c7271df40 1 -- 172.21.15.33:0/405547790 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f4c50069eb0 msgr2=0x7f4c5006c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:38.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.847+0000 7f4c7271df40 1 --2- 172.21.15.33:0/405547790 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f4c50069eb0 0x7f4c5006c370 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4c60057000 tx=0x7f4c60051000 comp rx=0 tx=0).stop 2024-05-08T10:55:38.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.847+0000 7f4c7271df40 1 -- 172.21.15.33:0/405547790 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f65fa23210 msgr2=0x55f65fa26cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:38.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.847+0000 7f4c7271df40 1 --2- 172.21.15.33:0/405547790 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f65fa23210 0x55f65fa26cc0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f4c58000f60 tx=0x7f4c58000ed0 comp rx=0 tx=0).stop 2024-05-08T10:55:38.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.847+0000 7f4c70a1f640 1 -- 172.21.15.33:0/405547790 reap_dead start 2024-05-08T10:55:38.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.847+0000 7f4c7271df40 1 -- 172.21.15.33:0/405547790 shutdown_connections 2024-05-08T10:55:38.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.847+0000 7f4c7271df40 1 -- 172.21.15.33:0/405547790 >> 172.21.15.33:0/405547790 conn(0x55f65fa0dd70 msgr2=0x55f65fa0e150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:38.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.847+0000 7f4c7271df40 1 -- 172.21.15.33:0/405547790 shutdown_connections 2024-05-08T10:55:38.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.847+0000 7f4c7271df40 1 -- 172.21.15.33:0/405547790 wait complete. 2024-05-08T10:55:38.849 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T10:55:38.849 ERROR:tasks.cephfs.filesystem:Command failed on smithi033 with status 1: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000001.00000000 parent' 2024-05-08T10:55:38.850 DEBUG:teuthology.orchestra.run.smithi033:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata listomapkeys 1.00000000 2024-05-08T10:55:38.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.895+0000 7f8f6c5b5f40 1 Processor -- start 2024-05-08T10:55:38.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.896+0000 7f8f6c5b5f40 1 -- start start 2024-05-08T10:55:38.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.896+0000 7f8f6c5b5f40 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5561a5233950 0x5561a527a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:38.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.896+0000 7f8f6c5b5f40 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5561a5271210 0x5561a5233360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:38.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.896+0000 7f8f6c5b5f40 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x5561a52715f0 0x5561a525fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:38.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.896+0000 7f8f6c5b5f40 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561a5308930 con 0x5561a5233950 2024-05-08T10:55:38.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.896+0000 7f8f6c5b5f40 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561a51d7b70 con 0x5561a5271210 2024-05-08T10:55:38.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.896+0000 7f8f6c5b5f40 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x5561a5309650 con 0x5561a52715f0 2024-05-08T10:55:38.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.896+0000 7f8f6a0b6640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5561a5233950 0x5561a527a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:38.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.896+0000 7f8f6a0b6640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5561a5233950 0x5561a527a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56444/0 (socket says 172.21.15.33:56444) 2024-05-08T10:55:38.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.896+0000 7f8f6a0b6640 1 -- 172.21.15.33:0/580008277 learned_addr learned my addr 172.21.15.33:0/580008277 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:38.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.897+0000 7f8f6a0b6640 1 -- 172.21.15.33:0/580008277 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x5561a52715f0 msgr2=0x5561a525fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:38.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.897+0000 7f8f6a0b6640 1 --2- 172.21.15.33:0/580008277 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x5561a52715f0 0x5561a525fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:38.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.897+0000 7f8f6a0b6640 1 -- 172.21.15.33:0/580008277 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5561a5271210 msgr2=0x5561a5233360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:38.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.897+0000 7f8f6a0b6640 1 --2- 172.21.15.33:0/580008277 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5561a5271210 0x5561a5233360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:38.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.897+0000 7f8f6a0b6640 1 -- 172.21.15.33:0/580008277 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5561a5279de0 con 0x5561a5233950 2024-05-08T10:55:38.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.897+0000 7f8f6a0b6640 1 --2- 172.21.15.33:0/580008277 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5561a5233950 0x5561a527a540 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c001d80 tx=0x7f8f5c001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6b3ced752d5dffc server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:38.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.897+0000 7f8f690b4640 1 -- 172.21.15.33:0/580008277 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f5c00bd70 con 0x5561a5233950 2024-05-08T10:55:38.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.897+0000 7f8f690b4640 1 -- 172.21.15.33:0/580008277 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f5c00f400 con 0x5561a5233950 2024-05-08T10:55:38.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.897+0000 7f8f690b4640 1 -- 172.21.15.33:0/580008277 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f5c00f7f0 con 0x5561a5233950 2024-05-08T10:55:38.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.897+0000 7f8f6c5b5f40 1 -- 172.21.15.33:0/580008277 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5561a5233950 msgr2=0x5561a527a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:38.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.897+0000 7f8f6c5b5f40 1 --2- 172.21.15.33:0/580008277 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5561a5233950 0x5561a527a540 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c001d80 tx=0x7f8f5c001e70 comp rx=0 tx=0).stop 2024-05-08T10:55:38.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.897+0000 7f8f6c5b5f40 1 -- 172.21.15.33:0/580008277 shutdown_connections 2024-05-08T10:55:38.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.897+0000 7f8f6c5b5f40 1 --2- 172.21.15.33:0/580008277 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x5561a52715f0 0x5561a525fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:38.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.897+0000 7f8f6c5b5f40 1 --2- 172.21.15.33:0/580008277 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5561a5271210 0x5561a5233360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:38.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.897+0000 7f8f6c5b5f40 1 --2- 172.21.15.33:0/580008277 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5561a5233950 0x5561a527a540 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:38.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.897+0000 7f8f6c5b5f40 1 -- 172.21.15.33:0/580008277 >> 172.21.15.33:0/580008277 conn(0x5561a525bd70 msgr2=0x5561a525c150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:38.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.897+0000 7f8f6c5b5f40 1 -- 172.21.15.33:0/580008277 shutdown_connections 2024-05-08T10:55:38.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.897+0000 7f8f6c5b5f40 1 -- 172.21.15.33:0/580008277 wait complete. 2024-05-08T10:55:38.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.898+0000 7f8f6c5b5f40 1 Processor -- start 2024-05-08T10:55:38.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.898+0000 7f8f6c5b5f40 1 -- start start 2024-05-08T10:55:38.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.899+0000 7f8f6c5b5f40 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5561a5233950 0x5561a52ffbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:38.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.899+0000 7f8f6c5b5f40 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x5561a5271210 0x5561a52fcb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:38.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.899+0000 7f8f6c5b5f40 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5561a52715f0 0x5561a52fd0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:38.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.899+0000 7f8f6c5b5f40 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561a5276660 con 0x5561a52715f0 2024-05-08T10:55:38.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.899+0000 7f8f6c5b5f40 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561a527a080 con 0x5561a5233950 2024-05-08T10:55:38.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.899+0000 7f8f6c5b5f40 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x5561a52ff730 con 0x5561a5271210 2024-05-08T10:55:38.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.899+0000 7f8f6a8b7640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5561a52715f0 0x5561a52fd0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:38.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.899+0000 7f8f6a8b7640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5561a52715f0 0x5561a52fd0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56450/0 (socket says 172.21.15.33:56450) 2024-05-08T10:55:38.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.899+0000 7f8f6a8b7640 1 -- 172.21.15.33:0/467986471 learned_addr learned my addr 172.21.15.33:0/467986471 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:38.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.899+0000 7f8f6a0b6640 1 --2- 172.21.15.33:0/467986471 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5561a5233950 0x5561a52ffbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:38.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.899+0000 7f8f63fff640 1 --2- 172.21.15.33:0/467986471 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x5561a5271210 0x5561a52fcb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:38.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.899+0000 7f8f6a8b7640 1 -- 172.21.15.33:0/467986471 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x5561a5271210 msgr2=0x5561a52fcb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:38.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.899+0000 7f8f6a8b7640 1 --2- 172.21.15.33:0/467986471 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x5561a5271210 0x5561a52fcb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:38.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.899+0000 7f8f6a8b7640 1 -- 172.21.15.33:0/467986471 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5561a5233950 msgr2=0x5561a52ffbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:38.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.899+0000 7f8f6a8b7640 1 --2- 172.21.15.33:0/467986471 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5561a5233950 0x5561a52ffbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:38.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.899+0000 7f8f6a8b7640 1 -- 172.21.15.33:0/467986471 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5561a53086c0 con 0x5561a52715f0 2024-05-08T10:55:38.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.899+0000 7f8f6a8b7640 1 --2- 172.21.15.33:0/467986471 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5561a52715f0 0x5561a52fd0d0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f8f64025b30 tx=0x7f8f64005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:38.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.900+0000 7f8f637fe640 1 -- 172.21.15.33:0/467986471 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f64067070 con 0x5561a52715f0 2024-05-08T10:55:38.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.900+0000 7f8f637fe640 1 -- 172.21.15.33:0/467986471 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f64050520 con 0x5561a52715f0 2024-05-08T10:55:38.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.900+0000 7f8f6c5b5f40 1 -- 172.21.15.33:0/467986471 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5561a5304170 con 0x5561a52715f0 2024-05-08T10:55:38.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.900+0000 7f8f637fe640 1 -- 172.21.15.33:0/467986471 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f64054040 con 0x5561a52715f0 2024-05-08T10:55:38.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.900+0000 7f8f6c5b5f40 1 -- 172.21.15.33:0/467986471 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5561a5270490 con 0x5561a52715f0 2024-05-08T10:55:38.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.901+0000 7f8f637fe640 1 -- 172.21.15.33:0/467986471 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8f6406a070 con 0x5561a52715f0 2024-05-08T10:55:38.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.901+0000 7f8f637fe640 1 --2- 172.21.15.33:0/467986471 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f8f4c069eb0 0x7f8f4c06c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:38.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.901+0000 7f8f637fe640 1 -- 172.21.15.33:0/467986471 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8f640cc640 con 0x5561a52715f0 2024-05-08T10:55:38.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.902+0000 7f8f6c5b5f40 1 --2- 172.21.15.33:0/467986471 >> [v2:172.21.15.174:6816/2326407945,v1:172.21.15.174:6817/2326407945] conn(0x5561a5300100 0x5561a53aa550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:38.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.902+0000 7f8f6c5b5f40 1 -- 172.21.15.33:0/467986471 --> [v2:172.21.15.174:6816/2326407945,v1:172.21.15.174:6817/2326407945] -- osd_op(unknown.0.0:1 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-keys in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v9 -- 0x5561a52fe1a0 con 0x5561a5300100 2024-05-08T10:55:38.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.902+0000 7f8f6a0b6640 1 --2- 172.21.15.33:0/467986471 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f8f4c069eb0 0x7f8f4c06c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:38.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.902+0000 7f8f63fff640 1 --2- 172.21.15.33:0/467986471 >> [v2:172.21.15.174:6816/2326407945,v1:172.21.15.174:6817/2326407945] conn(0x5561a5300100 0x5561a53aa550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:38.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.902+0000 7f8f6a0b6640 1 --2- 172.21.15.33:0/467986471 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f8f4c069eb0 0x7f8f4c06c370 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c003040 tx=0x7f8f5c009000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:38.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.902+0000 7f8f63fff640 1 --2- 172.21.15.33:0/467986471 >> [v2:172.21.15.174:6816/2326407945,v1:172.21.15.174:6817/2326407945] conn(0x5561a5300100 0x5561a53aa550 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:38.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.903+0000 7f8f63fff640 1 -- 172.21.15.33:0/467986471 <== osd.6 v2:172.21.15.174:6816/2326407945 1 ==== osd_op_reply(1 1.00000000 [omap-get-keys out=5b] v0'0 uv2 ondisk = 0) v8 ==== 154+0+5 (crc 0 0 0) 0x7f8f540098b0 con 0x5561a5300100 2024-05-08T10:55:38.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.903+0000 7f8f6c5b5f40 1 -- 172.21.15.33:0/467986471 >> [v2:172.21.15.174:6816/2326407945,v1:172.21.15.174:6817/2326407945] conn(0x5561a5300100 msgr2=0x5561a53aa550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:38.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.903+0000 7f8f6c5b5f40 1 --2- 172.21.15.33:0/467986471 >> [v2:172.21.15.174:6816/2326407945,v1:172.21.15.174:6817/2326407945] conn(0x5561a5300100 0x5561a53aa550 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:38.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.903+0000 7f8f6c5b5f40 1 -- 172.21.15.33:0/467986471 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f8f4c069eb0 msgr2=0x7f8f4c06c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:38.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.903+0000 7f8f6c5b5f40 1 --2- 172.21.15.33:0/467986471 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f8f4c069eb0 0x7f8f4c06c370 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c003040 tx=0x7f8f5c009000 comp rx=0 tx=0).stop 2024-05-08T10:55:38.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.903+0000 7f8f6c5b5f40 1 -- 172.21.15.33:0/467986471 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5561a52715f0 msgr2=0x5561a52fd0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:38.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.903+0000 7f8f6c5b5f40 1 --2- 172.21.15.33:0/467986471 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5561a52715f0 0x5561a52fd0d0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f8f64025b30 tx=0x7f8f64005880 comp rx=0 tx=0).stop 2024-05-08T10:55:38.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.903+0000 7f8f6a8b7640 1 -- 172.21.15.33:0/467986471 reap_dead start 2024-05-08T10:55:38.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.903+0000 7f8f6c5b5f40 1 -- 172.21.15.33:0/467986471 shutdown_connections 2024-05-08T10:55:38.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.903+0000 7f8f6c5b5f40 1 -- 172.21.15.33:0/467986471 >> 172.21.15.33:0/467986471 conn(0x5561a525bd70 msgr2=0x5561a525c150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:38.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.903+0000 7f8f6c5b5f40 1 -- 172.21.15.33:0/467986471 shutdown_connections 2024-05-08T10:55:38.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:38.903+0000 7f8f6c5b5f40 1 -- 172.21.15.33:0/467986471 wait complete. 2024-05-08T10:55:38.905 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T10:55:39.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.053+0000 7f14c3da2640 1 Processor -- start 2024-05-08T10:55:39.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.053+0000 7f14c3da2640 1 -- start start 2024-05-08T10:55:39.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.054+0000 7f14c3da2640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f14bc0d0920 0x7f14bc15e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:39.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.054+0000 7f14c3da2640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14bc0d4910 con 0x7f14bc0b4c60 2024-05-08T10:55:39.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.054+0000 7f14c3da2640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14bc0d25e0 con 0x7f14bc0d0540 2024-05-08T10:55:39.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.054+0000 7f14c3da2640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14bc0d46c0 con 0x7f14bc0d0920 2024-05-08T10:55:39.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.054+0000 7f14c233f640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f14bc0b4c60 0x7f14bc0ce7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:55472/0 (socket says 172.21.15.33:55472) 2024-05-08T10:55:39.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.054+0000 7f14c233f640 1 -- 172.21.15.33:0/2159805827 learned_addr learned my addr 172.21.15.33:0/2159805827 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-05-08T10:55:39.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.054+0000 7f14c133d640 1 --2- 172.21.15.33:0/2159805827 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f14bc0d0920 0x7f14bc15e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:39.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.054+0000 7f14c0b3c640 1 -- 172.21.15.33:0/2159805827 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 439280638 0 0) 0x7f14bc0d4910 con 0x7f14bc0b4c60 2024-05-08T10:55:39.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.054+0000 7f14c0b3c640 1 -- 172.21.15.33:0/2159805827 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14a8003520 con 0x7f14bc0b4c60 2024-05-08T10:55:39.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.054+0000 7f14c0b3c640 1 -- 172.21.15.33:0/2159805827 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2724320968 0 0) 0x7f14bc0d25e0 con 0x7f14bc0d0540 2024-05-08T10:55:39.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.054+0000 7f14c0b3c640 1 -- 172.21.15.33:0/2159805827 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14bc0d4910 con 0x7f14bc0d0540 2024-05-08T10:55:39.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.054+0000 7f14c0b3c640 1 -- 172.21.15.33:0/2159805827 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3518639160 0 0) 0x7f14a8003520 con 0x7f14bc0b4c60 2024-05-08T10:55:39.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.054+0000 7f14c0b3c640 1 -- 172.21.15.33:0/2159805827 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f14bc0d0920 msgr2=0x7f14bc15e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:39.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.054+0000 7f14c0b3c640 1 --2- 172.21.15.33:0/2159805827 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f14bc0d0920 0x7f14bc15e2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:39.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.054+0000 7f14c0b3c640 1 -- 172.21.15.33:0/2159805827 >> v1:172.21.15.174:6789/0 conn(0x7f14bc0d0540 legacy=0x7f14bc15dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:39.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.054+0000 7f14c0b3c640 1 -- 172.21.15.33:0/2159805827 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14bc0b4730 con 0x7f14bc0b4c60 2024-05-08T10:55:39.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.054+0000 7f14c0b3c640 1 -- 172.21.15.33:0/2159805827 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2948294915 0 0) 0x7f14b40019f0 con 0x7f14bc0b4c60 2024-05-08T10:55:39.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.054+0000 7f14c0b3c640 1 -- 172.21.15.33:0/2159805827 >> v1:172.21.15.33:6789/0 conn(0x7f14bc0b4c60 legacy=0x7f14bc0ce7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:39.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.054+0000 7f14c0b3c640 1 --2- 172.21.15.33:0/2159805827 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14a8003b70 0x7f14a8003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:39.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.055+0000 7f14c0b3c640 1 --2- 172.21.15.33:0/2159805827 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f14bc0d0920 0x7f14a8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:39.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.055+0000 7f14c0b3c640 1 --2- 172.21.15.33:0/2159805827 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f14a8004d40 0x7f14a80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:39.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.055+0000 7f14c0b3c640 1 -- 172.21.15.33:0/2159805827 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14bc0d46c0 con 0x7f14a8003b70 2024-05-08T10:55:39.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.055+0000 7f14c0b3c640 1 -- 172.21.15.33:0/2159805827 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14a800bb80 con 0x7f14a8004d40 2024-05-08T10:55:39.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.055+0000 7f14c0b3c640 1 -- 172.21.15.33:0/2159805827 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14a800bd80 con 0x7f14bc0d0920 2024-05-08T10:55:39.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.055+0000 7f14c1b3e640 1 --2- 172.21.15.33:0/2159805827 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14a8003b70 0x7f14a8003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:39.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.055+0000 7f14c133d640 1 --2- 172.21.15.33:0/2159805827 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f14bc0d0920 0x7f14a8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:39.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.055+0000 7f14c233f640 1 --2- 172.21.15.33:0/2159805827 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f14a8004d40 0x7f14a80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:39.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.055+0000 7f14c1b3e640 1 -- 172.21.15.33:0/2159805827 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f14bc0d0920 msgr2=0x7f14a8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:39.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.055+0000 7f14c1b3e640 1 --2- 172.21.15.33:0/2159805827 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f14bc0d0920 0x7f14a8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:39.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.055+0000 7f14c1b3e640 1 -- 172.21.15.33:0/2159805827 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f14a8004d40 msgr2=0x7f14a80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:39.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.055+0000 7f14c1b3e640 1 --2- 172.21.15.33:0/2159805827 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f14a8004d40 0x7f14a80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:39.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.055+0000 7f14c1b3e640 1 -- 172.21.15.33:0/2159805827 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14a8003520 con 0x7f14a8003b70 2024-05-08T10:55:39.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.055+0000 7f14c233f640 1 --2- 172.21.15.33:0/2159805827 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f14a8004d40 0x7f14a80051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:55:39.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.056+0000 7f14c1b3e640 1 --2- 172.21.15.33:0/2159805827 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14a8003b70 0x7f14a8003f70 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f14b80018d0 tx=0x7f14a8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9415d691fb1f1fa5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:39.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.056+0000 7f14c0b3c640 1 -- 172.21.15.33:0/2159805827 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14b80014f0 con 0x7f14a8003b70 2024-05-08T10:55:39.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.056+0000 7f14c0b3c640 1 -- 172.21.15.33:0/2159805827 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14b80052d0 con 0x7f14a8003b70 2024-05-08T10:55:39.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.056+0000 7f14c0b3c640 1 -- 172.21.15.33:0/2159805827 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14b802aca0 con 0x7f14a8003b70 2024-05-08T10:55:39.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.056+0000 7f14c3da2640 1 -- 172.21.15.33:0/2159805827 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14a8003b70 msgr2=0x7f14a8003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:39.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.056+0000 7f14c3da2640 1 --2- 172.21.15.33:0/2159805827 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14a8003b70 0x7f14a8003f70 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f14b80018d0 tx=0x7f14a8005830 comp rx=0 tx=0).stop 2024-05-08T10:55:39.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.056+0000 7f14c233f640 1 -- 172.21.15.33:0/2159805827 reap_dead start 2024-05-08T10:55:39.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.056+0000 7f14c3da2640 1 -- 172.21.15.33:0/2159805827 shutdown_connections 2024-05-08T10:55:39.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.056+0000 7f14c3da2640 1 -- 172.21.15.33:0/2159805827 >> 172.21.15.33:0/2159805827 conn(0x7f14bc0d3ba0 msgr2=0x7f14bc0d3fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:39.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.056+0000 7f14c3da2640 1 -- 172.21.15.33:0/2159805827 shutdown_connections 2024-05-08T10:55:39.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.056+0000 7f14c3da2640 1 -- 172.21.15.33:0/2159805827 wait complete. 2024-05-08T10:55:39.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.058+0000 7f14c3da2640 1 Processor -- start 2024-05-08T10:55:39.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.058+0000 7f14c3da2640 1 -- start start 2024-05-08T10:55:39.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.058+0000 7f14c3da2640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14a8003b70 0x7f14bc1f46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:39.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.058+0000 7f14c3da2640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f14bc15bf00 0x7f14bc0cd090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:39.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.058+0000 7f14c3da2640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f14bc15c380 0x7f14bc0cd5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:39.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.058+0000 7f14c3da2640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14bc0d2390 con 0x7f14a8003b70 2024-05-08T10:55:39.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.058+0000 7f14c3da2640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14bc0b5420 con 0x7f14bc15c380 2024-05-08T10:55:39.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.058+0000 7f14c3da2640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14bc0d2950 con 0x7f14bc15bf00 2024-05-08T10:55:39.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.059+0000 7f14c1b3e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14a8003b70 0x7f14bc1f46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:39.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.059+0000 7f14c1b3e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14a8003b70 0x7f14bc1f46f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56472/0 (socket says 172.21.15.33:56472) 2024-05-08T10:55:39.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.059+0000 7f14c1b3e640 1 -- 172.21.15.33:0/2744128812 learned_addr learned my addr 172.21.15.33:0/2744128812 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:39.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.059+0000 7f14c133d640 1 --2- 172.21.15.33:0/2744128812 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f14bc15bf00 0x7f14bc0cd090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:39.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.059+0000 7f14c233f640 1 --2- 172.21.15.33:0/2744128812 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f14bc15c380 0x7f14bc0cd5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:39.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.059+0000 7f14c1b3e640 1 -- 172.21.15.33:0/2744128812 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f14bc15bf00 msgr2=0x7f14bc0cd090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:39.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.059+0000 7f14c1b3e640 1 --2- 172.21.15.33:0/2744128812 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f14bc15bf00 0x7f14bc0cd090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:39.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.059+0000 7f14c1b3e640 1 -- 172.21.15.33:0/2744128812 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f14bc15c380 msgr2=0x7f14bc0cd5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:39.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.059+0000 7f14c1b3e640 1 --2- 172.21.15.33:0/2744128812 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f14bc15c380 0x7f14bc0cd5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:39.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.059+0000 7f14c1b3e640 1 -- 172.21.15.33:0/2744128812 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14bc1f4c30 con 0x7f14a8003b70 2024-05-08T10:55:39.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.059+0000 7f14c1b3e640 1 --2- 172.21.15.33:0/2744128812 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14a8003b70 0x7f14bc1f46f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f14b8005040 tx=0x7f14b80012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:39.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.059+0000 7f14b27fc640 1 -- 172.21.15.33:0/2744128812 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14b803f020 con 0x7f14a8003b70 2024-05-08T10:55:39.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.059+0000 7f14b27fc640 1 -- 172.21.15.33:0/2744128812 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14b8006e50 con 0x7f14a8003b70 2024-05-08T10:55:39.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.059+0000 7f14c3da2640 1 -- 172.21.15.33:0/2744128812 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14bc0b0ab0 con 0x7f14a8003b70 2024-05-08T10:55:39.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.059+0000 7f14b27fc640 1 -- 172.21.15.33:0/2744128812 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14b8037040 con 0x7f14a8003b70 2024-05-08T10:55:39.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.059+0000 7f14c3da2640 1 -- 172.21.15.33:0/2744128812 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14bc0b1070 con 0x7f14a8003b70 2024-05-08T10:55:39.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.061+0000 7f14c3da2640 1 -- 172.21.15.33:0/2744128812 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14bc069d20 con 0x7f14a8003b70 2024-05-08T10:55:39.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.061+0000 7f14b27fc640 1 -- 172.21.15.33:0/2744128812 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f14b8042020 con 0x7f14a8003b70 2024-05-08T10:55:39.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.061+0000 7f14b27fc640 1 --2- 172.21.15.33:0/2744128812 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f14a006b4d0 0x7f14a006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:39.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.062+0000 7f14b27fc640 1 -- 172.21.15.33:0/2744128812 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f14b80a9b40 con 0x7f14a8003b70 2024-05-08T10:55:39.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.062+0000 7f14c133d640 1 --2- 172.21.15.33:0/2744128812 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f14a006b4d0 0x7f14a006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:39.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.062+0000 7f14c133d640 1 --2- 172.21.15.33:0/2744128812 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f14a006b4d0 0x7f14a006d990 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f14bc0cdd70 tx=0x7f14ac009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:39.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.066+0000 7f14b27fc640 1 -- 172.21.15.33:0/2744128812 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f14b8049030 con 0x7f14a8003b70 2024-05-08T10:55:39.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.283+0000 7f14c3da2640 1 -- 172.21.15.33:0/2744128812 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f14bc06c850 con 0x7f14a8003b70 2024-05-08T10:55:39.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.284+0000 7f14b27fc640 1 -- 172.21.15.33:0/2744128812 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4941 (secure 0 0 0) 0x7f14bc1f4c30 con 0x7f14a8003b70 2024-05-08T10:55:39.281 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:55:39.281 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4592,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6836/2731663891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2731663891},{"type":"v1","addr":"172.21.15.174:6836","nonce":2731663891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":4598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/2004985147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6833","nonce":2004985147},{"type":"v1","addr":"172.21.15.33:6835","nonce":2004985147}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4702,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6837/3164144740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6835","nonce":3164144740},{"type":"v1","addr":"172.21.15.174:6837","nonce":3164144740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T10:55:31.311811+0000","modified":"2024-05-08T10:55:33.333600+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4708},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4708":{"gid":4708,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.33:6834/415400390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":415400390},{"type":"v1","addr":"172.21.15.33:6834","nonce":415400390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-05-08T10:55:39.281 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 14 2024-05-08T10:55:39.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.285+0000 7f14c3da2640 1 -- 172.21.15.33:0/2744128812 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f14a006b4d0 msgr2=0x7f14a006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:39.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.285+0000 7f14c3da2640 1 --2- 172.21.15.33:0/2744128812 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f14a006b4d0 0x7f14a006d990 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f14bc0cdd70 tx=0x7f14ac009190 comp rx=0 tx=0).stop 2024-05-08T10:55:39.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.285+0000 7f14c3da2640 1 -- 172.21.15.33:0/2744128812 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14a8003b70 msgr2=0x7f14bc1f46f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:39.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.285+0000 7f14c3da2640 1 --2- 172.21.15.33:0/2744128812 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14a8003b70 0x7f14bc1f46f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f14b8005040 tx=0x7f14b80012d0 comp rx=0 tx=0).stop 2024-05-08T10:55:39.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.285+0000 7f14c3da2640 1 -- 172.21.15.33:0/2744128812 shutdown_connections 2024-05-08T10:55:39.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.285+0000 7f14c3da2640 1 --2- 172.21.15.33:0/2744128812 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f14a006b4d0 0x7f14a006d990 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:39.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.285+0000 7f14c3da2640 1 --2- 172.21.15.33:0/2744128812 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f14bc15c380 0x7f14bc0cd5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:39.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.285+0000 7f14c3da2640 1 --2- 172.21.15.33:0/2744128812 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f14bc15bf00 0x7f14bc0cd090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:39.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.285+0000 7f14c3da2640 1 --2- 172.21.15.33:0/2744128812 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14a8003b70 0x7f14bc1f46f0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:39.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.285+0000 7f14c3da2640 1 -- 172.21.15.33:0/2744128812 >> 172.21.15.33:0/2744128812 conn(0x7f14bc0d3ba0 msgr2=0x7f14bc06b230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:39.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.286+0000 7f14c3da2640 1 -- 172.21.15.33:0/2744128812 shutdown_connections 2024-05-08T10:55:39.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.286+0000 7f14c3da2640 1 -- 172.21.15.33:0/2744128812 wait complete. 2024-05-08T10:55:39.294 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2024-05-08T10:55:39.419 INFO:teuthology.orchestra.run.smithi033.stdout:{"message":"","return_code":0} 2024-05-08T10:55:39.419 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-05-08T10:55:39.420 DEBUG:teuthology.orchestra.run.smithi033:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata listomapkeys 10000000000.00000000 2024-05-08T10:55:39.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.466+0000 7f5d643c7f40 1 Processor -- start 2024-05-08T10:55:39.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.466+0000 7f5d643c7f40 1 -- start start 2024-05-08T10:55:39.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.467+0000 7f5d643c7f40 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5d4c002850 0x5636edb6eba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:39.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.467+0000 7f5d643c7f40 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5636edb7d6d0 0x5636edaa5e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:39.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.467+0000 7f5d643c7f40 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5636edb6a770 0x5636edb6ab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:39.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.467+0000 7f5d643c7f40 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636eda4db70 con 0x5636edb7d6d0 2024-05-08T10:55:39.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.467+0000 7f5d643c7f40 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636eda51ad0 con 0x5636edb6a770 2024-05-08T10:55:39.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.467+0000 7f5d643c7f40 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x5636edb7f3d0 con 0x7f5d4c002850 2024-05-08T10:55:39.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.467+0000 7f5d616c7640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5636edb7d6d0 0x5636edaa5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:39.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.467+0000 7f5d616c7640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5636edb7d6d0 0x5636edaa5e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56496/0 (socket says 172.21.15.33:56496) 2024-05-08T10:55:39.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.467+0000 7f5d616c7640 1 -- 172.21.15.33:0/3604051387 learned_addr learned my addr 172.21.15.33:0/3604051387 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:39.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.467+0000 7f5d616c7640 1 -- 172.21.15.33:0/3604051387 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5d4c002850 msgr2=0x5636edb6eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:39.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.467+0000 7f5d626c9640 1 --2- 172.21.15.33:0/3604051387 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5636edb6a770 0x5636edb6ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:39.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.467+0000 7f5d61ec8640 1 --2- 172.21.15.33:0/3604051387 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5d4c002850 0x5636edb6eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:39.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.467+0000 7f5d616c7640 1 --2- 172.21.15.33:0/3604051387 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5d4c002850 0x5636edb6eba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:39.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.467+0000 7f5d616c7640 1 -- 172.21.15.33:0/3604051387 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5636edb6a770 msgr2=0x5636edb6ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:39.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.467+0000 7f5d616c7640 1 --2- 172.21.15.33:0/3604051387 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5636edb6a770 0x5636edb6ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:39.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.467+0000 7f5d616c7640 1 -- 172.21.15.33:0/3604051387 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5636edb71720 con 0x5636edb7d6d0 2024-05-08T10:55:39.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.467+0000 7f5d616c7640 1 --2- 172.21.15.33:0/3604051387 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5636edb7d6d0 0x5636edaa5e30 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f5d580258a0 tx=0x7f5d58051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a977c23144fff02f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:39.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.468+0000 7f5d53fff640 1 -- 172.21.15.33:0/3604051387 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d58055440 con 0x5636edb7d6d0 2024-05-08T10:55:39.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.468+0000 7f5d53fff640 1 -- 172.21.15.33:0/3604051387 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d58055810 con 0x5636edb7d6d0 2024-05-08T10:55:39.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.468+0000 7f5d53fff640 1 -- 172.21.15.33:0/3604051387 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d58055c00 con 0x5636edb7d6d0 2024-05-08T10:55:39.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.468+0000 7f5d643c7f40 1 -- 172.21.15.33:0/3604051387 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5636edb7d6d0 msgr2=0x5636edaa5e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:39.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.468+0000 7f5d643c7f40 1 --2- 172.21.15.33:0/3604051387 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5636edb7d6d0 0x5636edaa5e30 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f5d580258a0 tx=0x7f5d58051000 comp rx=0 tx=0).stop 2024-05-08T10:55:39.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.468+0000 7f5d643c7f40 1 -- 172.21.15.33:0/3604051387 shutdown_connections 2024-05-08T10:55:39.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.468+0000 7f5d643c7f40 1 --2- 172.21.15.33:0/3604051387 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5636edb6a770 0x5636edb6ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:39.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.468+0000 7f5d643c7f40 1 --2- 172.21.15.33:0/3604051387 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5636edb7d6d0 0x5636edaa5e30 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:39.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.468+0000 7f5d643c7f40 1 --2- 172.21.15.33:0/3604051387 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5d4c002850 0x5636edb6eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:39.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.468+0000 7f5d643c7f40 1 -- 172.21.15.33:0/3604051387 >> 172.21.15.33:0/3604051387 conn(0x5636edad1d70 msgr2=0x5636edaa8bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:39.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.468+0000 7f5d643c7f40 1 -- 172.21.15.33:0/3604051387 shutdown_connections 2024-05-08T10:55:39.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.468+0000 7f5d643c7f40 1 -- 172.21.15.33:0/3604051387 wait complete. 2024-05-08T10:55:39.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.469+0000 7f5d643c7f40 1 Processor -- start 2024-05-08T10:55:39.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.469+0000 7f5d643c7f40 1 -- start start 2024-05-08T10:55:39.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.469+0000 7f5d643c7f40 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5636edb6a770 0x5636edb6e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:39.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.469+0000 7f5d643c7f40 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x5636edb7d6d0 0x5636edb68e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:39.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.469+0000 7f5d643c7f40 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5d4c002850 0x5636edb6d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:39.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.469+0000 7f5d643c7f40 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636edb79b90 con 0x5636edb6a770 2024-05-08T10:55:39.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.469+0000 7f5d643c7f40 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636edb7b600 con 0x7f5d4c002850 2024-05-08T10:55:39.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.469+0000 7f5d643c7f40 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x5636edaa92c0 con 0x5636edb7d6d0 2024-05-08T10:55:39.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.469+0000 7f5d61ec8640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5636edb6a770 0x5636edb6e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:39.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.470+0000 7f5d61ec8640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5636edb6a770 0x5636edb6e250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56512/0 (socket says 172.21.15.33:56512) 2024-05-08T10:55:39.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.470+0000 7f5d61ec8640 1 -- 172.21.15.33:0/3047732367 learned_addr learned my addr 172.21.15.33:0/3047732367 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:39.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.470+0000 7f5d616c7640 1 --2- 172.21.15.33:0/3047732367 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x5636edb7d6d0 0x5636edb68e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:39.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.470+0000 7f5d626c9640 1 --2- 172.21.15.33:0/3047732367 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5d4c002850 0x5636edb6d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:39.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.470+0000 7f5d61ec8640 1 -- 172.21.15.33:0/3047732367 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x5636edb7d6d0 msgr2=0x5636edb68e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:39.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.470+0000 7f5d61ec8640 1 --2- 172.21.15.33:0/3047732367 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x5636edb7d6d0 0x5636edb68e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:39.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.470+0000 7f5d61ec8640 1 -- 172.21.15.33:0/3047732367 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5d4c002850 msgr2=0x5636edb6d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:39.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.470+0000 7f5d61ec8640 1 --2- 172.21.15.33:0/3047732367 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5d4c002850 0x5636edb6d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:39.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.470+0000 7f5d61ec8640 1 -- 172.21.15.33:0/3047732367 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5636edb69740 con 0x5636edb6a770 2024-05-08T10:55:39.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.470+0000 7f5d626c9640 1 --2- 172.21.15.33:0/3047732367 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5d4c002850 0x5636edb6d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:55:39.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.470+0000 7f5d61ec8640 1 --2- 172.21.15.33:0/3047732367 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5636edb6a770 0x5636edb6e250 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f5d54001780 tx=0x7f5d5400f880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:39.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.470+0000 7f5d52ffd640 1 -- 172.21.15.33:0/3047732367 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d5400d840 con 0x5636edb6a770 2024-05-08T10:55:39.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.470+0000 7f5d52ffd640 1 -- 172.21.15.33:0/3047732367 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d5400d9e0 con 0x5636edb6a770 2024-05-08T10:55:39.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.470+0000 7f5d643c7f40 1 -- 172.21.15.33:0/3047732367 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5636edaa89f0 con 0x5636edb6a770 2024-05-08T10:55:39.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.470+0000 7f5d52ffd640 1 -- 172.21.15.33:0/3047732367 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d5400ddd0 con 0x5636edb6a770 2024-05-08T10:55:39.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.470+0000 7f5d643c7f40 1 -- 172.21.15.33:0/3047732367 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5636edb69340 con 0x5636edb6a770 2024-05-08T10:55:39.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.472+0000 7f5d52ffd640 1 -- 172.21.15.33:0/3047732367 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5d54018440 con 0x5636edb6a770 2024-05-08T10:55:39.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.472+0000 7f5d52ffd640 1 --2- 172.21.15.33:0/3047732367 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f5d44069eb0 0x7f5d4406c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:39.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.472+0000 7f5d52ffd640 1 -- 172.21.15.33:0/3047732367 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5d54089720 con 0x5636edb6a770 2024-05-08T10:55:39.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.472+0000 7f5d616c7640 1 --2- 172.21.15.33:0/3047732367 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f5d44069eb0 0x7f5d4406c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:39.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.472+0000 7f5d643c7f40 1 --2- 172.21.15.33:0/3047732367 >> [v2:172.21.15.33:6802/4029047077,v1:172.21.15.33:6804/4029047077] conn(0x5636edb6dab0 0x5636edb6bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:39.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.472+0000 7f5d643c7f40 1 -- 172.21.15.33:0/3047732367 --> [v2:172.21.15.33:6802/4029047077,v1:172.21.15.33:6804/4029047077] -- osd_op(unknown.0.0:1 4.10 4:0cf6ad0f:::10000000000.00000000:head [omap-get-keys in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v9 -- 0x5636edb69a20 con 0x5636edb6dab0 2024-05-08T10:55:39.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.472+0000 7f5d626c9640 1 --2- 172.21.15.33:0/3047732367 >> [v2:172.21.15.33:6802/4029047077,v1:172.21.15.33:6804/4029047077] conn(0x5636edb6dab0 0x5636edb6bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:39.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.473+0000 7f5d626c9640 1 --2- 172.21.15.33:0/3047732367 >> [v2:172.21.15.33:6802/4029047077,v1:172.21.15.33:6804/4029047077] conn(0x5636edb6dab0 0x5636edb6bb60 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:39.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.473+0000 7f5d616c7640 1 --2- 172.21.15.33:0/3047732367 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f5d44069eb0 0x7f5d4406c370 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5d5804e010 tx=0x7f5d58053000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:39.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.473+0000 7f5d626c9640 1 -- 172.21.15.33:0/3047732367 <== osd.3 v2:172.21.15.33:6802/4029047077 1 ==== osd_op_reply(1 10000000000.00000000 [omap-get-keys out=19b] v0'0 uv10 ondisk = 0) v8 ==== 164+0+19 (crc 0 0 0) 0x7f5d5c00a870 con 0x5636edb6dab0 2024-05-08T10:55:39.474 INFO:teuthology.orchestra.run.smithi033.stdout:alpha_head 2024-05-08T10:55:39.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.473+0000 7f5d643c7f40 1 -- 172.21.15.33:0/3047732367 >> [v2:172.21.15.33:6802/4029047077,v1:172.21.15.33:6804/4029047077] conn(0x5636edb6dab0 msgr2=0x5636edb6bb60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:39.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.473+0000 7f5d643c7f40 1 --2- 172.21.15.33:0/3047732367 >> [v2:172.21.15.33:6802/4029047077,v1:172.21.15.33:6804/4029047077] conn(0x5636edb6dab0 0x5636edb6bb60 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:39.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.473+0000 7f5d643c7f40 1 -- 172.21.15.33:0/3047732367 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f5d44069eb0 msgr2=0x7f5d4406c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:39.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.473+0000 7f5d643c7f40 1 --2- 172.21.15.33:0/3047732367 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f5d44069eb0 0x7f5d4406c370 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5d5804e010 tx=0x7f5d58053000 comp rx=0 tx=0).stop 2024-05-08T10:55:39.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.473+0000 7f5d643c7f40 1 -- 172.21.15.33:0/3047732367 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5636edb6a770 msgr2=0x5636edb6e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:39.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.473+0000 7f5d643c7f40 1 --2- 172.21.15.33:0/3047732367 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5636edb6a770 0x5636edb6e250 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f5d54001780 tx=0x7f5d5400f880 comp rx=0 tx=0).stop 2024-05-08T10:55:39.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.473+0000 7f5d626c9640 1 -- 172.21.15.33:0/3047732367 reap_dead start 2024-05-08T10:55:39.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.473+0000 7f5d643c7f40 1 -- 172.21.15.33:0/3047732367 shutdown_connections 2024-05-08T10:55:39.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.473+0000 7f5d643c7f40 1 -- 172.21.15.33:0/3047732367 >> 172.21.15.33:0/3047732367 conn(0x5636edad1d70 msgr2=0x5636edb718f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:39.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.473+0000 7f5d643c7f40 1 -- 172.21.15.33:0/3047732367 shutdown_connections 2024-05-08T10:55:39.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.473+0000 7f5d643c7f40 1 -- 172.21.15.33:0/3047732367 wait complete. 2024-05-08T10:55:39.477 DEBUG:teuthology.orchestra.run.smithi033:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata listomapkeys 1.00000000 2024-05-08T10:55:39.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.523+0000 7fbbc271ff40 1 Processor -- start 2024-05-08T10:55:39.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.523+0000 7fbbc271ff40 1 -- start start 2024-05-08T10:55:39.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.524+0000 7fbbc271ff40 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558ec846a400 0x558ec841fe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:39.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.524+0000 7fbbc271ff40 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x558ec84f5590 0x558ec8420350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:39.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.524+0000 7fbbc271ff40 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558ec84f3e90 0x558ec8420890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:39.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.524+0000 7fbbc271ff40 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ec84f6020 con 0x558ec846a400 2024-05-08T10:55:39.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.524+0000 7fbbc271ff40 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ec83c8b70 con 0x558ec84f3e90 2024-05-08T10:55:39.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.524+0000 7fbbc271ff40 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x558ec846bad0 con 0x558ec84f5590 2024-05-08T10:55:39.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.524+0000 7fbbbf7a8640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558ec846a400 0x558ec841fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:39.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.524+0000 7fbbbf7a8640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558ec846a400 0x558ec841fe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56522/0 (socket says 172.21.15.33:56522) 2024-05-08T10:55:39.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.524+0000 7fbbbf7a8640 1 -- 172.21.15.33:0/2387725730 learned_addr learned my addr 172.21.15.33:0/2387725730 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:39.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.524+0000 7fbbbf7a8640 1 -- 172.21.15.33:0/2387725730 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x558ec84f5590 msgr2=0x558ec8420350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:39.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.524+0000 7fbbbf7a8640 1 --2- 172.21.15.33:0/2387725730 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x558ec84f5590 0x558ec8420350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:39.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.524+0000 7fbbbf7a8640 1 -- 172.21.15.33:0/2387725730 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558ec84f3e90 msgr2=0x558ec8420890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:39.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.524+0000 7fbbbf7a8640 1 --2- 172.21.15.33:0/2387725730 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558ec84f3e90 0x558ec8420890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:39.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.524+0000 7fbbbf7a8640 1 -- 172.21.15.33:0/2387725730 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558ec84f4bb0 con 0x558ec846a400 2024-05-08T10:55:39.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.525+0000 7fbbbf7a8640 1 --2- 172.21.15.33:0/2387725730 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558ec846a400 0x558ec841fe10 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fbbb0059040 tx=0x7fbbb004f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1fb4bb58a6486b8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:39.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.525+0000 7fbbbdfa5640 1 -- 172.21.15.33:0/2387725730 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb0005230 con 0x558ec846a400 2024-05-08T10:55:39.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.525+0000 7fbbbdfa5640 1 -- 172.21.15.33:0/2387725730 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbb0065070 con 0x558ec846a400 2024-05-08T10:55:39.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.525+0000 7fbbbdfa5640 1 -- 172.21.15.33:0/2387725730 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb004d910 con 0x558ec846a400 2024-05-08T10:55:39.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.525+0000 7fbbc271ff40 1 -- 172.21.15.33:0/2387725730 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558ec846a400 msgr2=0x558ec841fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:39.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.525+0000 7fbbc271ff40 1 --2- 172.21.15.33:0/2387725730 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558ec846a400 0x558ec841fe10 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fbbb0059040 tx=0x7fbbb004f000 comp rx=0 tx=0).stop 2024-05-08T10:55:39.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.525+0000 7fbbc271ff40 1 -- 172.21.15.33:0/2387725730 shutdown_connections 2024-05-08T10:55:39.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.525+0000 7fbbc271ff40 1 --2- 172.21.15.33:0/2387725730 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558ec84f3e90 0x558ec8420890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:39.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.525+0000 7fbbc271ff40 1 --2- 172.21.15.33:0/2387725730 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x558ec84f5590 0x558ec8420350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:39.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.525+0000 7fbbc271ff40 1 --2- 172.21.15.33:0/2387725730 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558ec846a400 0x558ec841fe10 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:39.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.525+0000 7fbbc271ff40 1 -- 172.21.15.33:0/2387725730 >> 172.21.15.33:0/2387725730 conn(0x558ec844cd70 msgr2=0x558ec84f3780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:39.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.525+0000 7fbbc271ff40 1 -- 172.21.15.33:0/2387725730 shutdown_connections 2024-05-08T10:55:39.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.525+0000 7fbbc271ff40 1 -- 172.21.15.33:0/2387725730 wait complete. 2024-05-08T10:55:39.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.526+0000 7fbbc271ff40 1 Processor -- start 2024-05-08T10:55:39.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.526+0000 7fbbc271ff40 1 -- start start 2024-05-08T10:55:39.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.527+0000 7fbbc271ff40 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558ec846a400 0x558ec841fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:39.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.527+0000 7fbbc271ff40 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558ec84f3e90 0x558ec8420350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:39.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.527+0000 7fbbc271ff40 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x558ec84f5590 0x558ec84ee520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:39.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.527+0000 7fbbc271ff40 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ec84f4e50 con 0x558ec84f3e90 2024-05-08T10:55:39.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.527+0000 7fbbc271ff40 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ec84f1cc0 con 0x558ec846a400 2024-05-08T10:55:39.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.527+0000 7fbbc271ff40 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x558ec84f50f0 con 0x558ec84f5590 2024-05-08T10:55:39.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.527+0000 7fbbbefa7640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558ec84f3e90 0x558ec8420350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:39.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.527+0000 7fbbbefa7640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558ec84f3e90 0x558ec8420350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56538/0 (socket says 172.21.15.33:56538) 2024-05-08T10:55:39.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.527+0000 7fbbbefa7640 1 -- 172.21.15.33:0/583585890 learned_addr learned my addr 172.21.15.33:0/583585890 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:39.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.527+0000 7fbbbf7a8640 1 --2- 172.21.15.33:0/583585890 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558ec846a400 0x558ec841fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:39.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.527+0000 7fbbbffa9640 1 --2- 172.21.15.33:0/583585890 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x558ec84f5590 0x558ec84ee520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:39.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.527+0000 7fbbbefa7640 1 -- 172.21.15.33:0/583585890 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x558ec84f5590 msgr2=0x558ec84ee520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:39.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.527+0000 7fbbbefa7640 1 --2- 172.21.15.33:0/583585890 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x558ec84f5590 0x558ec84ee520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:39.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.527+0000 7fbbbefa7640 1 -- 172.21.15.33:0/583585890 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558ec846a400 msgr2=0x558ec841fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:39.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.527+0000 7fbbbefa7640 1 --2- 172.21.15.33:0/583585890 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558ec846a400 0x558ec841fe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:39.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.527+0000 7fbbbefa7640 1 -- 172.21.15.33:0/583585890 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558ec84dc4d0 con 0x558ec84f3e90 2024-05-08T10:55:39.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.527+0000 7fbbbefa7640 1 --2- 172.21.15.33:0/583585890 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558ec84f3e90 0x558ec8420350 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fbba8001200 tx=0x7fbba800b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:39.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.527+0000 7fbbbcfa3640 1 -- 172.21.15.33:0/583585890 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbba8013070 con 0x558ec84f3e90 2024-05-08T10:55:39.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.527+0000 7fbbbcfa3640 1 -- 172.21.15.33:0/583585890 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbba800f860 con 0x558ec84f3e90 2024-05-08T10:55:39.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.527+0000 7fbbc271ff40 1 -- 172.21.15.33:0/583585890 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558ec84dc7b0 con 0x558ec84f3e90 2024-05-08T10:55:39.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.527+0000 7fbbbcfa3640 1 -- 172.21.15.33:0/583585890 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbba800fc30 con 0x558ec84f3e90 2024-05-08T10:55:39.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.527+0000 7fbbc271ff40 1 -- 172.21.15.33:0/583585890 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558ec84dcd70 con 0x558ec84f3e90 2024-05-08T10:55:39.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.529+0000 7fbbbcfa3640 1 -- 172.21.15.33:0/583585890 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fbba8016070 con 0x558ec84f3e90 2024-05-08T10:55:39.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.529+0000 7fbbbcfa3640 1 --2- 172.21.15.33:0/583585890 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fbba0069eb0 0x7fbba006c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:39.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.529+0000 7fbbbcfa3640 1 -- 172.21.15.33:0/583585890 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbba8089570 con 0x558ec84f3e90 2024-05-08T10:55:39.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.530+0000 7fbbbf7a8640 1 --2- 172.21.15.33:0/583585890 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fbba0069eb0 0x7fbba006c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:39.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.530+0000 7fbbc271ff40 1 --2- 172.21.15.33:0/583585890 >> [v2:172.21.15.174:6816/2326407945,v1:172.21.15.174:6817/2326407945] conn(0x558ec84ee0e0 0x558ec84eea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:39.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.530+0000 7fbbc271ff40 1 -- 172.21.15.33:0/583585890 --> [v2:172.21.15.174:6816/2326407945,v1:172.21.15.174:6817/2326407945] -- osd_op(unknown.0.0:1 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-keys in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v9 -- 0x558ec84dbff0 con 0x558ec84ee0e0 2024-05-08T10:55:39.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.530+0000 7fbbbffa9640 1 --2- 172.21.15.33:0/583585890 >> [v2:172.21.15.174:6816/2326407945,v1:172.21.15.174:6817/2326407945] conn(0x558ec84ee0e0 0x558ec84eea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:39.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.530+0000 7fbbbf7a8640 1 --2- 172.21.15.33:0/583585890 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fbba0069eb0 0x7fbba006c370 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fbbb0061000 tx=0x7fbbb0051000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:39.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.530+0000 7fbbbffa9640 1 --2- 172.21.15.33:0/583585890 >> [v2:172.21.15.174:6816/2326407945,v1:172.21.15.174:6817/2326407945] conn(0x558ec84ee0e0 0x558ec84eea60 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:39.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.531+0000 7fbbbffa9640 1 -- 172.21.15.33:0/583585890 <== osd.6 v2:172.21.15.174:6816/2326407945 1 ==== osd_op_reply(1 1.00000000 [omap-get-keys out=19b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+19 (crc 0 0 0) 0x7fbbb80094f0 con 0x558ec84ee0e0 2024-05-08T10:55:39.531 INFO:teuthology.orchestra.run.smithi033.stdout:mydir_head 2024-05-08T10:55:39.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.531+0000 7fbbc271ff40 1 -- 172.21.15.33:0/583585890 >> [v2:172.21.15.174:6816/2326407945,v1:172.21.15.174:6817/2326407945] conn(0x558ec84ee0e0 msgr2=0x558ec84eea60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:39.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.531+0000 7fbbc271ff40 1 --2- 172.21.15.33:0/583585890 >> [v2:172.21.15.174:6816/2326407945,v1:172.21.15.174:6817/2326407945] conn(0x558ec84ee0e0 0x558ec84eea60 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:39.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.531+0000 7fbbc271ff40 1 -- 172.21.15.33:0/583585890 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fbba0069eb0 msgr2=0x7fbba006c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:39.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.531+0000 7fbbc271ff40 1 --2- 172.21.15.33:0/583585890 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fbba0069eb0 0x7fbba006c370 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fbbb0061000 tx=0x7fbbb0051000 comp rx=0 tx=0).stop 2024-05-08T10:55:39.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.531+0000 7fbbc271ff40 1 -- 172.21.15.33:0/583585890 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558ec84f3e90 msgr2=0x558ec8420350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:39.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.531+0000 7fbbc271ff40 1 --2- 172.21.15.33:0/583585890 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558ec84f3e90 0x558ec8420350 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fbba8001200 tx=0x7fbba800b6c0 comp rx=0 tx=0).stop 2024-05-08T10:55:39.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.531+0000 7fbbbffa9640 1 -- 172.21.15.33:0/583585890 reap_dead start 2024-05-08T10:55:39.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.531+0000 7fbbc271ff40 1 -- 172.21.15.33:0/583585890 shutdown_connections 2024-05-08T10:55:39.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.531+0000 7fbbc271ff40 1 -- 172.21.15.33:0/583585890 >> 172.21.15.33:0/583585890 conn(0x558ec844cd70 msgr2=0x558ec8468b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:39.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.531+0000 7fbbc271ff40 1 -- 172.21.15.33:0/583585890 shutdown_connections 2024-05-08T10:55:39.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.531+0000 7fbbc271ff40 1 -- 172.21.15.33:0/583585890 wait complete. 2024-05-08T10:55:39.533 DEBUG:teuthology.orchestra.run.smithi033:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000001.00000000 parent 2024-05-08T10:55:39.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.621+0000 7fc452993f40 1 Processor -- start 2024-05-08T10:55:39.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.621+0000 7fc452993f40 1 -- start start 2024-05-08T10:55:39.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.621+0000 7fc452993f40 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x556bd26f0970 0x556bd26f4b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:39.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.621+0000 7fc452993f40 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556bd270eda0 0x556bd26c6950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:39.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.621+0000 7fc452993f40 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556bd270f6c0 0x556bd26c4e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:39.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.621+0000 7fc452993f40 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bd279b020 con 0x556bd270eda0 2024-05-08T10:55:39.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.621+0000 7fc452993f40 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bd266db70 con 0x556bd270f6c0 2024-05-08T10:55:39.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.621+0000 7fc452993f40 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x556bd2710ad0 con 0x556bd26f0970 2024-05-08T10:55:39.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.622+0000 7fc44fc93640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556bd270eda0 0x556bd26c6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:39.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.622+0000 7fc44fc93640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556bd270eda0 0x556bd26c6950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56558/0 (socket says 172.21.15.33:56558) 2024-05-08T10:55:39.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.622+0000 7fc44fc93640 1 -- 172.21.15.33:0/4058162354 learned_addr learned my addr 172.21.15.33:0/4058162354 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:39.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.622+0000 7fc450494640 1 --2- 172.21.15.33:0/4058162354 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x556bd26f0970 0x556bd26f4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:39.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.622+0000 7fc450c95640 1 --2- 172.21.15.33:0/4058162354 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556bd270f6c0 0x556bd26c4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:39.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.622+0000 7fc44fc93640 1 -- 172.21.15.33:0/4058162354 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x556bd26f0970 msgr2=0x556bd26f4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:39.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.622+0000 7fc44fc93640 1 --2- 172.21.15.33:0/4058162354 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x556bd26f0970 0x556bd26f4b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:39.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.622+0000 7fc44fc93640 1 -- 172.21.15.33:0/4058162354 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556bd270f6c0 msgr2=0x556bd26c4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:39.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.622+0000 7fc44fc93640 1 --2- 172.21.15.33:0/4058162354 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556bd270f6c0 0x556bd26c4e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:39.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.622+0000 7fc44fc93640 1 -- 172.21.15.33:0/4058162354 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556bd26c6e90 con 0x556bd270eda0 2024-05-08T10:55:39.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.622+0000 7fc450494640 1 --2- 172.21.15.33:0/4058162354 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x556bd26f0970 0x556bd26f4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:55:39.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.622+0000 7fc44fc93640 1 --2- 172.21.15.33:0/4058162354 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556bd270eda0 0x556bd26c6950 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fc44400a4a0 tx=0x7fc44400a960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=785607ff4ef7d209 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:39.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.622+0000 7fc44ec91640 1 -- 172.21.15.33:0/4058162354 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc44400b8d0 con 0x556bd270eda0 2024-05-08T10:55:39.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.622+0000 7fc44ec91640 1 -- 172.21.15.33:0/4058162354 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc44400f070 con 0x556bd270eda0 2024-05-08T10:55:39.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.622+0000 7fc44ec91640 1 -- 172.21.15.33:0/4058162354 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc44400bc90 con 0x556bd270eda0 2024-05-08T10:55:39.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.623+0000 7fc452993f40 1 -- 172.21.15.33:0/4058162354 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556bd270eda0 msgr2=0x556bd26c6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:39.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.623+0000 7fc452993f40 1 --2- 172.21.15.33:0/4058162354 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556bd270eda0 0x556bd26c6950 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fc44400a4a0 tx=0x7fc44400a960 comp rx=0 tx=0).stop 2024-05-08T10:55:39.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.623+0000 7fc452993f40 1 -- 172.21.15.33:0/4058162354 shutdown_connections 2024-05-08T10:55:39.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.623+0000 7fc452993f40 1 --2- 172.21.15.33:0/4058162354 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556bd270f6c0 0x556bd26c4e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:39.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.623+0000 7fc452993f40 1 --2- 172.21.15.33:0/4058162354 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556bd270eda0 0x556bd26c6950 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:39.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.623+0000 7fc452993f40 1 --2- 172.21.15.33:0/4058162354 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x556bd26f0970 0x556bd26f4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:39.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.623+0000 7fc452993f40 1 -- 172.21.15.33:0/4058162354 >> 172.21.15.33:0/4058162354 conn(0x556bd26f1d70 msgr2=0x556bd26f57f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:39.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.623+0000 7fc452993f40 1 -- 172.21.15.33:0/4058162354 shutdown_connections 2024-05-08T10:55:39.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.623+0000 7fc452993f40 1 -- 172.21.15.33:0/4058162354 wait complete. 2024-05-08T10:55:39.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.623+0000 7fc452993f40 1 Processor -- start 2024-05-08T10:55:39.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.623+0000 7fc452993f40 1 -- start start 2024-05-08T10:55:39.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.624+0000 7fc452993f40 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x556bd26f0970 0x556bd2789b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:39.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.624+0000 7fc452993f40 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556bd270eda0 0x556bd2785d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:39.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.624+0000 7fc452993f40 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556bd270f6c0 0x556bd2787a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:39.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.624+0000 7fc452993f40 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bd2798d40 con 0x556bd270f6c0 2024-05-08T10:55:39.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.624+0000 7fc452993f40 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bd2786c70 con 0x556bd270eda0 2024-05-08T10:55:39.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.624+0000 7fc452993f40 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x556bd2798fc0 con 0x556bd26f0970 2024-05-08T10:55:39.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.624+0000 7fc450c95640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556bd270f6c0 0x556bd2787a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:39.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.624+0000 7fc450c95640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556bd270f6c0 0x556bd2787a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56574/0 (socket says 172.21.15.33:56574) 2024-05-08T10:55:39.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.624+0000 7fc450c95640 1 -- 172.21.15.33:0/1459955291 learned_addr learned my addr 172.21.15.33:0/1459955291 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:39.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.624+0000 7fc44fc93640 1 --2- 172.21.15.33:0/1459955291 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556bd270eda0 0x556bd2785d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:39.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.624+0000 7fc450494640 1 --2- 172.21.15.33:0/1459955291 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x556bd26f0970 0x556bd2789b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:39.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.625+0000 7fc450c95640 1 -- 172.21.15.33:0/1459955291 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x556bd26f0970 msgr2=0x556bd2789b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:39.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.625+0000 7fc450c95640 1 --2- 172.21.15.33:0/1459955291 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x556bd26f0970 0x556bd2789b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:39.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.625+0000 7fc450c95640 1 -- 172.21.15.33:0/1459955291 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556bd270eda0 msgr2=0x556bd2785d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:39.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.625+0000 7fc450c95640 1 --2- 172.21.15.33:0/1459955291 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556bd270eda0 0x556bd2785d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:39.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.625+0000 7fc450c95640 1 -- 172.21.15.33:0/1459955291 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556bd27886d0 con 0x556bd270f6c0 2024-05-08T10:55:39.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.625+0000 7fc450c95640 1 --2- 172.21.15.33:0/1459955291 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556bd270f6c0 0x556bd2787a10 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fc44800a710 tx=0x7fc44800abd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:39.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.625+0000 7fc44dc8f640 1 -- 172.21.15.33:0/1459955291 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc448019070 con 0x556bd270f6c0 2024-05-08T10:55:39.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.625+0000 7fc44dc8f640 1 -- 172.21.15.33:0/1459955291 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4480089a0 con 0x556bd270f6c0 2024-05-08T10:55:39.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.625+0000 7fc452993f40 1 -- 172.21.15.33:0/1459955291 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556bd2784110 con 0x556bd270f6c0 2024-05-08T10:55:39.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.625+0000 7fc44dc8f640 1 -- 172.21.15.33:0/1459955291 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc448008d70 con 0x556bd270f6c0 2024-05-08T10:55:39.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.625+0000 7fc452993f40 1 -- 172.21.15.33:0/1459955291 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556bd27883f0 con 0x556bd270f6c0 2024-05-08T10:55:39.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.626+0000 7fc44dc8f640 1 -- 172.21.15.33:0/1459955291 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc44801c070 con 0x556bd270f6c0 2024-05-08T10:55:39.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.627+0000 7fc44dc8f640 1 --2- 172.21.15.33:0/1459955291 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fc43c069eb0 0x7fc43c06c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:39.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.627+0000 7fc44dc8f640 1 -- 172.21.15.33:0/1459955291 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc448088ae0 con 0x556bd270f6c0 2024-05-08T10:55:39.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.627+0000 7fc452993f40 1 --2- 172.21.15.33:0/1459955291 >> [v2:172.21.15.174:6824/1511860729,v1:172.21.15.174:6825/1511860729] conn(0x556bd26c5320 0x556bd2832ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:39.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.627+0000 7fc452993f40 1 -- 172.21.15.33:0/1459955291 --> [v2:172.21.15.174:6824/1511860729,v1:172.21.15.174:6825/1511860729] -- osd_op(unknown.0.0:1 5.7 5:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v9 -- 0x556bd2833020 con 0x556bd26c5320 2024-05-08T10:55:39.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.627+0000 7fc450494640 1 --2- 172.21.15.33:0/1459955291 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fc43c069eb0 0x7fc43c06c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:39.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.627+0000 7fc44fc93640 1 --2- 172.21.15.33:0/1459955291 >> [v2:172.21.15.174:6824/1511860729,v1:172.21.15.174:6825/1511860729] conn(0x556bd26c5320 0x556bd2832ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:39.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.628+0000 7fc450494640 1 --2- 172.21.15.33:0/1459955291 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fc43c069eb0 0x7fc43c06c370 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc440056000 tx=0x7fc440007030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:39.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.628+0000 7fc44fc93640 1 --2- 172.21.15.33:0/1459955291 >> [v2:172.21.15.174:6824/1511860729,v1:172.21.15.174:6825/1511860729] conn(0x556bd26c5320 0x556bd2832ae0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:39.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.628+0000 7fc44fc93640 1 -- 172.21.15.33:0/1459955291 <== osd.5 v2:172.21.15.174:6824/1511860729 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (92) out=92b] v0'0 uv6 ondisk = 0) v8 ==== 164+0+92 (crc 0 0 0) 0x7fc44400c960 con 0x556bd26c5320 2024-05-08T10:55:39.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.628+0000 7fc452993f40 1 -- 172.21.15.33:0/1459955291 >> [v2:172.21.15.174:6824/1511860729,v1:172.21.15.174:6825/1511860729] conn(0x556bd26c5320 msgr2=0x556bd2832ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:39.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.628+0000 7fc452993f40 1 --2- 172.21.15.33:0/1459955291 >> [v2:172.21.15.174:6824/1511860729,v1:172.21.15.174:6825/1511860729] conn(0x556bd26c5320 0x556bd2832ae0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:39.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.628+0000 7fc452993f40 1 -- 172.21.15.33:0/1459955291 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fc43c069eb0 msgr2=0x7fc43c06c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:39.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.628+0000 7fc452993f40 1 --2- 172.21.15.33:0/1459955291 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fc43c069eb0 0x7fc43c06c370 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc440056000 tx=0x7fc440007030 comp rx=0 tx=0).stop 2024-05-08T10:55:39.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.628+0000 7fc452993f40 1 -- 172.21.15.33:0/1459955291 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556bd270f6c0 msgr2=0x556bd2787a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:39.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.628+0000 7fc452993f40 1 --2- 172.21.15.33:0/1459955291 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556bd270f6c0 0x556bd2787a10 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fc44800a710 tx=0x7fc44800abd0 comp rx=0 tx=0).stop 2024-05-08T10:55:39.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.628+0000 7fc450c95640 1 -- 172.21.15.33:0/1459955291 reap_dead start 2024-05-08T10:55:39.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.628+0000 7fc452993f40 1 -- 172.21.15.33:0/1459955291 shutdown_connections 2024-05-08T10:55:39.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.628+0000 7fc452993f40 1 -- 172.21.15.33:0/1459955291 >> 172.21.15.33:0/1459955291 conn(0x556bd26f1d70 msgr2=0x556bd2786370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:39.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.628+0000 7fc452993f40 1 -- 172.21.15.33:0/1459955291 shutdown_connections 2024-05-08T10:55:39.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.628+0000 7fc452993f40 1 -- 172.21.15.33:0/1459955291 wait complete. 2024-05-08T10:55:39.630 INFO:teuthology.orchestra.run.smithi033.stdout:Valphamydir 2024-05-08T10:55:39.631 DEBUG:teuthology.orchestra.run.smithi033:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2024-05-08T10:55:39.719 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-05-08T10:55:39.719 INFO:teuthology.orchestra.run.smithi033.stdout: "ino": 1099511627777, 2024-05-08T10:55:39.719 INFO:teuthology.orchestra.run.smithi033.stdout: "ancestors": [ 2024-05-08T10:55:39.720 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T10:55:39.720 INFO:teuthology.orchestra.run.smithi033.stdout: "dirino": 1099511627776, 2024-05-08T10:55:39.720 INFO:teuthology.orchestra.run.smithi033.stdout: "dname": "alpha", 2024-05-08T10:55:39.720 INFO:teuthology.orchestra.run.smithi033.stdout: "version": 6 2024-05-08T10:55:39.720 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T10:55:39.720 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T10:55:39.720 INFO:teuthology.orchestra.run.smithi033.stdout: "dirino": 1, 2024-05-08T10:55:39.720 INFO:teuthology.orchestra.run.smithi033.stdout: "dname": "mydir", 2024-05-08T10:55:39.720 INFO:teuthology.orchestra.run.smithi033.stdout: "version": 8 2024-05-08T10:55:39.720 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T10:55:39.720 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T10:55:39.720 INFO:teuthology.orchestra.run.smithi033.stdout: "pool": 5, 2024-05-08T10:55:39.720 INFO:teuthology.orchestra.run.smithi033.stdout: "old_pools": [] 2024-05-08T10:55:39.720 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-05-08T10:55:39.720 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:55:39.723 DEBUG:teuthology.orchestra.run.smithi033:> cephfs-journal-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 --rank cephfs:0 event get summary 2024-05-08T10:55:39.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.770+0000 7ff209a74280 1 -- start start 2024-05-08T10:55:39.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.770+0000 7ff209a74280 1 Processor -- start 2024-05-08T10:55:39.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.771+0000 7ff209a74280 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d8bb1c8000 0x55d8ba457080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:39.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.771+0000 7ff209a74280 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d8bb1c9000 0x55d8ba456b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:39.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.771+0000 7ff209a74280 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55d8bb1c9400 0x55d8ba457600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:39.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.771+0000 7ff209a74280 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8bb1c4780 con 0x55d8bb1c8000 2024-05-08T10:55:39.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.771+0000 7ff209a74280 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8bb1c4600 con 0x55d8bb1c9000 2024-05-08T10:55:39.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.771+0000 7ff209a74280 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d8bb1c4180 con 0x55d8bb1c9400 2024-05-08T10:55:39.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.771+0000 7ff208220640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d8bb1c8000 0x55d8ba457080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:39.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.771+0000 7ff208220640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d8bb1c8000 0x55d8ba457080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56594/0 (socket says 172.21.15.33:56594) 2024-05-08T10:55:39.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.771+0000 7ff208220640 1 -- 172.21.15.33:0/2157167020 learned_addr learned my addr 172.21.15.33:0/2157167020 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:39.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.771+0000 7ff208220640 1 -- 172.21.15.33:0/2157167020 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55d8bb1c9400 msgr2=0x55d8ba457600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:39.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.771+0000 7ff208220640 1 --2- 172.21.15.33:0/2157167020 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55d8bb1c9400 0x55d8ba457600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:39.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.771+0000 7ff208220640 1 -- 172.21.15.33:0/2157167020 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d8bb1c9000 msgr2=0x55d8ba456b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:39.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.771+0000 7ff208220640 1 --2- 172.21.15.33:0/2157167020 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d8bb1c9000 0x55d8ba456b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:39.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.771+0000 7ff208220640 1 -- 172.21.15.33:0/2157167020 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d8ba41c780 con 0x55d8bb1c8000 2024-05-08T10:55:39.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.772+0000 7ff208220640 1 --2- 172.21.15.33:0/2157167020 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d8bb1c8000 0x55d8ba457080 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x55d8bb216990 tx=0x55d8bb1ee120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35f357f99e5cd542 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:39.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.772+0000 7ff205a1b640 1 -- 172.21.15.33:0/2157167020 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55d8ba40cb60 con 0x55d8bb1c8000 2024-05-08T10:55:39.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.772+0000 7ff205a1b640 1 -- 172.21.15.33:0/2157167020 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d8ba412a80 con 0x55d8bb1c8000 2024-05-08T10:55:39.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.772+0000 7ff205a1b640 1 -- 172.21.15.33:0/2157167020 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55d8ba40cd00 con 0x55d8bb1c8000 2024-05-08T10:55:39.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.772+0000 7ff209a74280 1 -- 172.21.15.33:0/2157167020 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d8ba41da40 con 0x55d8bb1c8000 2024-05-08T10:55:39.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.772+0000 7ff209a74280 1 -- 172.21.15.33:0/2157167020 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x55d8ba41d860 con 0x55d8bb1c8000 2024-05-08T10:55:39.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.772+0000 7ff209a74280 4 waiting for MDS map... 2024-05-08T10:55:39.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.772+0000 7ff205a1b640 1 -- 172.21.15.33:0/2157167020 <== mon.0 v2:172.21.15.33:3300/0 4 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x55d8bb2ae400 con 0x55d8bb1c8000 2024-05-08T10:55:39.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.772+0000 7ff205a1b640 1 -- 172.21.15.33:0/2157167020 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 14) v1 ==== 3294+0+0 (secure 0 0 0) 0x55d8ba441180 con 0x55d8bb1c8000 2024-05-08T10:55:39.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.772+0000 7ff209a74280 4 Got MDS map 14 2024-05-08T10:55:39.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.772+0000 7ff209a74280 10 main: JournalTool::main 2024-05-08T10:55:39.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.772+0000 7ff209a74280 4 main: JournalTool: connecting to RADOS... 2024-05-08T10:55:39.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.773+0000 7ff209a74280 1 Processor -- start 2024-05-08T10:55:39.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.773+0000 7ff209a74280 1 -- start start 2024-05-08T10:55:39.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.773+0000 7ff209a74280 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55d8bb1c9c00 0x55d8ba456580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:39.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.773+0000 7ff209a74280 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d8bb30c000 0x55d8ba458100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:39.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.773+0000 7ff209a74280 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d8bb30c400 0x55d8ba458680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:39.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.773+0000 7ff209a74280 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8ba448480 con 0x55d8bb30c400 2024-05-08T10:55:39.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.773+0000 7ff209a74280 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8ba448900 con 0x55d8bb30c000 2024-05-08T10:55:39.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.773+0000 7ff209a74280 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d8bb1c5500 con 0x55d8bb1c9c00 2024-05-08T10:55:39.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.773+0000 7ff207a1f640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d8bb30c400 0x55d8ba458680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:39.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.773+0000 7ff207a1f640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d8bb30c400 0x55d8ba458680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56608/0 (socket says 172.21.15.33:56608) 2024-05-08T10:55:39.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.773+0000 7ff207a1f640 1 -- 172.21.15.33:0/3337982483 learned_addr learned my addr 172.21.15.33:0/3337982483 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:39.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.773+0000 7ff208a21640 1 --2- 172.21.15.33:0/3337982483 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55d8bb1c9c00 0x55d8ba456580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:39.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.773+0000 7ff208220640 1 --2- 172.21.15.33:0/3337982483 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d8bb30c000 0x55d8ba458100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:39.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.774+0000 7ff207a1f640 1 -- 172.21.15.33:0/3337982483 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55d8bb1c9c00 msgr2=0x55d8ba456580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:39.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.774+0000 7ff207a1f640 1 --2- 172.21.15.33:0/3337982483 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55d8bb1c9c00 0x55d8ba456580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:39.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.774+0000 7ff207a1f640 1 -- 172.21.15.33:0/3337982483 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d8bb30c000 msgr2=0x55d8ba458100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:39.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.774+0000 7ff207a1f640 1 --2- 172.21.15.33:0/3337982483 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d8bb30c000 0x55d8ba458100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:39.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.774+0000 7ff207a1f640 1 -- 172.21.15.33:0/3337982483 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d8ba41c3c0 con 0x55d8bb30c400 2024-05-08T10:55:39.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.774+0000 7ff208220640 1 --2- 172.21.15.33:0/3337982483 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d8bb30c000 0x55d8ba458100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:55:39.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.774+0000 7ff207a1f640 1 --2- 172.21.15.33:0/3337982483 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d8bb30c400 0x55d8ba458680 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x55d8bb2c2600 tx=0x55d8bb1eff20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6c4122149f77ce9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:39.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.774+0000 7ff203a17640 1 -- 172.21.15.33:0/3337982483 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55d8ba40cb60 con 0x55d8bb30c400 2024-05-08T10:55:39.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.774+0000 7ff203a17640 1 -- 172.21.15.33:0/3337982483 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d8ba412c40 con 0x55d8bb30c400 2024-05-08T10:55:39.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.774+0000 7ff203a17640 1 -- 172.21.15.33:0/3337982483 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55d8ba40cd00 con 0x55d8bb30c400 2024-05-08T10:55:39.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.774+0000 7ff209a74280 1 -- 172.21.15.33:0/3337982483 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d8bb30c400 msgr2=0x55d8ba458680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:39.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.774+0000 7ff209a74280 1 --2- 172.21.15.33:0/3337982483 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d8bb30c400 0x55d8ba458680 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x55d8bb2c2600 tx=0x55d8bb1eff20 comp rx=0 tx=0).stop 2024-05-08T10:55:39.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.774+0000 7ff209a74280 1 -- 172.21.15.33:0/3337982483 shutdown_connections 2024-05-08T10:55:39.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.774+0000 7ff209a74280 1 --2- 172.21.15.33:0/3337982483 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d8bb30c400 0x55d8ba458680 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:39.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.774+0000 7ff209a74280 1 --2- 172.21.15.33:0/3337982483 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d8bb30c000 0x55d8ba458100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:39.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.774+0000 7ff209a74280 1 --2- 172.21.15.33:0/3337982483 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55d8bb1c9c00 0x55d8ba456580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:39.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.774+0000 7ff209a74280 1 -- 172.21.15.33:0/3337982483 >> 172.21.15.33:0/3337982483 conn(0x55d8bb1c9800 msgr2=0x55d8ba4cf000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:39.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.774+0000 7ff209a74280 1 -- 172.21.15.33:0/3337982483 shutdown_connections 2024-05-08T10:55:39.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.774+0000 7ff209a74280 1 -- 172.21.15.33:0/3337982483 wait complete. 2024-05-08T10:55:39.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.775+0000 7ff209a74280 1 Processor -- start 2024-05-08T10:55:39.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.775+0000 7ff209a74280 1 -- start start 2024-05-08T10:55:39.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.775+0000 7ff209a74280 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d8bb1c9800 0x55d8ba459700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:39.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.775+0000 7ff209a74280 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55d8bb30d000 0x55d8ba459180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:39.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.775+0000 7ff209a74280 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d8bb30cc00 0x55d8ba458c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:39.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.775+0000 7ff209a74280 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8bb1c4c00 con 0x55d8bb1c9800 2024-05-08T10:55:39.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.775+0000 7ff209a74280 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8bb1c5380 con 0x55d8bb30cc00 2024-05-08T10:55:39.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.775+0000 7ff209a74280 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d8bb1c4a80 con 0x55d8bb30d000 2024-05-08T10:55:39.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.776+0000 7ff208a21640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d8bb1c9800 0x55d8ba459700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:39.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.776+0000 7ff208a21640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d8bb1c9800 0x55d8ba459700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56622/0 (socket says 172.21.15.33:56622) 2024-05-08T10:55:39.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.776+0000 7ff208a21640 1 -- 172.21.15.33:0/3446531435 learned_addr learned my addr 172.21.15.33:0/3446531435 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:39.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.776+0000 7ff207a1f640 1 --2- 172.21.15.33:0/3446531435 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d8bb30cc00 0x55d8ba458c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:39.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.776+0000 7ff208220640 1 --2- 172.21.15.33:0/3446531435 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55d8bb30d000 0x55d8ba459180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:39.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.776+0000 7ff208a21640 1 -- 172.21.15.33:0/3446531435 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55d8bb30d000 msgr2=0x55d8ba459180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:39.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.776+0000 7ff208a21640 1 --2- 172.21.15.33:0/3446531435 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55d8bb30d000 0x55d8ba459180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:39.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.776+0000 7ff208a21640 1 -- 172.21.15.33:0/3446531435 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d8bb30cc00 msgr2=0x55d8ba458c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:39.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.776+0000 7ff208a21640 1 --2- 172.21.15.33:0/3446531435 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d8bb30cc00 0x55d8ba458c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:39.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.776+0000 7ff208a21640 1 -- 172.21.15.33:0/3446531435 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d8ba41c780 con 0x55d8bb1c9800 2024-05-08T10:55:39.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.776+0000 7ff208a21640 1 --2- 172.21.15.33:0/3446531435 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d8bb1c9800 0x55d8ba459700 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x55d8bb2c3860 tx=0x55d8bb178060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:39.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.776+0000 7ff202214640 1 -- 172.21.15.33:0/3446531435 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55d8ba40cb60 con 0x55d8bb1c9800 2024-05-08T10:55:39.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.776+0000 7ff202214640 1 -- 172.21.15.33:0/3446531435 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d8ba4128c0 con 0x55d8bb1c9800 2024-05-08T10:55:39.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.776+0000 7ff209a74280 1 -- 172.21.15.33:0/3446531435 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d8ba41c000 con 0x55d8bb1c9800 2024-05-08T10:55:39.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.776+0000 7ff202214640 1 -- 172.21.15.33:0/3446531435 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55d8ba40cd00 con 0x55d8bb1c9800 2024-05-08T10:55:39.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.776+0000 7ff209a74280 1 -- 172.21.15.33:0/3446531435 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d8ba41d680 con 0x55d8bb1c9800 2024-05-08T10:55:39.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.776+0000 7ff209a74280 4 main: JournalTool: resolving pool 4 2024-05-08T10:55:39.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.777+0000 7ff202214640 1 -- 172.21.15.33:0/3446531435 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x55d8bb32ac00 con 0x55d8bb1c9800 2024-05-08T10:55:39.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.778+0000 7ff202214640 1 --2- 172.21.15.33:0/3446531435 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x55d8bb32ec00 0x55d8ba756000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:39.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.778+0000 7ff202214640 1 -- 172.21.15.33:0/3446531435 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x55d8bb328c00 con 0x55d8bb1c9800 2024-05-08T10:55:39.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.778+0000 7ff209a74280 4 main: JournalTool: creating IoCtx.. 2024-05-08T10:55:39.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.778+0000 7ff209a74280 4 main: Executing for rank 0 2024-05-08T10:55:39.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.778+0000 7ff209a74280 1 --2- 172.21.15.33:0/3446531435 >> [v2:172.21.15.33:6824/1758076090,v1:172.21.15.33:6825/1758076090] conn(0x55d8bb30c800 0x55d8ba458680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:39.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.778+0000 7ff209a74280 1 -- 172.21.15.33:0/3446531435 --> [v2:172.21.15.33:6824/1758076090,v1:172.21.15.33:6825/1758076090] -- osd_op(unknown.0.0:1 4.f 4:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v9 -- 0x55d8bb30c400 con 0x55d8bb30c800 2024-05-08T10:55:39.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.778+0000 7ff208220640 1 --2- 172.21.15.33:0/3446531435 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x55d8bb32ec00 0x55d8ba756000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:39.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.778+0000 7ff207a1f640 1 --2- 172.21.15.33:0/3446531435 >> [v2:172.21.15.33:6824/1758076090,v1:172.21.15.33:6825/1758076090] conn(0x55d8bb30c800 0x55d8ba458680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:39.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.778+0000 7ff207a1f640 1 --2- 172.21.15.33:0/3446531435 >> [v2:172.21.15.33:6824/1758076090,v1:172.21.15.33:6825/1758076090] conn(0x55d8bb30c800 0x55d8ba458680 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:39.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.778+0000 7ff208220640 1 --2- 172.21.15.33:0/3446531435 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x55d8bb32ec00 0x55d8ba756000 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x55d8bb2176b0 tx=0x55d8bb1ee1e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:39.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.779+0000 7ff207a1f640 1 -- 172.21.15.33:0/3446531435 <== osd.1 v2:172.21.15.33:6824/1758076090 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+22 (crc 0 0 0) 0x55d8ba4c0000 con 0x55d8bb30c800 2024-05-08T10:55:39.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.779+0000 7ff209a74280 4 Pointer 400.00000000 is readable 2024-05-08T10:55:39.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.779+0000 7ff209a74280 4 JournalScanner::scan: reading header object '200.00000000' 2024-05-08T10:55:39.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.779+0000 7ff209a74280 1 --2- 172.21.15.33:0/3446531435 >> [v2:172.21.15.33:6802/4029047077,v1:172.21.15.33:6804/4029047077] conn(0x55d8bb30c000 0x55d8ba458100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:39.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.779+0000 7ff209a74280 1 -- 172.21.15.33:0/3446531435 --> [v2:172.21.15.33:6802/4029047077,v1:172.21.15.33:6804/4029047077] -- osd_op(unknown.0.0:2 4.14 4:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v9 -- 0x55d8bb30dc00 con 0x55d8bb30c000 2024-05-08T10:55:39.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.779+0000 7ff208a21640 1 --2- 172.21.15.33:0/3446531435 >> [v2:172.21.15.33:6802/4029047077,v1:172.21.15.33:6804/4029047077] conn(0x55d8bb30c000 0x55d8ba458100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:39.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.779+0000 7ff208a21640 1 --2- 172.21.15.33:0/3446531435 >> [v2:172.21.15.33:6802/4029047077,v1:172.21.15.33:6804/4029047077] conn(0x55d8bb30c000 0x55d8ba458100 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:39.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.779+0000 7ff208a21640 1 -- 172.21.15.33:0/3446531435 <== osd.3 v2:172.21.15.33:6802/4029047077 1 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv18 ondisk = 0) v8 ==== 156+0+90 (crc 0 0 0) 0x55d8ba4c0500 con 0x55d8bb30c000 2024-05-08T10:55:39.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.780+0000 7ff209a74280 10 Header 0x400000 0x402c08 0x4033f6 2024-05-08T10:55:39.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.780+0000 7ff209a74280 10 Starting journal scan from offset 0x402c08 2024-05-08T10:55:39.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.780+0000 7ff209a74280 1 -- 172.21.15.33:0/3446531435 --> [v2:172.21.15.33:6802/4029047077,v1:172.21.15.33:6804/4029047077] -- osd_op(unknown.0.0:3 4.14 4:2e2fa760:::200.00000001:head [read 11272~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v9 -- 0x55d8bb30d400 con 0x55d8bb30c000 2024-05-08T10:55:39.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.780+0000 7ff208a21640 1 -- 172.21.15.33:0/3446531435 <== osd.3 v2:172.21.15.33:6802/4029047077 2 ==== osd_op_reply(3 200.00000001 [read 11272~2030 out=2030b] v0'0 uv15 ondisk = 0) v8 ==== 156+0+2030 (crc 0 0 0) 0x55d8ba4c0500 con 0x55d8bb30c000 2024-05-08T10:55:39.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.780+0000 7ff209a74280 4 Read 0x7ee bytes from 200.00000001 gap=0 2024-05-08T10:55:39.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.780+0000 7ff209a74280 10 Parsing data, 0x7ee bytes available 2024-05-08T10:55:39.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.780+0000 7ff209a74280 10 Attempting decode at 0x402c08 2024-05-08T10:55:39.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.780+0000 7ff209a74280 10 Consumed 0x37c bytes 2024-05-08T10:55:39.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.780+0000 7ff209a74280 10 Valid entry at 0x402c08 2024-05-08T10:55:39.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.780+0000 7ff209a74280 10 Attempting decode at 0x402f84 2024-05-08T10:55:39.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.780+0000 7ff209a74280 10 Consumed 0x472 bytes 2024-05-08T10:55:39.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.780+0000 7ff209a74280 10 Valid entry at 0x402f84 2024-05-08T10:55:39.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.780+0000 7ff209a74280 1 --2- 172.21.15.33:0/3446531435 >> [v2:172.21.15.174:6800/1697399220,v1:172.21.15.174:6801/1697399220] conn(0x55d8bb30d800 0x55d8ba456580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:39.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.780+0000 7ff209a74280 1 -- 172.21.15.33:0/3446531435 --> [v2:172.21.15.174:6800/1697399220,v1:172.21.15.174:6801/1697399220] -- osd_op(unknown.0.0:4 4.1b 4:ddb4e4d7:::200.00000002:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v9 -- 0x55d8bb30c400 con 0x55d8bb30d800 2024-05-08T10:55:39.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.780+0000 7ff208220640 1 --2- 172.21.15.33:0/3446531435 >> [v2:172.21.15.174:6800/1697399220,v1:172.21.15.174:6801/1697399220] conn(0x55d8bb30d800 0x55d8ba456580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:39.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.781+0000 7ff208220640 1 --2- 172.21.15.33:0/3446531435 >> [v2:172.21.15.174:6800/1697399220,v1:172.21.15.174:6801/1697399220] conn(0x55d8bb30d800 0x55d8ba456580 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:39.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.781+0000 7ff208220640 1 -- 172.21.15.33:0/3446531435 <== osd.4 v2:172.21.15.174:6800/1697399220 1 ==== osd_op_reply(4 200.00000002 [read 0~2147483647] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x55d8ba4c0f00 con 0x55d8bb30d800 2024-05-08T10:55:39.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.781+0000 7ff209a74280 4 Reached end of journal objects 2024-05-08T10:55:39.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.781+0000 7ff209a74280 4 Scanned objects, 0 missing, 1 valid 2024-05-08T10:55:39.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.781+0000 7ff209a74280 4 Events scanned, 0 gaps 2024-05-08T10:55:39.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.781+0000 7ff209a74280 4 Found 2 valid events 2024-05-08T10:55:39.785 INFO:teuthology.orchestra.run.smithi033.stdout:Events by type: 2024-05-08T10:55:39.785 INFO:teuthology.orchestra.run.smithi033.stdout: SUBTREEMAP: 1 2024-05-08T10:55:39.785 INFO:teuthology.orchestra.run.smithi033.stdout: UPDATE: 1 2024-05-08T10:55:39.786 INFO:teuthology.orchestra.run.smithi033.stdout:Errors: 0 2024-05-08T10:55:39.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.781+0000 7ff209a74280 4 Selected 2 events events for processing 2024-05-08T10:55:39.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.781+0000 7ff209a74280 4 2 events 2024-05-08T10:55:39.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.781+0000 7ff209a74280 1 -- 172.21.15.33:0/3446531435 >> [v2:172.21.15.33:6824/1758076090,v1:172.21.15.33:6825/1758076090] conn(0x55d8bb30c800 msgr2=0x55d8ba458680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:39.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.781+0000 7ff209a74280 1 --2- 172.21.15.33:0/3446531435 >> [v2:172.21.15.33:6824/1758076090,v1:172.21.15.33:6825/1758076090] conn(0x55d8bb30c800 0x55d8ba458680 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:39.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.781+0000 7ff209a74280 1 -- 172.21.15.33:0/3446531435 >> [v2:172.21.15.33:6802/4029047077,v1:172.21.15.33:6804/4029047077] conn(0x55d8bb30c000 msgr2=0x55d8ba458100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:39.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.781+0000 7ff209a74280 1 --2- 172.21.15.33:0/3446531435 >> [v2:172.21.15.33:6802/4029047077,v1:172.21.15.33:6804/4029047077] conn(0x55d8bb30c000 0x55d8ba458100 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:39.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.781+0000 7ff209a74280 1 -- 172.21.15.33:0/3446531435 >> [v2:172.21.15.174:6800/1697399220,v1:172.21.15.174:6801/1697399220] conn(0x55d8bb30d800 msgr2=0x55d8ba456580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:39.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.781+0000 7ff209a74280 1 --2- 172.21.15.33:0/3446531435 >> [v2:172.21.15.174:6800/1697399220,v1:172.21.15.174:6801/1697399220] conn(0x55d8bb30d800 0x55d8ba456580 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:39.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.781+0000 7ff207a1f640 1 -- 172.21.15.33:0/3446531435 reap_dead start 2024-05-08T10:55:39.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.781+0000 7ff209a74280 1 -- 172.21.15.33:0/3446531435 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x55d8bb32ec00 msgr2=0x55d8ba756000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:39.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.781+0000 7ff209a74280 1 --2- 172.21.15.33:0/3446531435 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x55d8bb32ec00 0x55d8ba756000 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x55d8bb2176b0 tx=0x55d8bb1ee1e0 comp rx=0 tx=0).stop 2024-05-08T10:55:39.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.781+0000 7ff209a74280 1 -- 172.21.15.33:0/3446531435 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d8bb1c9800 msgr2=0x55d8ba459700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:39.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.781+0000 7ff209a74280 1 --2- 172.21.15.33:0/3446531435 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d8bb1c9800 0x55d8ba459700 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x55d8bb2c3860 tx=0x55d8bb178060 comp rx=0 tx=0).stop 2024-05-08T10:55:39.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.781+0000 7ff209a74280 1 -- 172.21.15.33:0/3446531435 shutdown_connections 2024-05-08T10:55:39.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.781+0000 7ff209a74280 1 --2- 172.21.15.33:0/3446531435 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x55d8bb32ec00 0x55d8ba756000 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:39.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.781+0000 7ff209a74280 1 --2- 172.21.15.33:0/3446531435 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d8bb1c9800 0x55d8ba459700 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:39.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.781+0000 7ff209a74280 1 -- 172.21.15.33:0/3446531435 >> 172.21.15.33:0/3446531435 conn(0x55d8bb1c9c00 msgr2=0x55d8ba4cf000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:39.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.781+0000 7ff209a74280 1 -- 172.21.15.33:0/3446531435 shutdown_connections 2024-05-08T10:55:39.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.781+0000 7ff209a74280 1 -- 172.21.15.33:0/3446531435 wait complete. 2024-05-08T10:55:39.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.781+0000 7ff209a74280 1 -- 172.21.15.33:0/2157167020 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d8bb1c8000 msgr2=0x55d8ba457080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:39.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.781+0000 7ff209a74280 1 --2- 172.21.15.33:0/2157167020 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d8bb1c8000 0x55d8ba457080 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x55d8bb216990 tx=0x55d8bb1ee120 comp rx=0 tx=0).stop 2024-05-08T10:55:39.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.781+0000 7ff209a74280 1 -- 172.21.15.33:0/2157167020 shutdown_connections 2024-05-08T10:55:39.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.781+0000 7ff209a74280 1 --2- 172.21.15.33:0/2157167020 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55d8bb1c9400 0x55d8ba457600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:39.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.781+0000 7ff209a74280 1 --2- 172.21.15.33:0/2157167020 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d8bb1c9000 0x55d8ba456b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:39.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.781+0000 7ff209a74280 1 --2- 172.21.15.33:0/2157167020 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d8bb1c8000 0x55d8ba457080 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:39.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.781+0000 7ff209a74280 1 -- 172.21.15.33:0/2157167020 >> 172.21.15.33:0/2157167020 conn(0x55d8ba3e7000 msgr2=0x55d8ba4ce000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:39.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.782+0000 7ff209a74280 1 -- 172.21.15.33:0/2157167020 shutdown_connections 2024-05-08T10:55:39.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.782+0000 7ff209a74280 1 -- 172.21.15.33:0/2157167020 wait complete. 2024-05-08T10:55:39.794 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-journal-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '--rank', 'cephfs:0', 'event', 'get', 'summary'] in time 0:00:00.071602, result: Events by type: SUBTREEMAP: 1 UPDATE: 1 Errors: 0 2024-05-08T10:55:39.795 DEBUG:tasks.cephfs.test_flush:jos summary_output=Events by type: SUBTREEMAP: 1 UPDATE: 1 Errors: 0 2024-05-08T10:55:39.795 DEBUG:tasks.cephfs.test_flush:jos AssertionError 2024-05-08T10:55:39.795 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T10:55:39.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.903+0000 7fef8a9b0640 1 Processor -- start 2024-05-08T10:55:39.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.903+0000 7fef8a9b0640 1 -- start start 2024-05-08T10:55:39.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.904+0000 7fef8a9b0640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fef8406e960 0x7fef8406f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:39.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.904+0000 7fef8a9b0640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fef8415dfe0 0x7fef8406f630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:39.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.904+0000 7fef8a9b0640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef8406bd30 con 0x7fef8415dc00 2024-05-08T10:55:39.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.904+0000 7fef8a9b0640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef840d0f90 con 0x7fef8406e960 2024-05-08T10:55:39.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.904+0000 7fef8a9b0640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef8406c010 con 0x7fef8415dfe0 2024-05-08T10:55:39.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.904+0000 7fef7bfff640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fef8406e960 0x7fef8406f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:39.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.904+0000 7fef7bfff640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fef8406e960 0x7fef8406f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56630/0 (socket says 172.21.15.33:56630) 2024-05-08T10:55:39.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.904+0000 7fef7bfff640 1 -- 172.21.15.33:0/3161172541 learned_addr learned my addr 172.21.15.33:0/3161172541 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:39.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.904+0000 7fef88f4d640 1 --2- 172.21.15.33:0/3161172541 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fef8415dfe0 0x7fef8406f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:39.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.904+0000 7fef7bfff640 1 -- 172.21.15.33:0/3161172541 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fef8415dfe0 msgr2=0x7fef8406f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:39.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.904+0000 7fef7bfff640 1 --2- 172.21.15.33:0/3161172541 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fef8415dfe0 0x7fef8406f630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:39.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.904+0000 7fef7bfff640 1 -- 172.21.15.33:0/3161172541 >> v1:172.21.15.174:6789/0 conn(0x7fef8415dc00 legacy=0x7fef840d0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:39.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.904+0000 7fef7bfff640 1 -- 172.21.15.33:0/3161172541 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef8406c2f0 con 0x7fef8406e960 2024-05-08T10:55:39.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.905+0000 7fef7bfff640 1 --2- 172.21.15.33:0/3161172541 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fef8406e960 0x7fef8406f0f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fef6c009870 tx=0x7fef6c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b83260e28626b31a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:39.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.905+0000 7fef837fe640 1 -- 172.21.15.33:0/3161172541 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef6c037070 con 0x7fef8406e960 2024-05-08T10:55:39.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.905+0000 7fef837fe640 1 -- 172.21.15.33:0/3161172541 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef6c032440 con 0x7fef8406e960 2024-05-08T10:55:39.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.905+0000 7fef837fe640 1 -- 172.21.15.33:0/3161172541 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef6c032810 con 0x7fef8406e960 2024-05-08T10:55:39.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.905+0000 7fef8a9b0640 1 -- 172.21.15.33:0/3161172541 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fef8406e960 msgr2=0x7fef8406f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:39.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.906+0000 7fef8a9b0640 1 --2- 172.21.15.33:0/3161172541 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fef8406e960 0x7fef8406f0f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fef6c009870 tx=0x7fef6c02a180 comp rx=0 tx=0).stop 2024-05-08T10:55:39.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.906+0000 7fef8a9b0640 1 -- 172.21.15.33:0/3161172541 shutdown_connections 2024-05-08T10:55:39.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.906+0000 7fef8a9b0640 1 --2- 172.21.15.33:0/3161172541 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fef8415dfe0 0x7fef8406f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:39.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.906+0000 7fef8a9b0640 1 --2- 172.21.15.33:0/3161172541 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fef8406e960 0x7fef8406f0f0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:39.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.906+0000 7fef8a9b0640 1 -- 172.21.15.33:0/3161172541 >> 172.21.15.33:0/3161172541 conn(0x7fef840d1940 msgr2=0x7fef840d1d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:39.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.906+0000 7fef8a9b0640 1 -- 172.21.15.33:0/3161172541 shutdown_connections 2024-05-08T10:55:39.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.906+0000 7fef8a9b0640 1 -- 172.21.15.33:0/3161172541 wait complete. 2024-05-08T10:55:39.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.907+0000 7fef8a9b0640 1 Processor -- start 2024-05-08T10:55:39.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.907+0000 7fef8a9b0640 1 -- start start 2024-05-08T10:55:39.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.908+0000 7fef8a9b0640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fef8406e960 0x7fef840c6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:39.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.908+0000 7fef8a9b0640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fef8415dc00 0x7fef840c5470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:39.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.908+0000 7fef8a9b0640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fef8415dfe0 0x7fef840b5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:39.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.908+0000 7fef8a9b0640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef8406cc70 con 0x7fef8415dfe0 2024-05-08T10:55:39.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.908+0000 7fef8a9b0640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef8406caf0 con 0x7fef8406e960 2024-05-08T10:55:39.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.908+0000 7fef8a9b0640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef8406cdf0 con 0x7fef8415dc00 2024-05-08T10:55:39.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.908+0000 7fef88f4d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fef8415dfe0 0x7fef840b5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:39.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.908+0000 7fef88f4d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fef8415dfe0 0x7fef840b5300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56646/0 (socket says 172.21.15.33:56646) 2024-05-08T10:55:39.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.908+0000 7fef88f4d640 1 -- 172.21.15.33:0/620908442 learned_addr learned my addr 172.21.15.33:0/620908442 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:39.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.908+0000 7fef7bfff640 1 --2- 172.21.15.33:0/620908442 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fef8415dc00 0x7fef840c5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:39.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.908+0000 7fef83fff640 1 --2- 172.21.15.33:0/620908442 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fef8406e960 0x7fef840c6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:39.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.908+0000 7fef88f4d640 1 -- 172.21.15.33:0/620908442 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fef8415dc00 msgr2=0x7fef840c5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:39.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.908+0000 7fef88f4d640 1 --2- 172.21.15.33:0/620908442 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fef8415dc00 0x7fef840c5470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:39.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.908+0000 7fef88f4d640 1 -- 172.21.15.33:0/620908442 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fef8406e960 msgr2=0x7fef840c6bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:39.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.908+0000 7fef88f4d640 1 --2- 172.21.15.33:0/620908442 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fef8406e960 0x7fef840c6bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:39.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.908+0000 7fef88f4d640 1 -- 172.21.15.33:0/620908442 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef84158830 con 0x7fef8415dfe0 2024-05-08T10:55:39.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.908+0000 7fef83fff640 1 --2- 172.21.15.33:0/620908442 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fef8406e960 0x7fef840c6bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:55:39.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.908+0000 7fef88f4d640 1 --2- 172.21.15.33:0/620908442 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fef8415dfe0 0x7fef840b5300 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fef7c00cc30 tx=0x7fef7c00a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:39.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.908+0000 7fef817fa640 1 -- 172.21.15.33:0/620908442 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef7c00ce40 con 0x7fef8415dfe0 2024-05-08T10:55:39.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.908+0000 7fef817fa640 1 -- 172.21.15.33:0/620908442 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef7c003990 con 0x7fef8415dfe0 2024-05-08T10:55:39.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.908+0000 7fef8a9b0640 1 -- 172.21.15.33:0/620908442 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef840b5840 con 0x7fef8415dfe0 2024-05-08T10:55:39.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.909+0000 7fef817fa640 1 -- 172.21.15.33:0/620908442 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef7c003d40 con 0x7fef8415dfe0 2024-05-08T10:55:39.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.909+0000 7fef8a9b0640 1 -- 172.21.15.33:0/620908442 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef840c5e10 con 0x7fef8415dfe0 2024-05-08T10:55:39.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.910+0000 7fef8a9b0640 1 -- 172.21.15.33:0/620908442 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef84069d20 con 0x7fef8415dfe0 2024-05-08T10:55:39.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.910+0000 7fef817fa640 1 -- 172.21.15.33:0/620908442 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fef7c004000 con 0x7fef8415dfe0 2024-05-08T10:55:39.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.911+0000 7fef817fa640 1 --2- 172.21.15.33:0/620908442 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fef6406b4d0 0x7fef6406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:39.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.911+0000 7fef817fa640 1 -- 172.21.15.33:0/620908442 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fef7c08a610 con 0x7fef8415dfe0 2024-05-08T10:55:39.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.911+0000 7fef83fff640 1 --2- 172.21.15.33:0/620908442 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fef6406b4d0 0x7fef6406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:39.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.911+0000 7fef83fff640 1 --2- 172.21.15.33:0/620908442 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fef6406b4d0 0x7fef6406d990 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fef840c53c0 tx=0x7fef74009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:39.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:39.915+0000 7fef817fa640 1 -- 172.21.15.33:0/620908442 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fef7c014030 con 0x7fef8415dfe0 2024-05-08T10:55:40.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.139+0000 7fef8a9b0640 1 -- 172.21.15.33:0/620908442 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fef840702b0 con 0x7fef8415dfe0 2024-05-08T10:55:40.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.139+0000 7fef817fa640 1 -- 172.21.15.33:0/620908442 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4941 (secure 0 0 0) 0x7fef7c059520 con 0x7fef8415dfe0 2024-05-08T10:55:40.137 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:55:40.137 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4592,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6836/2731663891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2731663891},{"type":"v1","addr":"172.21.15.174:6836","nonce":2731663891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":4598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/2004985147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6833","nonce":2004985147},{"type":"v1","addr":"172.21.15.33:6835","nonce":2004985147}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4702,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6837/3164144740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6835","nonce":3164144740},{"type":"v1","addr":"172.21.15.174:6837","nonce":3164144740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T10:55:31.311811+0000","modified":"2024-05-08T10:55:33.333600+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4708},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4708":{"gid":4708,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.33:6834/415400390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":415400390},{"type":"v1","addr":"172.21.15.33:6834","nonce":415400390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-05-08T10:55:40.137 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 14 2024-05-08T10:55:40.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.141+0000 7fef8a9b0640 1 -- 172.21.15.33:0/620908442 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fef6406b4d0 msgr2=0x7fef6406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:40.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.141+0000 7fef8a9b0640 1 --2- 172.21.15.33:0/620908442 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fef6406b4d0 0x7fef6406d990 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fef840c53c0 tx=0x7fef74009040 comp rx=0 tx=0).stop 2024-05-08T10:55:40.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.141+0000 7fef8a9b0640 1 -- 172.21.15.33:0/620908442 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fef8415dfe0 msgr2=0x7fef840b5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:40.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.141+0000 7fef8a9b0640 1 --2- 172.21.15.33:0/620908442 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fef8415dfe0 0x7fef840b5300 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fef7c00cc30 tx=0x7fef7c00a5c0 comp rx=0 tx=0).stop 2024-05-08T10:55:40.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.141+0000 7fef8a9b0640 1 -- 172.21.15.33:0/620908442 shutdown_connections 2024-05-08T10:55:40.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.141+0000 7fef8a9b0640 1 --2- 172.21.15.33:0/620908442 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fef6406b4d0 0x7fef6406d990 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:40.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.141+0000 7fef8a9b0640 1 --2- 172.21.15.33:0/620908442 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fef8415dfe0 0x7fef840b5300 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:40.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.141+0000 7fef8a9b0640 1 --2- 172.21.15.33:0/620908442 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fef8415dc00 0x7fef840c5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:40.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.141+0000 7fef8a9b0640 1 --2- 172.21.15.33:0/620908442 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fef8406e960 0x7fef840c6bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:40.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.141+0000 7fef8a9b0640 1 -- 172.21.15.33:0/620908442 >> 172.21.15.33:0/620908442 conn(0x7fef840d1940 msgr2=0x7fef840b1ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:40.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.141+0000 7fef8a9b0640 1 -- 172.21.15.33:0/620908442 shutdown_connections 2024-05-08T10:55:40.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.141+0000 7fef8a9b0640 1 -- 172.21.15.33:0/620908442 wait complete. 2024-05-08T10:55:40.150 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2024-05-08T10:55:40.274 INFO:teuthology.orchestra.run.smithi033.stdout:{"message":"","return_code":0} 2024-05-08T10:55:40.275 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-05-08T10:55:40.275 DEBUG:teuthology.orchestra.run.smithi033:> cephfs-journal-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 --rank cephfs:0 event get summary 2024-05-08T10:55:40.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.321+0000 7f2e9d922280 1 -- start start 2024-05-08T10:55:40.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.321+0000 7f2e9d922280 1 Processor -- start 2024-05-08T10:55:40.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.322+0000 7f2e9d922280 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55f8d9036000 0x55f8d82db080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:40.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.322+0000 7f2e9d922280 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f8d826bc00 0x55f8d82dbb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:40.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.322+0000 7f2e9d922280 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f8d9036800 0x55f8d82db600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:40.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.322+0000 7f2e9d922280 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8d9056480 con 0x55f8d9036800 2024-05-08T10:55:40.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.322+0000 7f2e9d922280 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8d9056600 con 0x55f8d826bc00 2024-05-08T10:55:40.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.322+0000 7f2e9d922280 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f8d9056780 con 0x55f8d9036000 2024-05-08T10:55:40.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.322+0000 7f2e9be86640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f8d9036800 0x55f8d82db600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:40.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.322+0000 7f2e9be86640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f8d9036800 0x55f8d82db600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56666/0 (socket says 172.21.15.33:56666) 2024-05-08T10:55:40.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.322+0000 7f2e9be86640 1 -- 172.21.15.33:0/414460459 learned_addr learned my addr 172.21.15.33:0/414460459 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:40.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.322+0000 7f2e9ae84640 1 --2- 172.21.15.33:0/414460459 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f8d826bc00 0x55f8d82dbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:40.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.322+0000 7f2e9b685640 1 --2- 172.21.15.33:0/414460459 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55f8d9036000 0x55f8d82db080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:40.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.322+0000 7f2e9be86640 1 -- 172.21.15.33:0/414460459 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55f8d9036000 msgr2=0x55f8d82db080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:40.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.322+0000 7f2e9be86640 1 --2- 172.21.15.33:0/414460459 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55f8d9036000 0x55f8d82db080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:40.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.322+0000 7f2e9be86640 1 -- 172.21.15.33:0/414460459 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f8d826bc00 msgr2=0x55f8d82dbb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:40.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.322+0000 7f2e9be86640 1 --2- 172.21.15.33:0/414460459 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f8d826bc00 0x55f8d82dbb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:40.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.322+0000 7f2e9be86640 1 -- 172.21.15.33:0/414460459 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f8d82a0780 con 0x55f8d9036800 2024-05-08T10:55:40.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.322+0000 7f2e9ae84640 1 --2- 172.21.15.33:0/414460459 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f8d826bc00 0x55f8d82dbb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:55:40.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.322+0000 7f2e9b685640 1 --2- 172.21.15.33:0/414460459 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55f8d9036000 0x55f8d82db080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:55:40.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.323+0000 7f2e9be86640 1 --2- 172.21.15.33:0/414460459 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f8d9036800 0x55f8d82db600 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x55f8d9095260 tx=0x55f8d913e240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afead6be85c85034 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:40.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.323+0000 7f2e98e80640 1 -- 172.21.15.33:0/414460459 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55f8d8290d00 con 0x55f8d9036800 2024-05-08T10:55:40.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.323+0000 7f2e98e80640 1 -- 172.21.15.33:0/414460459 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f8d8296fc0 con 0x55f8d9036800 2024-05-08T10:55:40.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.323+0000 7f2e98e80640 1 -- 172.21.15.33:0/414460459 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55f8d8290680 con 0x55f8d9036800 2024-05-08T10:55:40.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.323+0000 7f2e9d922280 1 -- 172.21.15.33:0/414460459 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f8d82a0000 con 0x55f8d9036800 2024-05-08T10:55:40.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.323+0000 7f2e9d922280 1 -- 172.21.15.33:0/414460459 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x55f8d82a1680 con 0x55f8d9036800 2024-05-08T10:55:40.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.323+0000 7f2e9d922280 4 waiting for MDS map... 2024-05-08T10:55:40.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.323+0000 7f2e98e80640 1 -- 172.21.15.33:0/414460459 <== mon.0 v2:172.21.15.33:3300/0 4 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x55f8d9140600 con 0x55f8d9036800 2024-05-08T10:55:40.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.323+0000 7f2e98e80640 1 -- 172.21.15.33:0/414460459 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 14) v1 ==== 3294+0+0 (secure 0 0 0) 0x55f8d82c5180 con 0x55f8d9036800 2024-05-08T10:55:40.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.323+0000 7f2e9d922280 4 Got MDS map 14 2024-05-08T10:55:40.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.323+0000 7f2e9d922280 10 main: JournalTool::main 2024-05-08T10:55:40.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.323+0000 7f2e9d922280 4 main: JournalTool: connecting to RADOS... 2024-05-08T10:55:40.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.324+0000 7f2e9d922280 1 Processor -- start 2024-05-08T10:55:40.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.324+0000 7f2e9d922280 1 -- start start 2024-05-08T10:55:40.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.324+0000 7f2e9d922280 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f8d9142800 0x55f8d82dab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:40.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.324+0000 7f2e9d922280 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55f8d9142c00 0x55f8d82dc100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:40.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.324+0000 7f2e9d922280 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f8d9143000 0x55f8d82dc680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:40.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.324+0000 7f2e9d922280 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8d82cc180 con 0x55f8d9143000 2024-05-08T10:55:40.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.324+0000 7f2e9d922280 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8d9057680 con 0x55f8d9142800 2024-05-08T10:55:40.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.324+0000 7f2e9d922280 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f8d9057500 con 0x55f8d9142c00 2024-05-08T10:55:40.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.324+0000 7f2e9ae84640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f8d9143000 0x55f8d82dc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:40.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.324+0000 7f2e9ae84640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f8d9143000 0x55f8d82dc680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56676/0 (socket says 172.21.15.33:56676) 2024-05-08T10:55:40.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.324+0000 7f2e9ae84640 1 -- 172.21.15.33:0/1845436777 learned_addr learned my addr 172.21.15.33:0/1845436777 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:40.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.325+0000 7f2e9ae84640 1 --2- 172.21.15.33:0/1845436777 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f8d9142800 0x55f8d82dab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:40.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.325+0000 7f2e9b685640 1 --2- 172.21.15.33:0/1845436777 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55f8d9142c00 0x55f8d82dc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:40.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.325+0000 7f2e9ae84640 1 -- 172.21.15.33:0/1845436777 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55f8d9142c00 msgr2=0x55f8d82dc100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:40.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.325+0000 7f2e9ae84640 1 --2- 172.21.15.33:0/1845436777 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55f8d9142c00 0x55f8d82dc100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:40.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.325+0000 7f2e9ae84640 1 -- 172.21.15.33:0/1845436777 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f8d9142800 msgr2=0x55f8d82dab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:40.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.325+0000 7f2e9ae84640 1 --2- 172.21.15.33:0/1845436777 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f8d9142800 0x55f8d82dab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:40.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.325+0000 7f2e9ae84640 1 -- 172.21.15.33:0/1845436777 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f8d82a1860 con 0x55f8d9143000 2024-05-08T10:55:40.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.325+0000 7f2e9ae84640 1 --2- 172.21.15.33:0/1845436777 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f8d9143000 0x55f8d82dc680 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x55f8d9094e10 tx=0x55f8d913e1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99925563c60143fa server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:40.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.325+0000 7f2e96e7c640 1 -- 172.21.15.33:0/1845436777 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55f8d8290d00 con 0x55f8d9143000 2024-05-08T10:55:40.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.325+0000 7f2e96e7c640 1 -- 172.21.15.33:0/1845436777 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f8d8296700 con 0x55f8d9143000 2024-05-08T10:55:40.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.325+0000 7f2e96e7c640 1 -- 172.21.15.33:0/1845436777 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55f8d8290680 con 0x55f8d9143000 2024-05-08T10:55:40.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.325+0000 7f2e9d922280 1 -- 172.21.15.33:0/1845436777 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f8d9143000 msgr2=0x55f8d82dc680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:40.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.325+0000 7f2e9d922280 1 --2- 172.21.15.33:0/1845436777 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f8d9143000 0x55f8d82dc680 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x55f8d9094e10 tx=0x55f8d913e1e0 comp rx=0 tx=0).stop 2024-05-08T10:55:40.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.326+0000 7f2e9d922280 1 -- 172.21.15.33:0/1845436777 shutdown_connections 2024-05-08T10:55:40.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.326+0000 7f2e9d922280 1 --2- 172.21.15.33:0/1845436777 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f8d9143000 0x55f8d82dc680 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:40.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.326+0000 7f2e9d922280 1 --2- 172.21.15.33:0/1845436777 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55f8d9142c00 0x55f8d82dc100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:40.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.326+0000 7f2e9d922280 1 --2- 172.21.15.33:0/1845436777 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f8d9142800 0x55f8d82dab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:40.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.326+0000 7f2e9d922280 1 -- 172.21.15.33:0/1845436777 >> 172.21.15.33:0/1845436777 conn(0x55f8d9036400 msgr2=0x55f8d8353800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:40.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.326+0000 7f2e9d922280 1 -- 172.21.15.33:0/1845436777 shutdown_connections 2024-05-08T10:55:40.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.326+0000 7f2e9d922280 1 -- 172.21.15.33:0/1845436777 wait complete. 2024-05-08T10:55:40.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.326+0000 7f2e9d922280 1 Processor -- start 2024-05-08T10:55:40.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.326+0000 7f2e9d922280 1 -- start start 2024-05-08T10:55:40.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.327+0000 7f2e9d922280 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f8d9142800 0x55f8d82dab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:40.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.327+0000 7f2e9d922280 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55f8d9142c00 0x55f8d82dc100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:40.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.327+0000 7f2e9d922280 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f8d9143000 0x55f8d82dc680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:40.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.327+0000 7f2e9d922280 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8d9056900 con 0x55f8d9143000 2024-05-08T10:55:40.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.327+0000 7f2e9d922280 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8d9056a80 con 0x55f8d9142800 2024-05-08T10:55:40.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.327+0000 7f2e9d922280 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f8d9056180 con 0x55f8d9142c00 2024-05-08T10:55:40.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.327+0000 7f2e9ae84640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f8d9143000 0x55f8d82dc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:40.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.327+0000 7f2e9ae84640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f8d9143000 0x55f8d82dc680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56680/0 (socket says 172.21.15.33:56680) 2024-05-08T10:55:40.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.327+0000 7f2e9ae84640 1 -- 172.21.15.33:0/4074150520 learned_addr learned my addr 172.21.15.33:0/4074150520 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:40.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.327+0000 7f2e9ae84640 1 --2- 172.21.15.33:0/4074150520 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f8d9142800 0x55f8d82dab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:40.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.327+0000 7f2e9b685640 1 --2- 172.21.15.33:0/4074150520 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55f8d9142c00 0x55f8d82dc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:40.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.327+0000 7f2e9ae84640 1 -- 172.21.15.33:0/4074150520 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55f8d9142c00 msgr2=0x55f8d82dc100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:40.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.327+0000 7f2e9ae84640 1 --2- 172.21.15.33:0/4074150520 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55f8d9142c00 0x55f8d82dc100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:40.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.327+0000 7f2e9ae84640 1 -- 172.21.15.33:0/4074150520 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f8d9142800 msgr2=0x55f8d82dab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:40.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.327+0000 7f2e9ae84640 1 --2- 172.21.15.33:0/4074150520 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f8d9142800 0x55f8d82dab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:40.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.327+0000 7f2e9ae84640 1 -- 172.21.15.33:0/4074150520 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f8d82a03c0 con 0x55f8d9143000 2024-05-08T10:55:40.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.327+0000 7f2e9ae84640 1 --2- 172.21.15.33:0/4074150520 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f8d9143000 0x55f8d82dc680 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x55f8d915a8a0 tx=0x55f8d913e0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:40.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.327+0000 7f2e95679640 1 -- 172.21.15.33:0/4074150520 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55f8d8290820 con 0x55f8d9143000 2024-05-08T10:55:40.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.328+0000 7f2e95679640 1 -- 172.21.15.33:0/4074150520 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f8d8296e00 con 0x55f8d9143000 2024-05-08T10:55:40.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.328+0000 7f2e9d922280 1 -- 172.21.15.33:0/4074150520 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f8d82a0780 con 0x55f8d9143000 2024-05-08T10:55:40.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.328+0000 7f2e95679640 1 -- 172.21.15.33:0/4074150520 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55f8d8290d00 con 0x55f8d9143000 2024-05-08T10:55:40.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.328+0000 7f2e9d922280 1 -- 172.21.15.33:0/4074150520 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f8d82a0000 con 0x55f8d9143000 2024-05-08T10:55:40.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.328+0000 7f2e9d922280 4 main: JournalTool: resolving pool 4 2024-05-08T10:55:40.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.329+0000 7f2e95679640 1 -- 172.21.15.33:0/4074150520 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x55f8d9138c00 con 0x55f8d9143000 2024-05-08T10:55:40.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.329+0000 7f2e95679640 1 --2- 172.21.15.33:0/4074150520 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x55f8d9143c00 0x55f8d82dd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:40.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.329+0000 7f2e95679640 1 -- 172.21.15.33:0/4074150520 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x55f8d9136a00 con 0x55f8d9143000 2024-05-08T10:55:40.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.329+0000 7f2e9d922280 4 main: JournalTool: creating IoCtx.. 2024-05-08T10:55:40.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.329+0000 7f2e9d922280 4 main: Executing for rank 0 2024-05-08T10:55:40.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.329+0000 7f2e9d922280 1 --2- 172.21.15.33:0/4074150520 >> [v2:172.21.15.33:6824/1758076090,v1:172.21.15.33:6825/1758076090] conn(0x55f8d9143400 0x55f8d82dcc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:40.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.329+0000 7f2e9d922280 1 -- 172.21.15.33:0/4074150520 --> [v2:172.21.15.33:6824/1758076090,v1:172.21.15.33:6825/1758076090] -- osd_op(unknown.0.0:1 4.f 4:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v9 -- 0x55f8d9143800 con 0x55f8d9143400 2024-05-08T10:55:40.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.329+0000 7f2e9b685640 1 --2- 172.21.15.33:0/4074150520 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x55f8d9143c00 0x55f8d82dd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:40.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.329+0000 7f2e9ae84640 1 --2- 172.21.15.33:0/4074150520 >> [v2:172.21.15.33:6824/1758076090,v1:172.21.15.33:6825/1758076090] conn(0x55f8d9143400 0x55f8d82dcc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:40.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.330+0000 7f2e9ae84640 1 --2- 172.21.15.33:0/4074150520 >> [v2:172.21.15.33:6824/1758076090,v1:172.21.15.33:6825/1758076090] conn(0x55f8d9143400 0x55f8d82dcc00 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:40.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.330+0000 7f2e9b685640 1 --2- 172.21.15.33:0/4074150520 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x55f8d9143c00 0x55f8d82dd700 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x55f8d8346780 tx=0x55f8d9074180 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:40.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.330+0000 7f2e9ae84640 1 -- 172.21.15.33:0/4074150520 <== osd.1 v2:172.21.15.33:6824/1758076090 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+22 (crc 0 0 0) 0x55f8d8344000 con 0x55f8d9143400 2024-05-08T10:55:40.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.330+0000 7f2e9d922280 4 Pointer 400.00000000 is readable 2024-05-08T10:55:40.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.330+0000 7f2e9d922280 4 JournalScanner::scan: reading header object '200.00000000' 2024-05-08T10:55:40.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.330+0000 7f2e9d922280 1 --2- 172.21.15.33:0/4074150520 >> [v2:172.21.15.33:6802/4029047077,v1:172.21.15.33:6804/4029047077] conn(0x55f8d85e8c00 0x55f8d82dd180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:40.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.330+0000 7f2e9d922280 1 -- 172.21.15.33:0/4074150520 --> [v2:172.21.15.33:6802/4029047077,v1:172.21.15.33:6804/4029047077] -- osd_op(unknown.0.0:2 4.14 4:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v9 -- 0x55f8d85e9000 con 0x55f8d85e8c00 2024-05-08T10:55:40.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.330+0000 7f2e9be86640 1 --2- 172.21.15.33:0/4074150520 >> [v2:172.21.15.33:6802/4029047077,v1:172.21.15.33:6804/4029047077] conn(0x55f8d85e8c00 0x55f8d82dd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:40.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.330+0000 7f2e9be86640 1 --2- 172.21.15.33:0/4074150520 >> [v2:172.21.15.33:6802/4029047077,v1:172.21.15.33:6804/4029047077] conn(0x55f8d85e8c00 0x55f8d82dd180 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:40.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.331+0000 7f2e9be86640 1 -- 172.21.15.33:0/4074150520 <== osd.3 v2:172.21.15.33:6802/4029047077 1 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv22 ondisk = 0) v8 ==== 156+0+90 (crc 0 0 0) 0x55f8d8344500 con 0x55f8d85e8c00 2024-05-08T10:55:40.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.331+0000 7f2e9d922280 10 Header 0x400000 0x4033f6 0x403772 2024-05-08T10:55:40.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.331+0000 7f2e9d922280 10 Starting journal scan from offset 0x4033f6 2024-05-08T10:55:40.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.331+0000 7f2e9d922280 1 -- 172.21.15.33:0/4074150520 --> [v2:172.21.15.33:6802/4029047077,v1:172.21.15.33:6804/4029047077] -- osd_op(unknown.0.0:3 4.14 4:2e2fa760:::200.00000001:head [read 13302~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v9 -- 0x55f8d85e9400 con 0x55f8d85e8c00 2024-05-08T10:55:40.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.331+0000 7f2e9be86640 1 -- 172.21.15.33:0/4074150520 <== osd.3 v2:172.21.15.33:6802/4029047077 2 ==== osd_op_reply(3 200.00000001 [read 13302~892 out=892b] v0'0 uv19 ondisk = 0) v8 ==== 156+0+892 (crc 0 0 0) 0x55f8d8344500 con 0x55f8d85e8c00 2024-05-08T10:55:40.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.331+0000 7f2e9d922280 4 Read 0x37c bytes from 200.00000001 gap=0 2024-05-08T10:55:40.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.331+0000 7f2e9d922280 10 Parsing data, 0x37c bytes available 2024-05-08T10:55:40.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.331+0000 7f2e9d922280 10 Attempting decode at 0x4033f6 2024-05-08T10:55:40.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.331+0000 7f2e9d922280 10 Consumed 0x37c bytes 2024-05-08T10:55:40.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.331+0000 7f2e9d922280 10 Valid entry at 0x4033f6 2024-05-08T10:55:40.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.331+0000 7f2e9d922280 1 --2- 172.21.15.33:0/4074150520 >> [v2:172.21.15.174:6800/1697399220,v1:172.21.15.174:6801/1697399220] conn(0x55f8d85e9800 0x55f8d85fa000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:40.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.331+0000 7f2e9d922280 1 -- 172.21.15.33:0/4074150520 --> [v2:172.21.15.174:6800/1697399220,v1:172.21.15.174:6801/1697399220] -- osd_op(unknown.0.0:4 4.1b 4:ddb4e4d7:::200.00000002:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v9 -- 0x55f8d85e9c00 con 0x55f8d85e9800 2024-05-08T10:55:40.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.331+0000 7f2e9b685640 1 --2- 172.21.15.33:0/4074150520 >> [v2:172.21.15.174:6800/1697399220,v1:172.21.15.174:6801/1697399220] conn(0x55f8d85e9800 0x55f8d85fa000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:40.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.332+0000 7f2e9b685640 1 --2- 172.21.15.33:0/4074150520 >> [v2:172.21.15.174:6800/1697399220,v1:172.21.15.174:6801/1697399220] conn(0x55f8d85e9800 0x55f8d85fa000 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:40.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.332+0000 7f2e9b685640 1 -- 172.21.15.33:0/4074150520 <== osd.4 v2:172.21.15.174:6800/1697399220 1 ==== osd_op_reply(4 200.00000002 [read 0~2147483647] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x55f8d8344780 con 0x55f8d85e9800 2024-05-08T10:55:40.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.332+0000 7f2e9d922280 4 Reached end of journal objects 2024-05-08T10:55:40.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.332+0000 7f2e9d922280 4 Scanned objects, 0 missing, 1 valid 2024-05-08T10:55:40.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.332+0000 7f2e9d922280 4 Events scanned, 0 gaps 2024-05-08T10:55:40.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.332+0000 7f2e9d922280 4 Found 1 valid events 2024-05-08T10:55:40.340 INFO:teuthology.orchestra.run.smithi033.stdout:Events by type: 2024-05-08T10:55:40.340 INFO:teuthology.orchestra.run.smithi033.stdout: SUBTREEMAP: 1 2024-05-08T10:55:40.340 INFO:teuthology.orchestra.run.smithi033.stdout:Errors: 0 2024-05-08T10:55:40.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.332+0000 7f2e9d922280 4 Selected 1 events events for processing 2024-05-08T10:55:40.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.332+0000 7f2e9d922280 4 1 events 2024-05-08T10:55:40.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.332+0000 7f2e9d922280 1 -- 172.21.15.33:0/4074150520 >> [v2:172.21.15.33:6824/1758076090,v1:172.21.15.33:6825/1758076090] conn(0x55f8d9143400 msgr2=0x55f8d82dcc00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:40.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.332+0000 7f2e9d922280 1 --2- 172.21.15.33:0/4074150520 >> [v2:172.21.15.33:6824/1758076090,v1:172.21.15.33:6825/1758076090] conn(0x55f8d9143400 0x55f8d82dcc00 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:40.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.332+0000 7f2e9d922280 1 -- 172.21.15.33:0/4074150520 >> [v2:172.21.15.33:6802/4029047077,v1:172.21.15.33:6804/4029047077] conn(0x55f8d85e8c00 msgr2=0x55f8d82dd180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:40.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.332+0000 7f2e9d922280 1 --2- 172.21.15.33:0/4074150520 >> [v2:172.21.15.33:6802/4029047077,v1:172.21.15.33:6804/4029047077] conn(0x55f8d85e8c00 0x55f8d82dd180 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:40.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.332+0000 7f2e9d922280 1 -- 172.21.15.33:0/4074150520 >> [v2:172.21.15.174:6800/1697399220,v1:172.21.15.174:6801/1697399220] conn(0x55f8d85e9800 msgr2=0x55f8d85fa000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:40.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.332+0000 7f2e9d922280 1 --2- 172.21.15.33:0/4074150520 >> [v2:172.21.15.174:6800/1697399220,v1:172.21.15.174:6801/1697399220] conn(0x55f8d85e9800 0x55f8d85fa000 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:40.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.332+0000 7f2e9b685640 1 -- 172.21.15.33:0/4074150520 reap_dead start 2024-05-08T10:55:40.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.332+0000 7f2e9d922280 1 -- 172.21.15.33:0/4074150520 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x55f8d9143c00 msgr2=0x55f8d82dd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:40.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.332+0000 7f2e9d922280 1 --2- 172.21.15.33:0/4074150520 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x55f8d9143c00 0x55f8d82dd700 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x55f8d8346780 tx=0x55f8d9074180 comp rx=0 tx=0).stop 2024-05-08T10:55:40.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.332+0000 7f2e9d922280 1 -- 172.21.15.33:0/4074150520 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f8d9143000 msgr2=0x55f8d82dc680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:40.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.332+0000 7f2e9d922280 1 --2- 172.21.15.33:0/4074150520 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f8d9143000 0x55f8d82dc680 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x55f8d915a8a0 tx=0x55f8d913e0c0 comp rx=0 tx=0).stop 2024-05-08T10:55:40.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.332+0000 7f2e9d922280 1 -- 172.21.15.33:0/4074150520 shutdown_connections 2024-05-08T10:55:40.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.332+0000 7f2e9d922280 1 --2- 172.21.15.33:0/4074150520 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x55f8d9143c00 0x55f8d82dd700 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:40.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.332+0000 7f2e9d922280 1 --2- 172.21.15.33:0/4074150520 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f8d9143000 0x55f8d82dc680 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:40.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.332+0000 7f2e9d922280 1 -- 172.21.15.33:0/4074150520 >> 172.21.15.33:0/4074150520 conn(0x55f8d9036400 msgr2=0x55f8d8353800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:40.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.332+0000 7f2e9d922280 1 -- 172.21.15.33:0/4074150520 shutdown_connections 2024-05-08T10:55:40.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.332+0000 7f2e9d922280 1 -- 172.21.15.33:0/4074150520 wait complete. 2024-05-08T10:55:40.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.333+0000 7f2e9d922280 1 -- 172.21.15.33:0/414460459 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f8d9036800 msgr2=0x55f8d82db600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:40.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.333+0000 7f2e9d922280 1 --2- 172.21.15.33:0/414460459 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f8d9036800 0x55f8d82db600 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x55f8d9095260 tx=0x55f8d913e240 comp rx=0 tx=0).stop 2024-05-08T10:55:40.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.333+0000 7f2e9d922280 1 -- 172.21.15.33:0/414460459 shutdown_connections 2024-05-08T10:55:40.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.333+0000 7f2e9d922280 1 --2- 172.21.15.33:0/414460459 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f8d9036800 0x55f8d82db600 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:40.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.333+0000 7f2e9d922280 1 --2- 172.21.15.33:0/414460459 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f8d826bc00 0x55f8d82dbb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:40.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.333+0000 7f2e9d922280 1 --2- 172.21.15.33:0/414460459 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55f8d9036000 0x55f8d82db080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:40.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.333+0000 7f2e9d922280 1 -- 172.21.15.33:0/414460459 >> 172.21.15.33:0/414460459 conn(0x55f8d826b000 msgr2=0x55f8d8353000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:40.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.333+0000 7f2e9d922280 1 -- 172.21.15.33:0/414460459 shutdown_connections 2024-05-08T10:55:40.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.333+0000 7f2e9d922280 1 -- 172.21.15.33:0/414460459 wait complete. 2024-05-08T10:55:40.345 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-journal-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '--rank', 'cephfs:0', 'event', 'get', 'summary'] in time 0:00:00.069971, result: Events by type: SUBTREEMAP: 1 Errors: 0 2024-05-08T10:55:40.345 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T10:55:40.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.489+0000 7f075893b640 1 Processor -- start 2024-05-08T10:55:40.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.489+0000 7f075893b640 1 -- start start 2024-05-08T10:55:40.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.490+0000 7f075893b640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f07540d4960 0x7f07540d17e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:40.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.490+0000 7f075893b640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f07540d1e10 0x7f07540d2220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:40.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.490+0000 7f075893b640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07540d2760 con 0x7f07541613a0 2024-05-08T10:55:40.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.490+0000 7f075893b640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07540cf010 con 0x7f07540d1e10 2024-05-08T10:55:40.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.490+0000 7f075893b640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07540ce720 con 0x7f07540d4960 2024-05-08T10:55:40.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.491+0000 7f0752d9d640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f07540d1e10 0x7f07540d2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:40.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.491+0000 7f0752d9d640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f07540d1e10 0x7f07540d2220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56692/0 (socket says 172.21.15.33:56692) 2024-05-08T10:55:40.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.491+0000 7f0752d9d640 1 -- 172.21.15.33:0/3226858132 learned_addr learned my addr 172.21.15.33:0/3226858132 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:40.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.491+0000 7f0751d9b640 1 --2- 172.21.15.33:0/3226858132 >> v2:172.21.15.174:3300/0 conn(0x7f07540d4960 0x7f07540d17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:40.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.491+0000 7f0752d9d640 1 -- 172.21.15.33:0/3226858132 >> v2:172.21.15.174:3300/0 conn(0x7f07540d4960 msgr2=0x7f07540d17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:40.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.491+0000 7f0752d9d640 1 --2- 172.21.15.33:0/3226858132 >> v2:172.21.15.174:3300/0 conn(0x7f07540d4960 0x7f07540d17e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:40.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.491+0000 7f0752d9d640 1 -- 172.21.15.33:0/3226858132 >> v1:172.21.15.174:6789/0 conn(0x7f07541613a0 legacy=0x7f07540cf4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:40.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.491+0000 7f0752d9d640 1 -- 172.21.15.33:0/3226858132 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07540d12d0 con 0x7f07540d1e10 2024-05-08T10:55:40.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.492+0000 7f0752d9d640 1 --2- 172.21.15.33:0/3226858132 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07540d1e10 0x7f07540d2220 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f075408e0c0 tx=0x7f074402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=264631267b719330 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:40.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.492+0000 7f075159a640 1 -- 172.21.15.33:0/3226858132 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0744036070 con 0x7f07540d1e10 2024-05-08T10:55:40.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.492+0000 7f075159a640 1 -- 172.21.15.33:0/3226858132 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0744031600 con 0x7f07540d1e10 2024-05-08T10:55:40.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.492+0000 7f075159a640 1 -- 172.21.15.33:0/3226858132 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07440319d0 con 0x7f07540d1e10 2024-05-08T10:55:40.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.492+0000 7f075893b640 1 -- 172.21.15.33:0/3226858132 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07540d1e10 msgr2=0x7f07540d2220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:40.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.492+0000 7f075893b640 1 --2- 172.21.15.33:0/3226858132 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07540d1e10 0x7f07540d2220 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f075408e0c0 tx=0x7f074402a6f0 comp rx=0 tx=0).stop 2024-05-08T10:55:40.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.492+0000 7f075893b640 1 -- 172.21.15.33:0/3226858132 shutdown_connections 2024-05-08T10:55:40.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.492+0000 7f075893b640 1 --2- 172.21.15.33:0/3226858132 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07540d1e10 0x7f07540d2220 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:40.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.492+0000 7f075893b640 1 --2- 172.21.15.33:0/3226858132 >> v2:172.21.15.174:3300/0 conn(0x7f07540d4960 0x7f07540d17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:40.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.492+0000 7f075893b640 1 -- 172.21.15.33:0/3226858132 >> 172.21.15.33:0/3226858132 conn(0x7f07540d3c10 msgr2=0x7f07540d4020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:40.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.492+0000 7f075893b640 1 -- 172.21.15.33:0/3226858132 shutdown_connections 2024-05-08T10:55:40.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.492+0000 7f075893b640 1 -- 172.21.15.33:0/3226858132 wait complete. 2024-05-08T10:55:40.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.494+0000 7f075893b640 1 Processor -- start 2024-05-08T10:55:40.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.494+0000 7f075893b640 1 -- start start 2024-05-08T10:55:40.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.494+0000 7f075893b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07540d1e10 0x7f075415c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:40.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.495+0000 7f075893b640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f07540d4960 0x7f0754152120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:40.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.495+0000 7f075893b640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f07541613a0 0x7f075406b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:40.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.495+0000 7f075893b640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07540cfbb0 con 0x7f07540d1e10 2024-05-08T10:55:40.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.495+0000 7f075893b640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07540ceca0 con 0x7f07540d4960 2024-05-08T10:55:40.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.495+0000 7f075893b640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07540d0f80 con 0x7f07541613a0 2024-05-08T10:55:40.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.495+0000 7f075259c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07540d1e10 0x7f075415c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:40.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.495+0000 7f075259c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07540d1e10 0x7f075415c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56698/0 (socket says 172.21.15.33:56698) 2024-05-08T10:55:40.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.495+0000 7f075259c640 1 -- 172.21.15.33:0/2616248844 learned_addr learned my addr 172.21.15.33:0/2616248844 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:40.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.495+0000 7f0751d9b640 1 --2- 172.21.15.33:0/2616248844 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f07540d4960 0x7f0754152120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:40.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.495+0000 7f0752d9d640 1 --2- 172.21.15.33:0/2616248844 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f07541613a0 0x7f075406b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:40.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.495+0000 7f075259c640 1 -- 172.21.15.33:0/2616248844 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f07541613a0 msgr2=0x7f075406b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:40.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.495+0000 7f075259c640 1 --2- 172.21.15.33:0/2616248844 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f07541613a0 0x7f075406b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:40.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.495+0000 7f075259c640 1 -- 172.21.15.33:0/2616248844 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f07540d4960 msgr2=0x7f0754152120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:40.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.495+0000 7f075259c640 1 --2- 172.21.15.33:0/2616248844 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f07540d4960 0x7f0754152120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:40.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.495+0000 7f075259c640 1 -- 172.21.15.33:0/2616248844 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0754152660 con 0x7f07540d1e10 2024-05-08T10:55:40.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.495+0000 7f0752d9d640 1 --2- 172.21.15.33:0/2616248844 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f07541613a0 0x7f075406b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:55:40.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.495+0000 7f075259c640 1 --2- 172.21.15.33:0/2616248844 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07540d1e10 0x7f075415c980 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f074c00c430 tx=0x7f074c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:40.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.495+0000 7f074affd640 1 -- 172.21.15.33:0/2616248844 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f074c011790 con 0x7f07540d1e10 2024-05-08T10:55:40.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.495+0000 7f074affd640 1 -- 172.21.15.33:0/2616248844 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f074c017070 con 0x7f07540d1e10 2024-05-08T10:55:40.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.495+0000 7f075893b640 1 -- 172.21.15.33:0/2616248844 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f075415bc00 con 0x7f07540d1e10 2024-05-08T10:55:40.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.495+0000 7f074affd640 1 -- 172.21.15.33:0/2616248844 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f074c011bb0 con 0x7f07540d1e10 2024-05-08T10:55:40.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.495+0000 7f075893b640 1 -- 172.21.15.33:0/2616248844 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f075415c180 con 0x7f07540d1e10 2024-05-08T10:55:40.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.496+0000 7f075893b640 1 -- 172.21.15.33:0/2616248844 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07540ca910 con 0x7f07540d1e10 2024-05-08T10:55:40.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.497+0000 7f074affd640 1 -- 172.21.15.33:0/2616248844 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f074c01c460 con 0x7f07540d1e10 2024-05-08T10:55:40.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.497+0000 7f074affd640 1 --2- 172.21.15.33:0/2616248844 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f073406b4d0 0x7f073406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:40.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.497+0000 7f074affd640 1 -- 172.21.15.33:0/2616248844 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f074c089ff0 con 0x7f07540d1e10 2024-05-08T10:55:40.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.498+0000 7f0751d9b640 1 --2- 172.21.15.33:0/2616248844 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f073406b4d0 0x7f073406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:40.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.498+0000 7f0751d9b640 1 --2- 172.21.15.33:0/2616248844 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f073406b4d0 0x7f073406d990 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0754068f10 tx=0x7f073c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:40.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.501+0000 7f074affd640 1 -- 172.21.15.33:0/2616248844 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f07540ca910 con 0x7f07540d1e10 2024-05-08T10:55:40.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.724+0000 7f075893b640 1 -- 172.21.15.33:0/2616248844 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f075408d980 con 0x7f07540d1e10 2024-05-08T10:55:40.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.724+0000 7f074affd640 1 -- 172.21.15.33:0/2616248844 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4941 (secure 0 0 0) 0x7f0754152660 con 0x7f07540d1e10 2024-05-08T10:55:40.722 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:55:40.722 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4592,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6836/2731663891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2731663891},{"type":"v1","addr":"172.21.15.174:6836","nonce":2731663891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":4598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/2004985147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6833","nonce":2004985147},{"type":"v1","addr":"172.21.15.33:6835","nonce":2004985147}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4702,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6837/3164144740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6835","nonce":3164144740},{"type":"v1","addr":"172.21.15.174:6837","nonce":3164144740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T10:55:31.311811+0000","modified":"2024-05-08T10:55:33.333600+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4708},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4708":{"gid":4708,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.33:6834/415400390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":415400390},{"type":"v1","addr":"172.21.15.33:6834","nonce":415400390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-05-08T10:55:40.723 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 14 2024-05-08T10:55:40.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.726+0000 7f075893b640 1 -- 172.21.15.33:0/2616248844 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f073406b4d0 msgr2=0x7f073406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:40.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.726+0000 7f075893b640 1 --2- 172.21.15.33:0/2616248844 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f073406b4d0 0x7f073406d990 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0754068f10 tx=0x7f073c008040 comp rx=0 tx=0).stop 2024-05-08T10:55:40.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.726+0000 7f075893b640 1 -- 172.21.15.33:0/2616248844 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07540d1e10 msgr2=0x7f075415c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:40.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.726+0000 7f075893b640 1 --2- 172.21.15.33:0/2616248844 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07540d1e10 0x7f075415c980 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f074c00c430 tx=0x7f074c00c8f0 comp rx=0 tx=0).stop 2024-05-08T10:55:40.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.726+0000 7f075893b640 1 -- 172.21.15.33:0/2616248844 shutdown_connections 2024-05-08T10:55:40.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.726+0000 7f075893b640 1 --2- 172.21.15.33:0/2616248844 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f073406b4d0 0x7f073406d990 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:40.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.726+0000 7f075893b640 1 --2- 172.21.15.33:0/2616248844 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f07541613a0 0x7f075406b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:40.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.726+0000 7f075893b640 1 --2- 172.21.15.33:0/2616248844 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f07540d4960 0x7f0754152120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:40.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.726+0000 7f075893b640 1 --2- 172.21.15.33:0/2616248844 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07540d1e10 0x7f075415c980 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:40.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.726+0000 7f075893b640 1 -- 172.21.15.33:0/2616248844 >> 172.21.15.33:0/2616248844 conn(0x7f07540d3c10 msgr2=0x7f07540b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:40.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.727+0000 7f075893b640 1 -- 172.21.15.33:0/2616248844 shutdown_connections 2024-05-08T10:55:40.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.727+0000 7f075893b640 1 -- 172.21.15.33:0/2616248844 wait complete. 2024-05-08T10:55:40.735 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json perf dump objecter 2024-05-08T10:55:40.854 INFO:teuthology.orchestra.run.smithi033.stdout:{"objecter":{"op_active":0,"op_laggy":0,"op_send":567,"op_send_bytes":29664,"op_resend":37,"op_reply":567,"op_latency":{"avgcount":567,"sum":13.505781761,"avgtime":0.023819720},"op_inflight":0,"oplen_avg":{"avgcount":567,"sum":604},"op":567,"op_r":0,"op_w":567,"op_rmw":0,"op_pg":0,"osdop_stat":2,"osdop_create":14,"osdop_read":0,"osdop_write":10,"osdop_writefull":15,"osdop_writesame":0,"osdop_append":0,"osdop_zero":0,"osdop_truncate":0,"osdop_delete":506,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":0,"osdop_setxattr":28,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":31,"map_full":0,"map_inc":1,"osd_sessions":8,"osd_session_open":8,"osd_session_close":0,"osd_laggy":0,"omap_wr":26,"omap_rd":0,"omap_del":3}} 2024-05-08T10:55:40.854 DEBUG:tasks.cephfs.filesystem:_json_asok output { "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 31, "map_full": 0, "map_inc": 1, "omap_del": 3, "omap_rd": 0, "omap_wr": 26, "op": 567, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 567, "avgtime": 0.02381972, "sum": 13.505781761 }, "op_pg": 0, "op_r": 0, "op_reply": 567, "op_resend": 37, "op_rmw": 0, "op_send": 567, "op_send_bytes": 29664, "op_w": 567, "oplen_avg": { "avgcount": 567, "sum": 604 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 8, "osd_sessions": 8, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 14, "osdop_delete": 506, "osdop_getxattr": 0, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 0, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 28, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 2, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 10, "osdop_writefull": 15, "osdop_writesame": 0, "osdop_zero": 0, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 } } 2024-05-08T10:55:40.854 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T10:55:40.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.961+0000 7f9051f22640 1 Processor -- start 2024-05-08T10:55:40.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.961+0000 7f9051f22640 1 -- start start 2024-05-08T10:55:40.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.962+0000 7f9051f22640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f904c0cc290 0x7f904c15b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:40.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.962+0000 7f9051f22640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f904c15f340 con 0x7f904c072110 2024-05-08T10:55:40.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.962+0000 7f9051f22640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f904c0cfb60 con 0x7f904c06d7d0 2024-05-08T10:55:40.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.962+0000 7f9051f22640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f904c15bec0 con 0x7f904c0cc290 2024-05-08T10:55:40.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.962+0000 7f904bfff640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f904c072110 0x7f904c15ec30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:55514/0 (socket says 172.21.15.33:55514) 2024-05-08T10:55:40.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.962+0000 7f904bfff640 1 -- 172.21.15.33:0/773868656 learned_addr learned my addr 172.21.15.33:0/773868656 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-05-08T10:55:40.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.962+0000 7f904b7fe640 1 --2- 172.21.15.33:0/773868656 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f904c0cc290 0x7f904c15b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:40.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.962+0000 7f904a7fc640 1 -- 172.21.15.33:0/773868656 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1364297492 0 0) 0x7f904c15f340 con 0x7f904c072110 2024-05-08T10:55:40.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.962+0000 7f904a7fc640 1 -- 172.21.15.33:0/773868656 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9034003520 con 0x7f904c072110 2024-05-08T10:55:40.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.963+0000 7f904a7fc640 1 -- 172.21.15.33:0/773868656 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 223611021 0 0) 0x7f9034003520 con 0x7f904c072110 2024-05-08T10:55:40.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.963+0000 7f904a7fc640 1 -- 172.21.15.33:0/773868656 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f904c0cc290 msgr2=0x7f904c15b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:40.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.963+0000 7f904a7fc640 1 --2- 172.21.15.33:0/773868656 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f904c0cc290 0x7f904c15b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:40.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.963+0000 7f904a7fc640 1 -- 172.21.15.33:0/773868656 >> v1:172.21.15.174:6789/0 conn(0x7f904c06d7d0 legacy=0x7f904c15e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:40.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.963+0000 7f904a7fc640 1 -- 172.21.15.33:0/773868656 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f904c0cfe40 con 0x7f904c072110 2024-05-08T10:55:40.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.963+0000 7f904a7fc640 1 -- 172.21.15.33:0/773868656 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2948294915 0 0) 0x7f90440019f0 con 0x7f904c072110 2024-05-08T10:55:40.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.963+0000 7f904a7fc640 1 -- 172.21.15.33:0/773868656 >> v1:172.21.15.33:6789/0 conn(0x7f904c072110 legacy=0x7f904c15ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:40.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.963+0000 7f904a7fc640 1 --2- 172.21.15.33:0/773868656 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f904c0cc290 0x7f90340039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:40.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.963+0000 7f904a7fc640 1 --2- 172.21.15.33:0/773868656 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9034003f60 0x7f9034004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:40.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.963+0000 7f904a7fc640 1 --2- 172.21.15.33:0/773868656 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9034004d40 0x7f90340051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:40.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.963+0000 7f904a7fc640 1 -- 172.21.15.33:0/773868656 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f904c15bec0 con 0x7f9034004d40 2024-05-08T10:55:40.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.963+0000 7f904a7fc640 1 -- 172.21.15.33:0/773868656 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f903400bb50 con 0x7f9034003f60 2024-05-08T10:55:40.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.963+0000 7f904a7fc640 1 -- 172.21.15.33:0/773868656 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f903400bd50 con 0x7f904c0cc290 2024-05-08T10:55:40.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.963+0000 7f904bfff640 1 --2- 172.21.15.33:0/773868656 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9034004d40 0x7f90340051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:40.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.963+0000 7f904b7fe640 1 --2- 172.21.15.33:0/773868656 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f904c0cc290 0x7f90340039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:40.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.963+0000 7f904affd640 1 --2- 172.21.15.33:0/773868656 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9034003f60 0x7f9034004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:40.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.963+0000 7f904bfff640 1 -- 172.21.15.33:0/773868656 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f904c0cc290 msgr2=0x7f90340039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:40.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.963+0000 7f904bfff640 1 --2- 172.21.15.33:0/773868656 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f904c0cc290 0x7f90340039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:40.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.963+0000 7f904bfff640 1 -- 172.21.15.33:0/773868656 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9034003f60 msgr2=0x7f9034004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:40.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.963+0000 7f904bfff640 1 --2- 172.21.15.33:0/773868656 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9034003f60 0x7f9034004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:40.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.963+0000 7f904bfff640 1 -- 172.21.15.33:0/773868656 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9034003520 con 0x7f9034004d40 2024-05-08T10:55:40.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.964+0000 7f904bfff640 1 --2- 172.21.15.33:0/773868656 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9034004d40 0x7f90340051c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f904400a810 tx=0x7f9034005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d72e5d876d46cce1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:40.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.964+0000 7f904a7fc640 1 -- 172.21.15.33:0/773868656 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f904400a460 con 0x7f9034004d40 2024-05-08T10:55:40.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.964+0000 7f904a7fc640 1 -- 172.21.15.33:0/773868656 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f904402f070 con 0x7f9034004d40 2024-05-08T10:55:40.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.964+0000 7f904a7fc640 1 -- 172.21.15.33:0/773868656 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f904402bc90 con 0x7f9034004d40 2024-05-08T10:55:40.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.965+0000 7f9051f22640 1 -- 172.21.15.33:0/773868656 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9034004d40 msgr2=0x7f90340051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:40.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.965+0000 7f9051f22640 1 --2- 172.21.15.33:0/773868656 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9034004d40 0x7f90340051c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f904400a810 tx=0x7f9034005830 comp rx=0 tx=0).stop 2024-05-08T10:55:40.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.965+0000 7f904bfff640 1 -- 172.21.15.33:0/773868656 reap_dead start 2024-05-08T10:55:40.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.965+0000 7f9051f22640 1 -- 172.21.15.33:0/773868656 shutdown_connections 2024-05-08T10:55:40.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.965+0000 7f9051f22640 1 -- 172.21.15.33:0/773868656 >> 172.21.15.33:0/773868656 conn(0x7f904c06aba0 msgr2=0x7f904c06afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:40.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.965+0000 7f9051f22640 1 -- 172.21.15.33:0/773868656 shutdown_connections 2024-05-08T10:55:40.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.965+0000 7f9051f22640 1 -- 172.21.15.33:0/773868656 wait complete. 2024-05-08T10:55:40.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.966+0000 7f9051f22640 1 Processor -- start 2024-05-08T10:55:40.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.966+0000 7f9051f22640 1 -- start start 2024-05-08T10:55:40.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.967+0000 7f9051f22640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f904c154630 0x7f904c1f2950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:40.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.967+0000 7f9051f22640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f904c157800 0x7f904c157c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:40.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.967+0000 7f9051f22640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f904c0af680 0x7f904c0afb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:40.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.967+0000 7f9051f22640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f904c0d0400 con 0x7f904c154630 2024-05-08T10:55:40.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.967+0000 7f9051f22640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f904c0d0770 con 0x7f904c157800 2024-05-08T10:55:40.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.967+0000 7f9051f22640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f904c0b36b0 con 0x7f904c0af680 2024-05-08T10:55:40.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.967+0000 7f904b7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f904c154630 0x7f904c1f2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:40.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.967+0000 7f904b7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f904c154630 0x7f904c1f2950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56726/0 (socket says 172.21.15.33:56726) 2024-05-08T10:55:40.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.967+0000 7f904b7fe640 1 -- 172.21.15.33:0/3001993192 learned_addr learned my addr 172.21.15.33:0/3001993192 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:40.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.967+0000 7f904b7fe640 1 -- 172.21.15.33:0/3001993192 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f904c0af680 msgr2=0x7f904c0afb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:40.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.967+0000 7f904b7fe640 1 --2- 172.21.15.33:0/3001993192 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f904c0af680 0x7f904c0afb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:40.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.967+0000 7f904b7fe640 1 -- 172.21.15.33:0/3001993192 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f904c157800 msgr2=0x7f904c157c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:40.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.967+0000 7f904b7fe640 1 --2- 172.21.15.33:0/3001993192 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f904c157800 0x7f904c157c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:40.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.967+0000 7f904b7fe640 1 -- 172.21.15.33:0/3001993192 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f904c1f2e90 con 0x7f904c154630 2024-05-08T10:55:40.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.967+0000 7f904b7fe640 1 --2- 172.21.15.33:0/3001993192 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f904c154630 0x7f904c1f2950 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f903c0119a0 tx=0x7f903c011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:40.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.968+0000 7f9033fff640 1 -- 172.21.15.33:0/3001993192 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f903c00fa10 con 0x7f904c154630 2024-05-08T10:55:40.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.968+0000 7f9033fff640 1 -- 172.21.15.33:0/3001993192 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f903c00fbb0 con 0x7f904c154630 2024-05-08T10:55:40.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.968+0000 7f9051f22640 1 -- 172.21.15.33:0/3001993192 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f904c0b0390 con 0x7f904c154630 2024-05-08T10:55:40.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.968+0000 7f9033fff640 1 -- 172.21.15.33:0/3001993192 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f903c014440 con 0x7f904c154630 2024-05-08T10:55:40.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.968+0000 7f9051f22640 1 -- 172.21.15.33:0/3001993192 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f904c1f2150 con 0x7f904c154630 2024-05-08T10:55:40.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.969+0000 7f9051f22640 1 -- 172.21.15.33:0/3001993192 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f904c069d20 con 0x7f904c154630 2024-05-08T10:55:40.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.969+0000 7f9033fff640 1 -- 172.21.15.33:0/3001993192 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f903c012040 con 0x7f904c154630 2024-05-08T10:55:40.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.969+0000 7f9033fff640 1 --2- 172.21.15.33:0/3001993192 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f903806b500 0x7f903806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:40.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.970+0000 7f9033fff640 1 -- 172.21.15.33:0/3001993192 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f903c08a800 con 0x7f904c154630 2024-05-08T10:55:40.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.970+0000 7f904affd640 1 --2- 172.21.15.33:0/3001993192 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f903806b500 0x7f903806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:40.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.970+0000 7f904affd640 1 --2- 172.21.15.33:0/3001993192 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f903806b500 0x7f903806d9c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f904c14ffe0 tx=0x7f9040009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:40.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:40.974+0000 7f9033fff640 1 -- 172.21.15.33:0/3001993192 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f904c1f2e90 con 0x7f904c154630 2024-05-08T10:55:41.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:41.193+0000 7f9051f22640 1 -- 172.21.15.33:0/3001993192 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f904c0707a0 con 0x7f904c154630 2024-05-08T10:55:41.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:41.193+0000 7f9033fff640 1 -- 172.21.15.33:0/3001993192 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4941 (secure 0 0 0) 0x7f903c019030 con 0x7f904c154630 2024-05-08T10:55:41.191 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:55:41.191 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4592,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6836/2731663891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2731663891},{"type":"v1","addr":"172.21.15.174:6836","nonce":2731663891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":4598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/2004985147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6833","nonce":2004985147},{"type":"v1","addr":"172.21.15.33:6835","nonce":2004985147}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4702,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6837/3164144740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6835","nonce":3164144740},{"type":"v1","addr":"172.21.15.174:6837","nonce":3164144740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T10:55:31.311811+0000","modified":"2024-05-08T10:55:33.333600+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4708},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4708":{"gid":4708,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.33:6834/415400390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":415400390},{"type":"v1","addr":"172.21.15.33:6834","nonce":415400390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-05-08T10:55:41.191 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 14 2024-05-08T10:55:41.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:41.196+0000 7f9051f22640 1 -- 172.21.15.33:0/3001993192 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f903806b500 msgr2=0x7f903806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:41.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:41.196+0000 7f9051f22640 1 --2- 172.21.15.33:0/3001993192 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f903806b500 0x7f903806d9c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f904c14ffe0 tx=0x7f9040009040 comp rx=0 tx=0).stop 2024-05-08T10:55:41.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:41.196+0000 7f9051f22640 1 -- 172.21.15.33:0/3001993192 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f904c154630 msgr2=0x7f904c1f2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:41.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:41.196+0000 7f9051f22640 1 --2- 172.21.15.33:0/3001993192 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f904c154630 0x7f904c1f2950 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f903c0119a0 tx=0x7f903c011e60 comp rx=0 tx=0).stop 2024-05-08T10:55:41.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:41.196+0000 7f9051f22640 1 -- 172.21.15.33:0/3001993192 shutdown_connections 2024-05-08T10:55:41.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:41.196+0000 7f9051f22640 1 --2- 172.21.15.33:0/3001993192 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f903806b500 0x7f903806d9c0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:41.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:41.196+0000 7f9051f22640 1 --2- 172.21.15.33:0/3001993192 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f904c0af680 0x7f904c0afb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:41.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:41.196+0000 7f9051f22640 1 --2- 172.21.15.33:0/3001993192 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f904c157800 0x7f904c157c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:41.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:41.196+0000 7f9051f22640 1 --2- 172.21.15.33:0/3001993192 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f904c154630 0x7f904c1f2950 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:41.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:41.196+0000 7f9051f22640 1 -- 172.21.15.33:0/3001993192 >> 172.21.15.33:0/3001993192 conn(0x7f904c06aba0 msgr2=0x7f904c1507d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:41.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:41.196+0000 7f9051f22640 1 -- 172.21.15.33:0/3001993192 shutdown_connections 2024-05-08T10:55:41.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:41.196+0000 7f9051f22640 1 -- 172.21.15.33:0/3001993192 wait complete. 2024-05-08T10:55:41.204 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json perf dump mds_cache 2024-05-08T10:55:41.323 INFO:teuthology.orchestra.run.smithi033.stdout:{"mds_cache":{"dir_update":0,"dir_update_receipt":0,"dir_try_discover":0,"dir_send_discover":0,"dir_handle_discover":0,"num_strays":0,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":0,"strays_enqueued":0,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0}} 2024-05-08T10:55:41.323 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_cache": { "dir_handle_discover": 0, "dir_send_discover": 0, "dir_try_discover": 0, "dir_update": 0, "dir_update_receipt": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 0, "strays_enqueued": 0, "strays_migrated": 0, "strays_reintegrated": 0 } } 2024-05-08T10:55:41.324 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-08T10:55:41.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:41.430+0000 7f90da84a640 1 Processor -- start 2024-05-08T10:55:41.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:41.430+0000 7f90da84a640 1 -- start start 2024-05-08T10:55:41.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:41.431+0000 7f90da84a640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f90d4162410 0x7f90d40d0b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:41.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:41.431+0000 7f90da84a640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90d4162980 con 0x7f90d406ee30 2024-05-08T10:55:41.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:41.431+0000 7f90d3fff640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f90d406ee30 0x7f90d406f210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:55526/0 (socket says 172.21.15.33:55526) 2024-05-08T10:55:41.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:41.431+0000 7f90da84a640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90d406ec00 con 0x7f90d406e770 2024-05-08T10:55:41.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:41.431+0000 7f90d3fff640 1 -- 172.21.15.33:0/715832796 learned_addr learned my addr 172.21.15.33:0/715832796 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-05-08T10:55:41.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:41.431+0000 7f90da84a640 1 -- 172.21.15.33:0/715832796 --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90d40b1250 con 0x7f90d4162410 2024-05-08T10:55:41.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:41.431+0000 7f90d37fe640 1 --2- 172.21.15.33:0/715832796 >> v2:172.21.15.174:3300/0 conn(0x7f90d4162410 0x7f90d40d0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:41.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:41.431+0000 7f90d2ffd640 1 -- 172.21.15.33:0/715832796 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1288901499 0 0) 0x7f90d4162980 con 0x7f90d406ee30 2024-05-08T10:55:41.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:41.431+0000 7f90d2ffd640 1 -- 172.21.15.33:0/715832796 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90c0003520 con 0x7f90d406ee30 2024-05-08T10:55:41.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:41.431+0000 7f90d2ffd640 1 -- 172.21.15.33:0/715832796 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1331312472 0 0) 0x7f90c0003520 con 0x7f90d406ee30 2024-05-08T10:55:41.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:41.431+0000 7f90d2ffd640 1 -- 172.21.15.33:0/715832796 >> v2:172.21.15.174:3300/0 conn(0x7f90d4162410 msgr2=0x7f90d40d0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:41.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:41.431+0000 7f90d2ffd640 1 --2- 172.21.15.33:0/715832796 >> v2:172.21.15.174:3300/0 conn(0x7f90d4162410 0x7f90d40d0b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:41.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:41.431+0000 7f90d2ffd640 1 -- 172.21.15.33:0/715832796 >> v1:172.21.15.174:6789/0 conn(0x7f90d406e770 legacy=0x7f90d406bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:41.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:41.431+0000 7f90d2ffd640 1 -- 172.21.15.33:0/715832796 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90d40cfd70 con 0x7f90d406ee30 2024-05-08T10:55:41.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:41.431+0000 7f90d2ffd640 1 -- 172.21.15.33:0/715832796 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2948294915 0 0) 0x7f90c4001670 con 0x7f90d406ee30 2024-05-08T10:55:41.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:41.432+0000 7f90d2ffd640 1 -- 172.21.15.33:0/715832796 >> v1:172.21.15.33:6789/0 conn(0x7f90d406ee30 legacy=0x7f90d406f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:41.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:41.432+0000 7f90d2ffd640 1 --2- 172.21.15.33:0/715832796 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90c00039e0 0x7f90c0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:41.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:41.432+0000 7f90d2ffd640 1 --2- 172.21.15.33:0/715832796 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f90c0004800 0x7f90c0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:41.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:41.432+0000 7f90d2ffd640 1 --2- 172.21.15.33:0/715832796 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f90c00051c0 0x7f90c000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:41.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:41.432+0000 7f90d2ffd640 1 -- 172.21.15.33:0/715832796 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90d40b1250 con 0x7f90c00039e0 2024-05-08T10:55:41.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:41.432+0000 7f90d2ffd640 1 -- 172.21.15.33:0/715832796 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90c000c090 con 0x7f90c00051c0 2024-05-08T10:55:41.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:41.432+0000 7f90d2ffd640 1 -- 172.21.15.33:0/715832796 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90c000c290 con 0x7f90c0004800 2024-05-08T10:55:41.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:41.432+0000 7f90d3fff640 1 --2- 172.21.15.33:0/715832796 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90c00039e0 0x7f90c0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:41.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:41.432+0000 7f90d8de7640 1 --2- 172.21.15.33:0/715832796 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f90c00051c0 0x7f90c000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:41.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:41.432+0000 7f90d37fe640 1 --2- 172.21.15.33:0/715832796 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f90c0004800 0x7f90c0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:41.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:41.432+0000 7f90d3fff640 1 -- 172.21.15.33:0/715832796 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f90c0004800 msgr2=0x7f90c0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:41.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:41.432+0000 7f90d3fff640 1 --2- 172.21.15.33:0/715832796 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f90c0004800 0x7f90c0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:41.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:41.432+0000 7f90d3fff640 1 -- 172.21.15.33:0/715832796 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f90c00051c0 msgr2=0x7f90c000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:41.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:41.432+0000 7f90d3fff640 1 --2- 172.21.15.33:0/715832796 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f90c00051c0 0x7f90c000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:41.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:41.432+0000 7f90d3fff640 1 -- 172.21.15.33:0/715832796 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90c0003520 con 0x7f90c00039e0 2024-05-08T10:55:41.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:41.432+0000 7f90d8de7640 1 -- 172.21.15.33:0/715832796 reap_dead start 2024-05-08T10:55:41.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:41.432+0000 7f90d37fe640 1 --2- 172.21.15.33:0/715832796 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f90c0004800 0x7f90c0004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:55:41.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:41.433+0000 7f90d3fff640 1 --2- 172.21.15.33:0/715832796 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90c00039e0 0x7f90c0003e00 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f90c400c210 tx=0x7f90c0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e79d3e4d6a596a9e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:41.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:41.433+0000 7f90d2ffd640 1 -- 172.21.15.33:0/715832796 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c4007d30 con 0x7f90c00039e0 2024-05-08T10:55:41.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:41.433+0000 7f90d2ffd640 1 -- 172.21.15.33:0/715832796 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90c4005ad0 con 0x7f90c00039e0 2024-05-08T10:55:41.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:41.433+0000 7f90d2ffd640 1 -- 172.21.15.33:0/715832796 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c4007070 con 0x7f90c00039e0 2024-05-08T10:55:41.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:41.433+0000 7f90da84a640 1 -- 172.21.15.33:0/715832796 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90c00039e0 msgr2=0x7f90c0003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:41.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:41.433+0000 7f90da84a640 1 --2- 172.21.15.33:0/715832796 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90c00039e0 0x7f90c0003e00 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f90c400c210 tx=0x7f90c0005830 comp rx=0 tx=0).stop 2024-05-08T10:55:41.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:41.433+0000 7f90da84a640 1 -- 172.21.15.33:0/715832796 shutdown_connections 2024-05-08T10:55:41.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:41.433+0000 7f90da84a640 1 --2- 172.21.15.33:0/715832796 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90c00039e0 0x7f90c0003e00 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:41.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:41.433+0000 7f90da84a640 1 -- 172.21.15.33:0/715832796 >> 172.21.15.33:0/715832796 conn(0x7f90d40d1990 msgr2=0x7f90d40d1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:41.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:41.434+0000 7f90da84a640 1 -- 172.21.15.33:0/715832796 shutdown_connections 2024-05-08T10:55:41.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:41.434+0000 7f90da84a640 1 -- 172.21.15.33:0/715832796 wait complete. 2024-05-08T10:55:41.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:41.435+0000 7f90da84a640 1 Processor -- start 2024-05-08T10:55:41.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:41.435+0000 7f90da84a640 1 -- start start 2024-05-08T10:55:41.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:41.436+0000 7f90da84a640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f90c00039e0 0x7f90d40b09f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:41.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:41.436+0000 7f90da84a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90d40b5630 0x7f90d4148b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:41.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:41.436+0000 7f90da84a640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f90d40b66f0 0x7f90d40b6b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:41.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:41.436+0000 7f90da84a640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90d40d0610 con 0x7f90d40b5630 2024-05-08T10:55:41.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:41.436+0000 7f90da84a640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90d40d0330 con 0x7f90d40b66f0 2024-05-08T10:55:41.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:41.436+0000 7f90da84a640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90d40d0b30 con 0x7f90c00039e0 2024-05-08T10:55:41.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:41.436+0000 7f90d37fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90d40b5630 0x7f90d4148b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:41.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:41.436+0000 7f90d37fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90d40b5630 0x7f90d4148b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56752/0 (socket says 172.21.15.33:56752) 2024-05-08T10:55:41.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:41.436+0000 7f90d37fe640 1 -- 172.21.15.33:0/4135451274 learned_addr learned my addr 172.21.15.33:0/4135451274 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:41.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:41.436+0000 7f90d3fff640 1 --2- 172.21.15.33:0/4135451274 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f90c00039e0 0x7f90d40b09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:41.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:41.436+0000 7f90d8de7640 1 --2- 172.21.15.33:0/4135451274 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f90d40b66f0 0x7f90d40b6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:41.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:41.436+0000 7f90d37fe640 1 -- 172.21.15.33:0/4135451274 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f90c00039e0 msgr2=0x7f90d40b09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:41.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:41.436+0000 7f90d37fe640 1 --2- 172.21.15.33:0/4135451274 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f90c00039e0 0x7f90d40b09f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:41.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:41.436+0000 7f90d37fe640 1 -- 172.21.15.33:0/4135451274 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f90d40b66f0 msgr2=0x7f90d40b6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:41.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:41.436+0000 7f90d37fe640 1 --2- 172.21.15.33:0/4135451274 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f90d40b66f0 0x7f90d40b6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:41.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:41.436+0000 7f90d37fe640 1 -- 172.21.15.33:0/4135451274 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90d41ea030 con 0x7f90d40b5630 2024-05-08T10:55:41.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:41.436+0000 7f90d37fe640 1 --2- 172.21.15.33:0/4135451274 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90d40b5630 0x7f90d4148b00 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f90bc011540 tx=0x7f90bc011a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:41.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:41.436+0000 7f90d0ff9640 1 -- 172.21.15.33:0/4135451274 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90bc015870 con 0x7f90d40b5630 2024-05-08T10:55:41.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:41.436+0000 7f90d0ff9640 1 -- 172.21.15.33:0/4135451274 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90bc015a10 con 0x7f90d40b5630 2024-05-08T10:55:41.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:41.436+0000 7f90da84a640 1 -- 172.21.15.33:0/4135451274 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90d40b5ab0 con 0x7f90d40b5630 2024-05-08T10:55:41.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:41.436+0000 7f90d0ff9640 1 -- 172.21.15.33:0/4135451274 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90bc015e00 con 0x7f90d40b5630 2024-05-08T10:55:41.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:41.436+0000 7f90da84a640 1 -- 172.21.15.33:0/4135451274 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90d41e9550 con 0x7f90d40b5630 2024-05-08T10:55:41.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:41.437+0000 7f90da84a640 1 -- 172.21.15.33:0/4135451274 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90d4069d20 con 0x7f90d40b5630 2024-05-08T10:55:41.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:41.438+0000 7f90d0ff9640 1 -- 172.21.15.33:0/4135451274 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f90bc00f460 con 0x7f90d40b5630 2024-05-08T10:55:41.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:41.438+0000 7f90d0ff9640 1 --2- 172.21.15.33:0/4135451274 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f90b406b4d0 0x7f90b406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:41.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:41.438+0000 7f90d0ff9640 1 -- 172.21.15.33:0/4135451274 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f90bc08a820 con 0x7f90d40b5630 2024-05-08T10:55:41.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:41.439+0000 7f90d3fff640 1 --2- 172.21.15.33:0/4135451274 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f90b406b4d0 0x7f90b406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:41.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:41.439+0000 7f90d3fff640 1 --2- 172.21.15.33:0/4135451274 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f90b406b4d0 0x7f90b406d990 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f90c4033000 tx=0x7f90c402e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:41.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:41.442+0000 7f90d0ff9640 1 -- 172.21.15.33:0/4135451274 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f90bc019030 con 0x7f90d40b5630 2024-05-08T10:55:41.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:41.659+0000 7f90da84a640 1 -- 172.21.15.33:0/4135451274 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f90d4068170 con 0x7f90d40b5630 2024-05-08T10:55:41.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:41.659+0000 7f90d0ff9640 1 -- 172.21.15.33:0/4135451274 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v14) v1 ==== 53+0+73 (secure 0 0 0) 0x7f90bc059050 con 0x7f90d40b5630 2024-05-08T10:55:41.657 INFO:teuthology.orchestra.run.smithi033.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-08T10:55:41.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:41.661+0000 7f90da84a640 1 -- 172.21.15.33:0/4135451274 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f90b406b4d0 msgr2=0x7f90b406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:41.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:41.661+0000 7f90da84a640 1 --2- 172.21.15.33:0/4135451274 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f90b406b4d0 0x7f90b406d990 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f90c4033000 tx=0x7f90c402e000 comp rx=0 tx=0).stop 2024-05-08T10:55:41.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:41.661+0000 7f90da84a640 1 -- 172.21.15.33:0/4135451274 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90d40b5630 msgr2=0x7f90d4148b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:41.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:41.661+0000 7f90da84a640 1 --2- 172.21.15.33:0/4135451274 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90d40b5630 0x7f90d4148b00 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f90bc011540 tx=0x7f90bc011a00 comp rx=0 tx=0).stop 2024-05-08T10:55:41.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:41.661+0000 7f90da84a640 1 -- 172.21.15.33:0/4135451274 shutdown_connections 2024-05-08T10:55:41.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:41.661+0000 7f90da84a640 1 --2- 172.21.15.33:0/4135451274 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f90b406b4d0 0x7f90b406d990 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:41.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:41.661+0000 7f90da84a640 1 --2- 172.21.15.33:0/4135451274 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f90d40b66f0 0x7f90d40b6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:41.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:41.661+0000 7f90da84a640 1 --2- 172.21.15.33:0/4135451274 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90d40b5630 0x7f90d4148b00 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:41.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:41.661+0000 7f90da84a640 1 --2- 172.21.15.33:0/4135451274 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f90c00039e0 0x7f90d40b09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:41.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:41.661+0000 7f90da84a640 1 -- 172.21.15.33:0/4135451274 >> 172.21.15.33:0/4135451274 conn(0x7f90d40d1990 msgr2=0x7f90d40d1d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:41.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:41.661+0000 7f90da84a640 1 -- 172.21.15.33:0/4135451274 shutdown_connections 2024-05-08T10:55:41.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:41.661+0000 7f90da84a640 1 -- 172.21.15.33:0/4135451274 wait complete. 2024-05-08T10:55:41.670 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-08T10:55:41.670 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-08T10:55:41.670 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi033.front.sepia.ceph.com 2024-05-08T10:55:41.670 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-08T10:55:41.670 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-08T10:55:41.670 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-08T10:55:41.670 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-05-08T10:55:41.670 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-08T10:55:41.670 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-08T10:55:41.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:55:41.670 DEBUG:teuthology.orchestra.run.smithi033:> ip addr 2024-05-08T10:55:41.687 INFO:teuthology.orchestra.run.smithi033.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-08T10:55:41.687 INFO:teuthology.orchestra.run.smithi033.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-08T10:55:41.687 INFO:teuthology.orchestra.run.smithi033.stdout: inet 127.0.0.1/8 scope host lo 2024-05-08T10:55:41.687 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-05-08T10:55:41.687 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 ::1/128 scope host 2024-05-08T10:55:41.687 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-05-08T10:55:41.687 INFO:teuthology.orchestra.run.smithi033.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-08T10:55:41.688 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 0c:c4:7a:6b:fd:14 brd ff:ff:ff:ff:ff:ff 2024-05-08T10:55:41.688 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp7s0f0 2024-05-08T10:55:41.688 INFO:teuthology.orchestra.run.smithi033.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-08T10:55:41.688 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 0c:c4:7a:6b:fd:15 brd ff:ff:ff:ff:ff:ff 2024-05-08T10:55:41.688 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp7s0f1 2024-05-08T10:55:41.688 INFO:teuthology.orchestra.run.smithi033.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-08T10:55:41.688 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether ac:1f:6b:a5:d2:94 brd ff:ff:ff:ff:ff:ff 2024-05-08T10:55:41.688 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp1s0f0 2024-05-08T10:55:41.688 INFO:teuthology.orchestra.run.smithi033.stdout: inet 172.21.15.33/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-05-08T10:55:41.688 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft 42719sec preferred_lft 42719sec 2024-05-08T10:55:41.688 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::ae1f:6bff:fea5:d294/64 scope link noprefixroute 2024-05-08T10:55:41.688 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-05-08T10:55:41.688 INFO:teuthology.orchestra.run.smithi033.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-08T10:55:41.688 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether ac:1f:6b:a5:d2:95 brd ff:ff:ff:ff:ff:ff 2024-05-08T10:55:41.689 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp1s0f1 2024-05-08T10:55:41.689 INFO:teuthology.orchestra.run.smithi033.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-08T10:55:41.689 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 5e:1d:15:2d:e4:95 brd ff:ff:ff:ff:ff:ff 2024-05-08T10:55:41.689 INFO:teuthology.orchestra.run.smithi033.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-08T10:55:41.689 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-05-08T10:55:41.689 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::acf4:9cff:fe29:3730/64 scope link 2024-05-08T10:55:41.689 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-05-08T10:55:41.689 INFO:teuthology.orchestra.run.smithi033.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-08T10:55:41.689 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 5e:1d:15:2d:e4:95 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-08T10:55:41.689 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::5c1d:15ff:fe2d:e495/64 scope link 2024-05-08T10:55:41.690 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-05-08T10:55:41.690 INFO:teuthology.orchestra.run.smithi033.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-08T10:55:41.690 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether a6:37:ee:26:be:e4 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-08T10:55:41.690 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::a437:eeff:fe26:bee4/64 scope link 2024-05-08T10:55:41.690 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-05-08T10:55:41.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:55:41.690 DEBUG:teuthology.orchestra.run.smithi033:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-08T10:55:41.751 INFO:teuthology.orchestra.run.smithi033.stdout:1 2024-05-08T10:55:41.753 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:55:41.753 DEBUG:teuthology.orchestra.run.smithi033:> route 2024-05-08T10:55:41.810 INFO:teuthology.orchestra.run.smithi033.stdout:Kernel IP routing table 2024-05-08T10:55:41.810 INFO:teuthology.orchestra.run.smithi033.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-08T10:55:41.810 INFO:teuthology.orchestra.run.smithi033.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-05-08T10:55:41.810 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-05-08T10:55:41.810 INFO:teuthology.orchestra.run.smithi033.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-08T10:55:41.810 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-08T10:55:41.811 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2024-05-08T10:55:41.811 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-05-08T10:55:41.811 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-05-08T10:55:41.811 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-05-08T10:55:41.811 DEBUG:teuthology.orchestra.run.smithi033:> ') 2024-05-08T10:55:41.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:41 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-08T10:55:41.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T10:55:41.940 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:55:41.940 DEBUG:teuthology.orchestra.run.smithi033:> ip netns list 2024-05-08T10:55:41.956 INFO:teuthology.orchestra.run.smithi033.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-08T10:55:41.956 INFO:teuthology.orchestra.run.smithi033.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-08T10:55:41.956 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-08T10:55:41.957 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:55:41.957 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link set brx.0 up 2024-05-08T10:55:42.024 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-08T10:55:42.024 DEBUG:teuthology.orchestra.run.smithi033:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-08T10:55:42.080 INFO:teuthology.orchestra.run.smithi033.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-08T10:55:42.080 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-08T10:55:42.081 DEBUG:teuthology.orchestra.run.smithi033:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-08T10:55:42.137 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-05-08T10:55:42.137 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:55:42.137 DEBUG:teuthology.orchestra.run.smithi033:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-08T10:55:42.222 INFO:teuthology.orchestra.run.smithi033.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-08T10:55:42.222 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-08T10:55:42.229 INFO:teuthology.orchestra.run.smithi033.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-08T10:55:42.229 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-08T10:55:42.229 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: resolved to: "172.21.15.33:3300,172.21.15.174:3300,172.21.15.174:3301" 2024-05-08T10:55:42.230 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: trying mount with new device syntax: 0@963217b2-c375-4f5a-95cf-88e199dd38ff.cephfs=/ 2024-05-08T10:55:42.230 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.33:3300/172.21.15.174:3300/172.21.15.174:3301" will pass to kernel 2024-05-08T10:55:42.230 INFO:teuthology.orchestra.run.smithi033.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-05-08T10:55:42.230 INFO:teuthology.orchestra.run.smithi033.stdout: You just mounted a file system that supports labels which does not 2024-05-08T10:55:42.230 INFO:teuthology.orchestra.run.smithi033.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-08T10:55:42.230 INFO:teuthology.orchestra.run.smithi033.stdout: applications will generate AVC messages and not be allowed access to 2024-05-08T10:55:42.230 INFO:teuthology.orchestra.run.smithi033.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-08T10:55:42.232 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-08T10:55:42.232 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:55:42.232 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-08T10:55:42.257 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-08T10:55:42.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:42 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-08T10:55:42.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T10:55:42.355 INFO:teuthology.orchestra.run.smithi033.stdout:client4918 2024-05-08T10:55:42.355 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-05-08T10:55:42.355 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T10:55:42.372 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:55:42.372 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -rf mydir) 2024-05-08T10:55:42.434 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T10:55:42.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:42.581+0000 7f08e5a58640 1 Processor -- start 2024-05-08T10:55:42.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:42.581+0000 7f08e5a58640 1 -- start start 2024-05-08T10:55:42.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:42.582+0000 7f08e5a58640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f08e015df20 0x7f08e00cf170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:42.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:42.582+0000 7f08e5a58640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f08e00cf6b0 0x7f08e00d2180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:42.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:42.582+0000 7f08e5a58640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08e00b3140 con 0x7f08e00d26c0 2024-05-08T10:55:42.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:42.582+0000 7f08e5a58640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08e00d2b10 con 0x7f08e00cf6b0 2024-05-08T10:55:42.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:42.582+0000 7f08e5a58640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08e00b3420 con 0x7f08e015df20 2024-05-08T10:55:42.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:42.582+0000 7f08de7fc640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f08e00cf6b0 0x7f08e00d2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:42.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:42.582+0000 7f08de7fc640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f08e00cf6b0 0x7f08e00d2180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56768/0 (socket says 172.21.15.33:56768) 2024-05-08T10:55:42.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:42.582+0000 7f08de7fc640 1 -- 172.21.15.33:0/3913080455 learned_addr learned my addr 172.21.15.33:0/3913080455 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:42.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:42.583+0000 7f08deffd640 1 --2- 172.21.15.33:0/3913080455 >> v2:172.21.15.174:3300/0 conn(0x7f08e015df20 0x7f08e00cf170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:42.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:42.583+0000 7f08de7fc640 1 -- 172.21.15.33:0/3913080455 >> v2:172.21.15.174:3300/0 conn(0x7f08e015df20 msgr2=0x7f08e00cf170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:42.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:42.583+0000 7f08de7fc640 1 --2- 172.21.15.33:0/3913080455 >> v2:172.21.15.174:3300/0 conn(0x7f08e015df20 0x7f08e00cf170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:42.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:42.583+0000 7f08de7fc640 1 -- 172.21.15.33:0/3913080455 >> v1:172.21.15.174:6789/0 conn(0x7f08e00d26c0 legacy=0x7f08e00d01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:42.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:42.583+0000 7f08de7fc640 1 -- 172.21.15.33:0/3913080455 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08e00b3700 con 0x7f08e00cf6b0 2024-05-08T10:55:42.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:42.583+0000 7f08de7fc640 1 --2- 172.21.15.33:0/3913080455 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08e00cf6b0 0x7f08e00d2180 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f08e00b66a0 tx=0x7f08d402a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a40b13fb96702ea8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:42.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:42.584+0000 7f08ddffb640 1 -- 172.21.15.33:0/3913080455 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d4037070 con 0x7f08e00cf6b0 2024-05-08T10:55:42.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:42.584+0000 7f08ddffb640 1 -- 172.21.15.33:0/3913080455 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08d402ae50 con 0x7f08e00cf6b0 2024-05-08T10:55:42.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:42.584+0000 7f08ddffb640 1 -- 172.21.15.33:0/3913080455 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d4032860 con 0x7f08e00cf6b0 2024-05-08T10:55:42.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:42.584+0000 7f08e5a58640 1 -- 172.21.15.33:0/3913080455 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08e00cf6b0 msgr2=0x7f08e00d2180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:42.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:42.584+0000 7f08e5a58640 1 --2- 172.21.15.33:0/3913080455 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08e00cf6b0 0x7f08e00d2180 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f08e00b66a0 tx=0x7f08d402a300 comp rx=0 tx=0).stop 2024-05-08T10:55:42.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:42.584+0000 7f08e5a58640 1 -- 172.21.15.33:0/3913080455 shutdown_connections 2024-05-08T10:55:42.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:42.584+0000 7f08e5a58640 1 --2- 172.21.15.33:0/3913080455 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08e00cf6b0 0x7f08e00d2180 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:42.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:42.584+0000 7f08e5a58640 1 --2- 172.21.15.33:0/3913080455 >> v2:172.21.15.174:3300/0 conn(0x7f08e015df20 0x7f08e00cf170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:42.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:42.584+0000 7f08e5a58640 1 -- 172.21.15.33:0/3913080455 >> 172.21.15.33:0/3913080455 conn(0x7f08e009ce70 msgr2=0x7f08e00d3ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:42.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:42.584+0000 7f08e5a58640 1 -- 172.21.15.33:0/3913080455 shutdown_connections 2024-05-08T10:55:42.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:42.584+0000 7f08e5a58640 1 -- 172.21.15.33:0/3913080455 wait complete. 2024-05-08T10:55:42.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:42.585+0000 7f08e5a58640 1 Processor -- start 2024-05-08T10:55:42.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:42.586+0000 7f08e5a58640 1 -- start start 2024-05-08T10:55:42.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:42.586+0000 7f08e5a58640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08e00cf6b0 0x7f08e015e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:42.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:42.586+0000 7f08e5a58640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f08e00d26c0 0x7f08e015ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:42.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:42.586+0000 7f08e5a58640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f08e015df20 0x7f08e015f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:42.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:42.586+0000 7f08e5a58640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08e00d1b40 con 0x7f08e00cf6b0 2024-05-08T10:55:42.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:42.586+0000 7f08e5a58640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08e015e300 con 0x7f08e00d26c0 2024-05-08T10:55:42.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:42.586+0000 7f08e5a58640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08e00d1cc0 con 0x7f08e015df20 2024-05-08T10:55:42.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:42.586+0000 7f08deffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08e00cf6b0 0x7f08e015e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:42.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:42.586+0000 7f08deffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08e00cf6b0 0x7f08e015e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56782/0 (socket says 172.21.15.33:56782) 2024-05-08T10:55:42.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:42.586+0000 7f08deffd640 1 -- 172.21.15.33:0/1901977026 learned_addr learned my addr 172.21.15.33:0/1901977026 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:42.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:42.587+0000 7f08de7fc640 1 --2- 172.21.15.33:0/1901977026 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f08e00d26c0 0x7f08e015ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:42.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:42.587+0000 7f08df7fe640 1 --2- 172.21.15.33:0/1901977026 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f08e015df20 0x7f08e015f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:42.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:42.587+0000 7f08deffd640 1 -- 172.21.15.33:0/1901977026 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f08e015df20 msgr2=0x7f08e015f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:42.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:42.587+0000 7f08deffd640 1 --2- 172.21.15.33:0/1901977026 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f08e015df20 0x7f08e015f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:42.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:42.587+0000 7f08deffd640 1 -- 172.21.15.33:0/1901977026 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f08e00d26c0 msgr2=0x7f08e015ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:42.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:42.587+0000 7f08deffd640 1 --2- 172.21.15.33:0/1901977026 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f08e00d26c0 0x7f08e015ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:42.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:42.587+0000 7f08deffd640 1 -- 172.21.15.33:0/1901977026 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08e00cbde0 con 0x7f08e00cf6b0 2024-05-08T10:55:42.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:42.587+0000 7f08df7fe640 1 --2- 172.21.15.33:0/1901977026 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f08e015df20 0x7f08e015f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:55:42.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:42.587+0000 7f08deffd640 1 --2- 172.21.15.33:0/1901977026 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08e00cf6b0 0x7f08e015e920 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f08d0007e40 tx=0x7f08d000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:42.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:42.587+0000 7f08c7fff640 1 -- 172.21.15.33:0/1901977026 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d0014620 con 0x7f08e00cf6b0 2024-05-08T10:55:42.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:42.587+0000 7f08c7fff640 1 -- 172.21.15.33:0/1901977026 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08d0019070 con 0x7f08e00cf6b0 2024-05-08T10:55:42.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:42.587+0000 7f08e5a58640 1 -- 172.21.15.33:0/1901977026 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08e00cc0c0 con 0x7f08e00cf6b0 2024-05-08T10:55:42.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:42.587+0000 7f08c7fff640 1 -- 172.21.15.33:0/1901977026 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d0014a00 con 0x7f08e00cf6b0 2024-05-08T10:55:42.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:42.587+0000 7f08e5a58640 1 -- 172.21.15.33:0/1901977026 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08e00cc680 con 0x7f08e00cf6b0 2024-05-08T10:55:42.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:42.588+0000 7f08e5a58640 1 -- 172.21.15.33:0/1901977026 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08e0069d20 con 0x7f08e00cf6b0 2024-05-08T10:55:42.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:42.589+0000 7f08c7fff640 1 -- 172.21.15.33:0/1901977026 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f08d0014ba0 con 0x7f08e00cf6b0 2024-05-08T10:55:42.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:42.589+0000 7f08c7fff640 1 --2- 172.21.15.33:0/1901977026 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f08cc06b4d0 0x7f08cc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:42.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:42.589+0000 7f08c7fff640 1 -- 172.21.15.33:0/1901977026 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f08d008aa60 con 0x7f08e00cf6b0 2024-05-08T10:55:42.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:42.590+0000 7f08de7fc640 1 --2- 172.21.15.33:0/1901977026 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f08cc06b4d0 0x7f08cc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:42.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:42.590+0000 7f08de7fc640 1 --2- 172.21.15.33:0/1901977026 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f08cc06b4d0 0x7f08cc06d990 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f08d4034000 tx=0x7f08d402e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:42.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:42.594+0000 7f08c7fff640 1 -- 172.21.15.33:0/1901977026 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f08d0059970 con 0x7f08e00cf6b0 2024-05-08T10:55:42.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:42.811+0000 7f08e5a58640 1 -- 172.21.15.33:0/1901977026 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f08e00d4470 con 0x7f08e00cf6b0 2024-05-08T10:55:42.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:42.812+0000 7f08c7fff640 1 -- 172.21.15.33:0/1901977026 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4941 (secure 0 0 0) 0x7f08d0059270 con 0x7f08e00cf6b0 2024-05-08T10:55:42.809 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:55:42.809 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4592,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6836/2731663891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2731663891},{"type":"v1","addr":"172.21.15.174:6836","nonce":2731663891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":4598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/2004985147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6833","nonce":2004985147},{"type":"v1","addr":"172.21.15.33:6835","nonce":2004985147}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4702,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6837/3164144740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6835","nonce":3164144740},{"type":"v1","addr":"172.21.15.174:6837","nonce":3164144740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T10:55:31.311811+0000","modified":"2024-05-08T10:55:33.333600+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4708},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4708":{"gid":4708,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.33:6834/415400390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":415400390},{"type":"v1","addr":"172.21.15.33:6834","nonce":415400390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-05-08T10:55:42.809 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 14 2024-05-08T10:55:42.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:42.813+0000 7f08e5a58640 1 -- 172.21.15.33:0/1901977026 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f08cc06b4d0 msgr2=0x7f08cc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:42.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:42.813+0000 7f08e5a58640 1 --2- 172.21.15.33:0/1901977026 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f08cc06b4d0 0x7f08cc06d990 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f08d4034000 tx=0x7f08d402e000 comp rx=0 tx=0).stop 2024-05-08T10:55:42.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:42.813+0000 7f08e5a58640 1 -- 172.21.15.33:0/1901977026 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08e00cf6b0 msgr2=0x7f08e015e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:42.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:42.813+0000 7f08e5a58640 1 --2- 172.21.15.33:0/1901977026 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08e00cf6b0 0x7f08e015e920 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f08d0007e40 tx=0x7f08d000e4b0 comp rx=0 tx=0).stop 2024-05-08T10:55:42.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:42.813+0000 7f08e5a58640 1 -- 172.21.15.33:0/1901977026 shutdown_connections 2024-05-08T10:55:42.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:42.813+0000 7f08e5a58640 1 --2- 172.21.15.33:0/1901977026 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f08cc06b4d0 0x7f08cc06d990 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:42.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:42.813+0000 7f08e5a58640 1 --2- 172.21.15.33:0/1901977026 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f08e015df20 0x7f08e015f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:42.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:42.813+0000 7f08e5a58640 1 --2- 172.21.15.33:0/1901977026 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f08e00d26c0 0x7f08e015ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:42.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:42.813+0000 7f08e5a58640 1 --2- 172.21.15.33:0/1901977026 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08e00cf6b0 0x7f08e015e920 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:42.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:42.813+0000 7f08e5a58640 1 -- 172.21.15.33:0/1901977026 >> 172.21.15.33:0/1901977026 conn(0x7f08e009ce70 msgr2=0x7f08e015d180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:42.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:42.814+0000 7f08e5a58640 1 -- 172.21.15.33:0/1901977026 shutdown_connections 2024-05-08T10:55:42.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:42.814+0000 7f08e5a58640 1 -- 172.21.15.33:0/1901977026 wait complete. 2024-05-08T10:55:42.822 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2024-05-08T10:55:42.955 INFO:teuthology.orchestra.run.smithi033.stdout:{"message":"","return_code":0} 2024-05-08T10:55:42.956 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-05-08T10:55:42.956 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T10:55:43.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:43.063+0000 7fcf13796640 1 Processor -- start 2024-05-08T10:55:43.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:43.063+0000 7fcf13796640 1 -- start start 2024-05-08T10:55:43.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:43.064+0000 7fcf13796640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcf0c15df80 0x7fcf0c1619d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:43.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:43.064+0000 7fcf13796640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fcf0c06c830 0x7fcf0c06ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:43.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:43.064+0000 7fcf13796640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf0c0d0b80 con 0x7fcf0c0d0610 2024-05-08T10:55:43.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:43.064+0000 7fcf13796640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf0c06c3a0 con 0x7fcf0c06c830 2024-05-08T10:55:43.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:43.064+0000 7fcf13796640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf0c06bd50 con 0x7fcf0c15df80 2024-05-08T10:55:43.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:43.064+0000 7fcf11d33640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fcf0c06c830 0x7fcf0c06ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:43.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:43.064+0000 7fcf10d31640 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fcf0c0d0610 0x7fcf0c161f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.33:55844/0 (socket says 172.21.15.33:55844) 2024-05-08T10:55:43.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:43.064+0000 7fcf11532640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcf0c15df80 0x7fcf0c1619d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:43.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:43.064+0000 7fcf10d31640 1 -- 172.21.15.33:0/4279508344 learned_addr learned my addr 172.21.15.33:0/4279508344 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-05-08T10:55:43.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:43.064+0000 7fcf11d33640 1 --2- 172.21.15.33:0/4279508344 >> v2:172.21.15.174:3300/0 conn(0x7fcf0c06c830 0x7fcf0c06ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.33:33450/0 (socket says 172.21.15.33:33450) 2024-05-08T10:55:43.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:43.065+0000 7fcf11d33640 1 -- 172.21.15.33:0/4279508344 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcf0c15df80 msgr2=0x7fcf0c1619d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:43.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:43.065+0000 7fcf11d33640 1 --2- 172.21.15.33:0/4279508344 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcf0c15df80 0x7fcf0c1619d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:43.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:43.065+0000 7fcf11d33640 1 -- 172.21.15.33:0/4279508344 >> v1:172.21.15.174:6789/0 conn(0x7fcf0c0d0610 legacy=0x7fcf0c161f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:43.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:43.065+0000 7fcefffff640 1 -- 172.21.15.33:0/4279508344 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 18492237 0 0) 0x7fcf0c0d0b80 con 0x7fcf0c0d0610 2024-05-08T10:55:43.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:43.065+0000 7fcf11d33640 1 -- 172.21.15.33:0/4279508344 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf0c06c030 con 0x7fcf0c06c830 2024-05-08T10:55:43.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:43.065+0000 7fcf11532640 1 --2- 172.21.15.33:0/4279508344 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcf0c15df80 0x7fcf0c1619d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T10:55:43.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:43.065+0000 7fcf11d33640 1 --2- 172.21.15.33:0/4279508344 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcf0c06c830 0x7fcf0c06ccc0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fcf04009d90 tx=0x7fcf0402a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=465c81182ccde7b5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:43.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:43.066+0000 7fcefffff640 1 -- 172.21.15.33:0/4279508344 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf04007740 con 0x7fcf0c06c830 2024-05-08T10:55:43.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:43.066+0000 7fcefffff640 1 -- 172.21.15.33:0/4279508344 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf040078e0 con 0x7fcf0c06c830 2024-05-08T10:55:43.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:43.066+0000 7fcefffff640 1 -- 172.21.15.33:0/4279508344 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf04007cb0 con 0x7fcf0c06c830 2024-05-08T10:55:43.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:43.066+0000 7fcf13796640 1 -- 172.21.15.33:0/4279508344 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcf0c06c830 msgr2=0x7fcf0c06ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:43.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:43.066+0000 7fcf13796640 1 --2- 172.21.15.33:0/4279508344 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcf0c06c830 0x7fcf0c06ccc0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fcf04009d90 tx=0x7fcf0402a660 comp rx=0 tx=0).stop 2024-05-08T10:55:43.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:43.066+0000 7fcf13796640 1 -- 172.21.15.33:0/4279508344 shutdown_connections 2024-05-08T10:55:43.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:43.066+0000 7fcf13796640 1 --2- 172.21.15.33:0/4279508344 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcf0c06c830 0x7fcf0c06ccc0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:43.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:43.066+0000 7fcf13796640 1 --2- 172.21.15.33:0/4279508344 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcf0c15df80 0x7fcf0c1619d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:43.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:43.066+0000 7fcf13796640 1 -- 172.21.15.33:0/4279508344 >> 172.21.15.33:0/4279508344 conn(0x7fcf0c0d19b0 msgr2=0x7fcf0c0d1dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:43.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:43.066+0000 7fcf13796640 1 -- 172.21.15.33:0/4279508344 shutdown_connections 2024-05-08T10:55:43.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:43.066+0000 7fcf13796640 1 -- 172.21.15.33:0/4279508344 wait complete. 2024-05-08T10:55:43.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:43.067+0000 7fcf13796640 1 Processor -- start 2024-05-08T10:55:43.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:43.067+0000 7fcf13796640 1 -- start start 2024-05-08T10:55:43.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:43.068+0000 7fcf13796640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcf0c06c830 0x7fcf0c1e8270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:43.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:43.068+0000 7fcf13796640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf0c0d0610 0x7fcf0c1549e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:43.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:43.068+0000 7fcf13796640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcf0c15df80 0x7fcf0c0b3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:43.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:43.068+0000 7fcf13796640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf0c06fa90 con 0x7fcf0c0d0610 2024-05-08T10:55:43.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:43.068+0000 7fcf13796640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf0c06f910 con 0x7fcf0c15df80 2024-05-08T10:55:43.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:43.068+0000 7fcf13796640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf0c162620 con 0x7fcf0c06c830 2024-05-08T10:55:43.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:43.068+0000 7fcf10d31640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf0c0d0610 0x7fcf0c1549e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:43.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:43.068+0000 7fcf10d31640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf0c0d0610 0x7fcf0c1549e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56794/0 (socket says 172.21.15.33:56794) 2024-05-08T10:55:43.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:43.068+0000 7fcf10d31640 1 -- 172.21.15.33:0/79863261 learned_addr learned my addr 172.21.15.33:0/79863261 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:43.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:43.069+0000 7fcf11532640 1 --2- 172.21.15.33:0/79863261 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcf0c06c830 0x7fcf0c1e8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:43.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:43.069+0000 7fcf11d33640 1 --2- 172.21.15.33:0/79863261 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcf0c15df80 0x7fcf0c0b3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:43.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:43.069+0000 7fcf10d31640 1 -- 172.21.15.33:0/79863261 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcf0c06c830 msgr2=0x7fcf0c1e8270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:43.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:43.069+0000 7fcf10d31640 1 --2- 172.21.15.33:0/79863261 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcf0c06c830 0x7fcf0c1e8270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:43.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:43.069+0000 7fcf10d31640 1 -- 172.21.15.33:0/79863261 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcf0c15df80 msgr2=0x7fcf0c0b3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:43.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:43.069+0000 7fcf10d31640 1 --2- 172.21.15.33:0/79863261 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcf0c15df80 0x7fcf0c0b3980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:43.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:43.069+0000 7fcf10d31640 1 -- 172.21.15.33:0/79863261 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf0c0b2540 con 0x7fcf0c0d0610 2024-05-08T10:55:43.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:43.069+0000 7fcf10d31640 1 --2- 172.21.15.33:0/79863261 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf0c0d0610 0x7fcf0c1549e0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fcf0000c500 tx=0x7fcf0000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:43.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:43.069+0000 7fcefdffb640 1 -- 172.21.15.33:0/79863261 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf00018070 con 0x7fcf0c0d0610 2024-05-08T10:55:43.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:43.069+0000 7fcefdffb640 1 -- 172.21.15.33:0/79863261 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf00007580 con 0x7fcf0c0d0610 2024-05-08T10:55:43.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:43.069+0000 7fcefdffb640 1 -- 172.21.15.33:0/79863261 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf00004a20 con 0x7fcf0c0d0610 2024-05-08T10:55:43.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:43.069+0000 7fcf13796640 1 -- 172.21.15.33:0/79863261 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf0c1e77f0 con 0x7fcf0c0d0610 2024-05-08T10:55:43.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:43.069+0000 7fcf13796640 1 -- 172.21.15.33:0/79863261 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf0c1e7db0 con 0x7fcf0c0d0610 2024-05-08T10:55:43.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:43.070+0000 7fcf13796640 1 -- 172.21.15.33:0/79863261 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf0c1e88d0 con 0x7fcf0c0d0610 2024-05-08T10:55:43.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:43.071+0000 7fcefdffb640 1 -- 172.21.15.33:0/79863261 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fcf0001b070 con 0x7fcf0c0d0610 2024-05-08T10:55:43.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:43.071+0000 7fcefdffb640 1 --2- 172.21.15.33:0/79863261 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fcef006b4d0 0x7fcef006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:43.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:43.071+0000 7fcefdffb640 1 -- 172.21.15.33:0/79863261 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcf00089480 con 0x7fcf0c0d0610 2024-05-08T10:55:43.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:43.072+0000 7fcf11532640 1 --2- 172.21.15.33:0/79863261 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fcef006b4d0 0x7fcef006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:43.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:43.072+0000 7fcf11532640 1 --2- 172.21.15.33:0/79863261 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fcef006b4d0 0x7fcef006d990 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fcf08009560 tx=0x7fcf08009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:43.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:43.075+0000 7fcefdffb640 1 -- 172.21.15.33:0/79863261 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fcf00057cb0 con 0x7fcf0c0d0610 2024-05-08T10:55:43.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:43.294+0000 7fcf13796640 1 -- 172.21.15.33:0/79863261 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcf0c1574a0 con 0x7fcf0c0d0610 2024-05-08T10:55:43.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:43.294+0000 7fcefdffb640 1 -- 172.21.15.33:0/79863261 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4941 (secure 0 0 0) 0x7fcf0005bd50 con 0x7fcf0c0d0610 2024-05-08T10:55:43.292 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:55:43.292 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4592,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6836/2731663891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2731663891},{"type":"v1","addr":"172.21.15.174:6836","nonce":2731663891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":4598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/2004985147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6833","nonce":2004985147},{"type":"v1","addr":"172.21.15.33:6835","nonce":2004985147}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4702,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6837/3164144740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6835","nonce":3164144740},{"type":"v1","addr":"172.21.15.174:6837","nonce":3164144740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T10:55:31.311811+0000","modified":"2024-05-08T10:55:33.333600+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4708},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4708":{"gid":4708,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.33:6834/415400390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":415400390},{"type":"v1","addr":"172.21.15.33:6834","nonce":415400390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-05-08T10:55:43.293 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 14 2024-05-08T10:55:43.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:43.296+0000 7fcf13796640 1 -- 172.21.15.33:0/79863261 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fcef006b4d0 msgr2=0x7fcef006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:43.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:43.296+0000 7fcf13796640 1 --2- 172.21.15.33:0/79863261 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fcef006b4d0 0x7fcef006d990 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fcf08009560 tx=0x7fcf08009190 comp rx=0 tx=0).stop 2024-05-08T10:55:43.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:43.296+0000 7fcf13796640 1 -- 172.21.15.33:0/79863261 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf0c0d0610 msgr2=0x7fcf0c1549e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:43.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:43.296+0000 7fcf13796640 1 --2- 172.21.15.33:0/79863261 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf0c0d0610 0x7fcf0c1549e0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fcf0000c500 tx=0x7fcf0000c9c0 comp rx=0 tx=0).stop 2024-05-08T10:55:43.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:43.297+0000 7fcf13796640 1 -- 172.21.15.33:0/79863261 shutdown_connections 2024-05-08T10:55:43.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:43.297+0000 7fcf13796640 1 --2- 172.21.15.33:0/79863261 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fcef006b4d0 0x7fcef006d990 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:43.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:43.297+0000 7fcf13796640 1 --2- 172.21.15.33:0/79863261 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcf0c15df80 0x7fcf0c0b3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:43.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:43.297+0000 7fcf13796640 1 --2- 172.21.15.33:0/79863261 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf0c0d0610 0x7fcf0c1549e0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:43.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:43.297+0000 7fcf13796640 1 --2- 172.21.15.33:0/79863261 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcf0c06c830 0x7fcf0c1e8270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:43.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:43.297+0000 7fcf13796640 1 -- 172.21.15.33:0/79863261 >> 172.21.15.33:0/79863261 conn(0x7fcf0c0d19b0 msgr2=0x7fcf0c0cc120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:43.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:43.297+0000 7fcf13796640 1 -- 172.21.15.33:0/79863261 shutdown_connections 2024-05-08T10:55:43.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:43.297+0000 7fcf13796640 1 -- 172.21.15.33:0/79863261 wait complete. 2024-05-08T10:55:43.305 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json perf dump mds_cache 2024-05-08T10:55:43.423 INFO:teuthology.orchestra.run.smithi033.stdout:{"mds_cache":{"dir_update":0,"dir_update_receipt":0,"dir_try_discover":0,"dir_send_discover":0,"dir_handle_discover":0,"num_strays":2,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":2,"strays_enqueued":0,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0}} 2024-05-08T10:55:43.424 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_cache": { "dir_handle_discover": 0, "dir_send_discover": 0, "dir_try_discover": 0, "dir_update": 0, "dir_update_receipt": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 2, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 2, "strays_enqueued": 0, "strays_migrated": 0, "strays_reintegrated": 0 } } 2024-05-08T10:55:43.424 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=60 retry_count=0)... 2024-05-08T10:55:48.425 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T10:55:48.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:48.545+0000 7f0aad65d640 1 Processor -- start 2024-05-08T10:55:48.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:48.545+0000 7f0aad65d640 1 -- start start 2024-05-08T10:55:48.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:48.546+0000 7f0aad65d640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f0aa81455b0 0x7f0aa815cb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:48.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:48.546+0000 7f0aad65d640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f0aa80cdc70 0x7f0aa80b43e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:48.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:48.546+0000 7f0aad65d640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0aa815d060 con 0x7f0aa80b4920 2024-05-08T10:55:48.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:48.546+0000 7f0aad65d640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0aa8145990 con 0x7f0aa80cdc70 2024-05-08T10:55:48.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:48.546+0000 7f0aad65d640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0aa80b4d00 con 0x7f0aa81455b0 2024-05-08T10:55:48.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:48.546+0000 7f0aa67fc640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f0aa80cdc70 0x7f0aa80b43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:48.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:48.547+0000 7f0aa67fc640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f0aa80cdc70 0x7f0aa80b43e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37056/0 (socket says 172.21.15.33:37056) 2024-05-08T10:55:48.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:48.547+0000 7f0aa67fc640 1 -- 172.21.15.33:0/1665730096 learned_addr learned my addr 172.21.15.33:0/1665730096 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:48.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:48.547+0000 7f0aa6ffd640 1 --2- 172.21.15.33:0/1665730096 >> v2:172.21.15.174:3300/0 conn(0x7f0aa81455b0 0x7f0aa815cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:48.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:48.547+0000 7f0aa67fc640 1 -- 172.21.15.33:0/1665730096 >> v2:172.21.15.174:3300/0 conn(0x7f0aa81455b0 msgr2=0x7f0aa815cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:48.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:48.547+0000 7f0aa67fc640 1 --2- 172.21.15.33:0/1665730096 >> v2:172.21.15.174:3300/0 conn(0x7f0aa81455b0 0x7f0aa815cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:48.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:48.547+0000 7f0aa67fc640 1 -- 172.21.15.33:0/1665730096 >> v1:172.21.15.174:6789/0 conn(0x7f0aa80b4920 legacy=0x7f0aa815f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:48.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:48.547+0000 7f0aa67fc640 1 -- 172.21.15.33:0/1665730096 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aa80cfbd0 con 0x7f0aa80cdc70 2024-05-08T10:55:48.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:48.547+0000 7f0aa6ffd640 1 --2- 172.21.15.33:0/1665730096 >> v2:172.21.15.174:3300/0 conn(0x7f0aa81455b0 0x7f0aa815cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:55:48.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:48.548+0000 7f0aa67fc640 1 --2- 172.21.15.33:0/1665730096 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0aa80cdc70 0x7f0aa80b43e0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f0aa80d0aa0 tx=0x7f0a9c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=deaf979a39595712 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:48.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:48.548+0000 7f0aa5ffb640 1 -- 172.21.15.33:0/1665730096 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a9c037070 con 0x7f0aa80cdc70 2024-05-08T10:55:48.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:48.548+0000 7f0aa5ffb640 1 -- 172.21.15.33:0/1665730096 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a9c032440 con 0x7f0aa80cdc70 2024-05-08T10:55:48.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:48.548+0000 7f0aa5ffb640 1 -- 172.21.15.33:0/1665730096 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a9c032810 con 0x7f0aa80cdc70 2024-05-08T10:55:48.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:48.548+0000 7f0aad65d640 1 -- 172.21.15.33:0/1665730096 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0aa80cdc70 msgr2=0x7f0aa80b43e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:48.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:48.548+0000 7f0aad65d640 1 --2- 172.21.15.33:0/1665730096 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0aa80cdc70 0x7f0aa80b43e0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f0aa80d0aa0 tx=0x7f0a9c02a1e0 comp rx=0 tx=0).stop 2024-05-08T10:55:48.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:48.548+0000 7f0aad65d640 1 -- 172.21.15.33:0/1665730096 shutdown_connections 2024-05-08T10:55:48.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:48.548+0000 7f0aad65d640 1 --2- 172.21.15.33:0/1665730096 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0aa80cdc70 0x7f0aa80b43e0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:48.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:48.548+0000 7f0aad65d640 1 --2- 172.21.15.33:0/1665730096 >> v2:172.21.15.174:3300/0 conn(0x7f0aa81455b0 0x7f0aa815cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:48.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:48.548+0000 7f0aad65d640 1 -- 172.21.15.33:0/1665730096 >> 172.21.15.33:0/1665730096 conn(0x7f0aa806aba0 msgr2=0x7f0aa806afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:48.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:48.548+0000 7f0aad65d640 1 -- 172.21.15.33:0/1665730096 shutdown_connections 2024-05-08T10:55:48.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:48.549+0000 7f0aad65d640 1 -- 172.21.15.33:0/1665730096 wait complete. 2024-05-08T10:55:48.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:48.550+0000 7f0aad65d640 1 Processor -- start 2024-05-08T10:55:48.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:48.550+0000 7f0aad65d640 1 -- start start 2024-05-08T10:55:48.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:48.551+0000 7f0aad65d640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0aa80b4920 0x7f0aa8154a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:48.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:48.551+0000 7f0aad65d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0aa80cdc70 0x7f0aa80b38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:48.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:48.551+0000 7f0aad65d640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0aa81455b0 0x7f0aa8158d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:48.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:48.551+0000 7f0aad65d640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa806d0d0 con 0x7f0aa80cdc70 2024-05-08T10:55:48.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:48.551+0000 7f0aad65d640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa806cdf0 con 0x7f0aa81455b0 2024-05-08T10:55:48.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:48.551+0000 7f0aad65d640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa806d3b0 con 0x7f0aa80b4920 2024-05-08T10:55:48.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:48.551+0000 7f0aa67fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0aa80cdc70 0x7f0aa80b38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:48.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:48.551+0000 7f0aa67fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0aa80cdc70 0x7f0aa80b38a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37070/0 (socket says 172.21.15.33:37070) 2024-05-08T10:55:48.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:48.551+0000 7f0aa67fc640 1 -- 172.21.15.33:0/2935251483 learned_addr learned my addr 172.21.15.33:0/2935251483 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:48.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:48.551+0000 7f0aa77fe640 1 --2- 172.21.15.33:0/2935251483 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0aa81455b0 0x7f0aa8158d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:48.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:48.551+0000 7f0aa6ffd640 1 --2- 172.21.15.33:0/2935251483 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0aa80b4920 0x7f0aa8154a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:48.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:48.551+0000 7f0aa67fc640 1 -- 172.21.15.33:0/2935251483 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0aa80b4920 msgr2=0x7f0aa8154a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:48.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:48.551+0000 7f0aa67fc640 1 --2- 172.21.15.33:0/2935251483 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0aa80b4920 0x7f0aa8154a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:48.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:48.551+0000 7f0aa67fc640 1 -- 172.21.15.33:0/2935251483 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0aa81455b0 msgr2=0x7f0aa8158d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:48.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:48.551+0000 7f0aa67fc640 1 --2- 172.21.15.33:0/2935251483 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0aa81455b0 0x7f0aa8158d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:48.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:48.551+0000 7f0aa67fc640 1 -- 172.21.15.33:0/2935251483 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aa8130a30 con 0x7f0aa80cdc70 2024-05-08T10:55:48.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:48.551+0000 7f0aa67fc640 1 --2- 172.21.15.33:0/2935251483 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0aa80cdc70 0x7f0aa80b38a0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c02a220 tx=0x7f0a9c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:48.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:48.552+0000 7f0a8f7fe640 1 -- 172.21.15.33:0/2935251483 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a9c041020 con 0x7f0aa80cdc70 2024-05-08T10:55:48.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:48.552+0000 7f0a8f7fe640 1 -- 172.21.15.33:0/2935251483 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a9c0306c0 con 0x7f0aa80cdc70 2024-05-08T10:55:48.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:48.552+0000 7f0aad65d640 1 -- 172.21.15.33:0/2935251483 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0aa8156760 con 0x7f0aa80cdc70 2024-05-08T10:55:48.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:48.552+0000 7f0a8f7fe640 1 -- 172.21.15.33:0/2935251483 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a9c037040 con 0x7f0aa80cdc70 2024-05-08T10:55:48.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:48.552+0000 7f0aad65d640 1 -- 172.21.15.33:0/2935251483 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0aa8155350 con 0x7f0aa80cdc70 2024-05-08T10:55:48.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:48.553+0000 7f0aad65d640 1 -- 172.21.15.33:0/2935251483 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0aa8144e10 con 0x7f0aa80cdc70 2024-05-08T10:55:48.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:48.553+0000 7f0a8f7fe640 1 -- 172.21.15.33:0/2935251483 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0a9c044020 con 0x7f0aa80cdc70 2024-05-08T10:55:48.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:48.554+0000 7f0a8f7fe640 1 --2- 172.21.15.33:0/2935251483 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f0a9406b4d0 0x7f0a9406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:48.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:48.554+0000 7f0a8f7fe640 1 -- 172.21.15.33:0/2935251483 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0a9c0aa8e0 con 0x7f0aa80cdc70 2024-05-08T10:55:48.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:48.554+0000 7f0aa6ffd640 1 --2- 172.21.15.33:0/2935251483 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f0a9406b4d0 0x7f0a9406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:48.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:48.554+0000 7f0aa6ffd640 1 --2- 172.21.15.33:0/2935251483 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f0a9406b4d0 0x7f0a9406d990 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0a98003b80 tx=0x7f0a98009890 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:48.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:48.558+0000 7f0a8f7fe640 1 -- 172.21.15.33:0/2935251483 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0aa8144e10 con 0x7f0aa80cdc70 2024-05-08T10:55:48.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:48.776+0000 7f0aad65d640 1 -- 172.21.15.33:0/2935251483 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0aa8156930 con 0x7f0aa80cdc70 2024-05-08T10:55:48.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:48.776+0000 7f0a8f7fe640 1 -- 172.21.15.33:0/2935251483 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4941 (secure 0 0 0) 0x7f0a9c04b030 con 0x7f0aa80cdc70 2024-05-08T10:55:48.774 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:55:48.774 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4592,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6836/2731663891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2731663891},{"type":"v1","addr":"172.21.15.174:6836","nonce":2731663891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":4598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/2004985147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6833","nonce":2004985147},{"type":"v1","addr":"172.21.15.33:6835","nonce":2004985147}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4702,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6837/3164144740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6835","nonce":3164144740},{"type":"v1","addr":"172.21.15.174:6837","nonce":3164144740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T10:55:31.311811+0000","modified":"2024-05-08T10:55:33.333600+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4708},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4708":{"gid":4708,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.33:6834/415400390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":415400390},{"type":"v1","addr":"172.21.15.33:6834","nonce":415400390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-05-08T10:55:48.774 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 14 2024-05-08T10:55:48.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:48.778+0000 7f0aad65d640 1 -- 172.21.15.33:0/2935251483 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f0a9406b4d0 msgr2=0x7f0a9406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:48.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:48.778+0000 7f0aad65d640 1 --2- 172.21.15.33:0/2935251483 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f0a9406b4d0 0x7f0a9406d990 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0a98003b80 tx=0x7f0a98009890 comp rx=0 tx=0).stop 2024-05-08T10:55:48.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:48.778+0000 7f0aad65d640 1 -- 172.21.15.33:0/2935251483 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0aa80cdc70 msgr2=0x7f0aa80b38a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:48.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:48.778+0000 7f0aad65d640 1 --2- 172.21.15.33:0/2935251483 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0aa80cdc70 0x7f0aa80b38a0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c02a220 tx=0x7f0a9c0046c0 comp rx=0 tx=0).stop 2024-05-08T10:55:48.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:48.779+0000 7f0aad65d640 1 -- 172.21.15.33:0/2935251483 shutdown_connections 2024-05-08T10:55:48.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:48.779+0000 7f0aad65d640 1 --2- 172.21.15.33:0/2935251483 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f0a9406b4d0 0x7f0a9406d990 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:48.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:48.779+0000 7f0aad65d640 1 --2- 172.21.15.33:0/2935251483 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0aa81455b0 0x7f0aa8158d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:48.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:48.779+0000 7f0aad65d640 1 --2- 172.21.15.33:0/2935251483 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0aa80cdc70 0x7f0aa80b38a0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:48.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:48.779+0000 7f0aad65d640 1 --2- 172.21.15.33:0/2935251483 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0aa80b4920 0x7f0aa8154a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:48.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:48.779+0000 7f0aad65d640 1 -- 172.21.15.33:0/2935251483 >> 172.21.15.33:0/2935251483 conn(0x7f0aa806aba0 msgr2=0x7f0aa80cfda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:48.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:48.779+0000 7f0aad65d640 1 -- 172.21.15.33:0/2935251483 shutdown_connections 2024-05-08T10:55:48.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:48.779+0000 7f0aad65d640 1 -- 172.21.15.33:0/2935251483 wait complete. 2024-05-08T10:55:48.789 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json perf dump mds_cache 2024-05-08T10:55:48.908 INFO:teuthology.orchestra.run.smithi033.stdout:{"mds_cache":{"dir_update":0,"dir_update_receipt":0,"dir_try_discover":0,"dir_send_discover":0,"dir_handle_discover":0,"num_strays":0,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":2,"strays_enqueued":2,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0}} 2024-05-08T10:55:48.909 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_cache": { "dir_handle_discover": 0, "dir_send_discover": 0, "dir_try_discover": 0, "dir_update": 0, "dir_update_receipt": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 2, "strays_enqueued": 2, "strays_migrated": 0, "strays_reintegrated": 0 } } 2024-05-08T10:55:48.909 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2024-05-08T10:55:48.909 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T10:55:49.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.016+0000 7f38400df640 1 Processor -- start 2024-05-08T10:55:49.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.016+0000 7f38400df640 1 -- start start 2024-05-08T10:55:49.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.017+0000 7f38400df640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f383806ee30 0x7f38380d0b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:49.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.017+0000 7f38400df640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3838162410 0x7f383806e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:49.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.017+0000 7f38400df640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3838162980 con 0x7f383806f210 2024-05-08T10:55:49.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.017+0000 7f38400df640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38380b1250 con 0x7f383806ee30 2024-05-08T10:55:49.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.017+0000 7f38400df640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38380cfd70 con 0x7f3838162410 2024-05-08T10:55:49.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.017+0000 7f383e67c640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f383806f210 0x7f383806bcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:50682/0 (socket says 172.21.15.33:50682) 2024-05-08T10:55:49.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.017+0000 7f383e67c640 1 -- 172.21.15.33:0/2077408122 learned_addr learned my addr 172.21.15.33:0/2077408122 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-05-08T10:55:49.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.017+0000 7f383de7b640 1 --2- 172.21.15.33:0/2077408122 >> v2:172.21.15.174:3300/0 conn(0x7f383806ee30 0x7f38380d0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:49.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.017+0000 7f383d67a640 1 --2- 172.21.15.33:0/2077408122 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3838162410 0x7f383806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:49.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.017+0000 7f383ce79640 1 -- 172.21.15.33:0/2077408122 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3028860630 0 0) 0x7f3838162980 con 0x7f383806f210 2024-05-08T10:55:49.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.017+0000 7f383ce79640 1 -- 172.21.15.33:0/2077408122 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3824003520 con 0x7f383806f210 2024-05-08T10:55:49.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.017+0000 7f383de7b640 1 -- 172.21.15.33:0/2077408122 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3838162410 msgr2=0x7f383806e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:49.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.017+0000 7f383de7b640 1 --2- 172.21.15.33:0/2077408122 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3838162410 0x7f383806e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:49.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.017+0000 7f383de7b640 1 -- 172.21.15.33:0/2077408122 >> v1:172.21.15.33:6789/0 conn(0x7f383806f210 legacy=0x7f383806bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:49.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.017+0000 7f383de7b640 1 -- 172.21.15.33:0/2077408122 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38380d0050 con 0x7f383806ee30 2024-05-08T10:55:49.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.018+0000 7f383de7b640 1 --2- 172.21.15.33:0/2077408122 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f383806ee30 0x7f38380d0b30 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f38340097a0 tx=0x7f383402a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e8f384bff357a8e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:49.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.018+0000 7f383ce79640 1 -- 172.21.15.33:0/2077408122 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3834037070 con 0x7f383806ee30 2024-05-08T10:55:49.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.018+0000 7f383ce79640 1 -- 172.21.15.33:0/2077408122 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3834032440 con 0x7f383806ee30 2024-05-08T10:55:49.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.018+0000 7f383ce79640 1 -- 172.21.15.33:0/2077408122 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38340327f0 con 0x7f383806ee30 2024-05-08T10:55:49.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.019+0000 7f38400df640 1 -- 172.21.15.33:0/2077408122 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f383806ee30 msgr2=0x7f38380d0b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:49.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.019+0000 7f38400df640 1 --2- 172.21.15.33:0/2077408122 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f383806ee30 0x7f38380d0b30 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f38340097a0 tx=0x7f383402a180 comp rx=0 tx=0).stop 2024-05-08T10:55:49.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.019+0000 7f38400df640 1 -- 172.21.15.33:0/2077408122 shutdown_connections 2024-05-08T10:55:49.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.019+0000 7f38400df640 1 --2- 172.21.15.33:0/2077408122 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3838162410 0x7f383806e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:49.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.019+0000 7f38400df640 1 --2- 172.21.15.33:0/2077408122 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f383806ee30 0x7f38380d0b30 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:49.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.019+0000 7f38400df640 1 -- 172.21.15.33:0/2077408122 >> 172.21.15.33:0/2077408122 conn(0x7f38380d1990 msgr2=0x7f38380d1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:49.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.019+0000 7f38400df640 1 -- 172.21.15.33:0/2077408122 shutdown_connections 2024-05-08T10:55:49.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.019+0000 7f38400df640 1 -- 172.21.15.33:0/2077408122 wait complete. 2024-05-08T10:55:49.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.020+0000 7f38400df640 1 Processor -- start 2024-05-08T10:55:49.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.020+0000 7f38400df640 1 -- start start 2024-05-08T10:55:49.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.021+0000 7f38400df640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f383806ee30 0x7f38380b6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:49.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.021+0000 7f38400df640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f383806f210 0x7f383815d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:49.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.021+0000 7f38400df640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3838162410 0x7f383814ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:49.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.021+0000 7f38400df640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f383806f6a0 con 0x7f383806ee30 2024-05-08T10:55:49.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.021+0000 7f38400df640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38380d0610 con 0x7f3838162410 2024-05-08T10:55:49.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.021+0000 7f38400df640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f383815f220 con 0x7f383806f210 2024-05-08T10:55:49.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.021+0000 7f383de7b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f383806ee30 0x7f38380b6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:49.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.021+0000 7f383de7b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f383806ee30 0x7f38380b6aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37076/0 (socket says 172.21.15.33:37076) 2024-05-08T10:55:49.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.021+0000 7f383de7b640 1 -- 172.21.15.33:0/1153716035 learned_addr learned my addr 172.21.15.33:0/1153716035 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:49.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.021+0000 7f383e67c640 1 --2- 172.21.15.33:0/1153716035 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3838162410 0x7f383814ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:49.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.021+0000 7f383de7b640 1 -- 172.21.15.33:0/1153716035 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f383806f210 msgr2=0x7f383815d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:49.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.021+0000 7f383de7b640 1 --2- 172.21.15.33:0/1153716035 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f383806f210 0x7f383815d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:49.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.021+0000 7f383de7b640 1 -- 172.21.15.33:0/1153716035 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3838162410 msgr2=0x7f383814ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:49.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.021+0000 7f383de7b640 1 --2- 172.21.15.33:0/1153716035 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3838162410 0x7f383814ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:49.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.021+0000 7f383de7b640 1 -- 172.21.15.33:0/1153716035 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f383815d7f0 con 0x7f383806ee30 2024-05-08T10:55:49.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.022+0000 7f383de7b640 1 --2- 172.21.15.33:0/1153716035 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f383806ee30 0x7f38380b6aa0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f383402a1c0 tx=0x7f38340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:49.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.022+0000 7f382e7fc640 1 -- 172.21.15.33:0/1153716035 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3834037050 con 0x7f383806ee30 2024-05-08T10:55:49.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.022+0000 7f382e7fc640 1 -- 172.21.15.33:0/1153716035 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3834043070 con 0x7f383806ee30 2024-05-08T10:55:49.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.022+0000 7f38400df640 1 -- 172.21.15.33:0/1153716035 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38380b7210 con 0x7f383806ee30 2024-05-08T10:55:49.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.022+0000 7f382e7fc640 1 -- 172.21.15.33:0/1153716035 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3834006e10 con 0x7f383806ee30 2024-05-08T10:55:49.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.022+0000 7f38400df640 1 -- 172.21.15.33:0/1153716035 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f383815a370 con 0x7f383806ee30 2024-05-08T10:55:49.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.023+0000 7f38400df640 1 -- 172.21.15.33:0/1153716035 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3838069d20 con 0x7f383806ee30 2024-05-08T10:55:49.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.023+0000 7f382e7fc640 1 -- 172.21.15.33:0/1153716035 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3834032a30 con 0x7f383806ee30 2024-05-08T10:55:49.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.024+0000 7f382e7fc640 1 --2- 172.21.15.33:0/1153716035 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f381c06b4d0 0x7f381c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:49.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.024+0000 7f382e7fc640 1 -- 172.21.15.33:0/1153716035 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f38340ab0c0 con 0x7f383806ee30 2024-05-08T10:55:49.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.024+0000 7f383d67a640 1 --2- 172.21.15.33:0/1153716035 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f381c06b4d0 0x7f381c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:49.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.024+0000 7f383d67a640 1 --2- 172.21.15.33:0/1153716035 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f381c06b4d0 0x7f381c06d990 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3828006a90 tx=0x7f3828006a20 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:49.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.028+0000 7f382e7fc640 1 -- 172.21.15.33:0/1153716035 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3834079fc0 con 0x7f383806ee30 2024-05-08T10:55:49.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.249+0000 7f38400df640 1 -- 172.21.15.33:0/1153716035 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3838068170 con 0x7f383806ee30 2024-05-08T10:55:49.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.249+0000 7f382e7fc640 1 -- 172.21.15.33:0/1153716035 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4941 (secure 0 0 0) 0x7f38340798c0 con 0x7f383806ee30 2024-05-08T10:55:49.247 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:55:49.247 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4592,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6836/2731663891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2731663891},{"type":"v1","addr":"172.21.15.174:6836","nonce":2731663891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":4598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/2004985147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6833","nonce":2004985147},{"type":"v1","addr":"172.21.15.33:6835","nonce":2004985147}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4702,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6837/3164144740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6835","nonce":3164144740},{"type":"v1","addr":"172.21.15.174:6837","nonce":3164144740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T10:55:31.311811+0000","modified":"2024-05-08T10:55:33.333600+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4708},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4708":{"gid":4708,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.33:6834/415400390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":415400390},{"type":"v1","addr":"172.21.15.33:6834","nonce":415400390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-05-08T10:55:49.247 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 14 2024-05-08T10:55:49.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.251+0000 7f38400df640 1 -- 172.21.15.33:0/1153716035 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f381c06b4d0 msgr2=0x7f381c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:49.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.251+0000 7f38400df640 1 --2- 172.21.15.33:0/1153716035 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f381c06b4d0 0x7f381c06d990 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3828006a90 tx=0x7f3828006a20 comp rx=0 tx=0).stop 2024-05-08T10:55:49.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.251+0000 7f38400df640 1 -- 172.21.15.33:0/1153716035 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f383806ee30 msgr2=0x7f38380b6aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:49.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.251+0000 7f38400df640 1 --2- 172.21.15.33:0/1153716035 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f383806ee30 0x7f38380b6aa0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f383402a1c0 tx=0x7f38340046c0 comp rx=0 tx=0).stop 2024-05-08T10:55:49.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.251+0000 7f38400df640 1 -- 172.21.15.33:0/1153716035 shutdown_connections 2024-05-08T10:55:49.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.251+0000 7f38400df640 1 --2- 172.21.15.33:0/1153716035 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f381c06b4d0 0x7f381c06d990 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:49.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.251+0000 7f38400df640 1 --2- 172.21.15.33:0/1153716035 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3838162410 0x7f383814ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:49.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.251+0000 7f38400df640 1 --2- 172.21.15.33:0/1153716035 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f383806f210 0x7f383815d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:49.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.251+0000 7f38400df640 1 --2- 172.21.15.33:0/1153716035 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f383806ee30 0x7f38380b6aa0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:49.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.251+0000 7f38400df640 1 -- 172.21.15.33:0/1153716035 >> 172.21.15.33:0/1153716035 conn(0x7f38380d1990 msgr2=0x7f383806c5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:49.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.251+0000 7f38400df640 1 -- 172.21.15.33:0/1153716035 shutdown_connections 2024-05-08T10:55:49.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.251+0000 7f38400df640 1 -- 172.21.15.33:0/1153716035 wait complete. 2024-05-08T10:55:49.260 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json perf dump objecter 2024-05-08T10:55:49.379 INFO:teuthology.orchestra.run.smithi033.stdout:{"objecter":{"op_active":0,"op_laggy":0,"op_send":595,"op_send_bytes":45095,"op_resend":37,"op_reply":595,"op_latency":{"avgcount":595,"sum":13.586780457,"avgtime":0.022834925},"op_inflight":0,"oplen_avg":{"avgcount":595,"sum":647},"op":595,"op_r":1,"op_w":594,"op_rmw":0,"op_pg":0,"osdop_stat":5,"osdop_create":17,"osdop_read":1,"osdop_write":15,"osdop_writefull":20,"osdop_writesame":0,"osdop_append":0,"osdop_zero":0,"osdop_truncate":0,"osdop_delete":514,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":0,"osdop_setxattr":34,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":31,"map_full":0,"map_inc":1,"osd_sessions":8,"osd_session_open":8,"osd_session_close":0,"osd_laggy":0,"omap_wr":36,"omap_rd":0,"omap_del":5}} 2024-05-08T10:55:49.379 DEBUG:tasks.cephfs.filesystem:_json_asok output { "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 31, "map_full": 0, "map_inc": 1, "omap_del": 5, "omap_rd": 0, "omap_wr": 36, "op": 595, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 595, "avgtime": 0.022834925, "sum": 13.586780457 }, "op_pg": 0, "op_r": 1, "op_reply": 595, "op_resend": 37, "op_rmw": 0, "op_send": 595, "op_send_bytes": 45095, "op_w": 594, "oplen_avg": { "avgcount": 595, "sum": 647 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 8, "osd_sessions": 8, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 17, "osdop_delete": 514, "osdop_getxattr": 0, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 1, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 34, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 5, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 15, "osdop_writefull": 20, "osdop_writesame": 0, "osdop_zero": 0, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 } } 2024-05-08T10:55:49.379 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-05-08T10:55:49.380 DEBUG:teuthology.orchestra.run.smithi033:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata listomapkeys 10000000000.00000000 2024-05-08T10:55:49.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.426+0000 7fb8a580bf40 1 Processor -- start 2024-05-08T10:55:49.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.426+0000 7fb8a580bf40 1 -- start start 2024-05-08T10:55:49.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.427+0000 7fb8a580bf40 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x561369e0ad90 0x561369ede760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:49.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.427+0000 7fb8a580bf40 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561369e36890 0x561369edb1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:49.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.427+0000 7fb8a580bf40 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561369edfb50 0x561369e51e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:49.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.427+0000 7fb8a580bf40 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x561369e09e70 con 0x561369edfb50 2024-05-08T10:55:49.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.427+0000 7fb8a580bf40 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x561369db1b70 con 0x561369e36890 2024-05-08T10:55:49.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.427+0000 7fb8a580bf40 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x561369e0a110 con 0x561369e0ad90 2024-05-08T10:55:49.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.427+0000 7fb8a2dff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561369edfb50 0x561369e51e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:49.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.427+0000 7fb8a2dff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561369edfb50 0x561369e51e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37094/0 (socket says 172.21.15.33:37094) 2024-05-08T10:55:49.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.427+0000 7fb8a2dff640 1 -- 172.21.15.33:0/1714098494 learned_addr learned my addr 172.21.15.33:0/1714098494 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:49.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.427+0000 7fb8a1dfd640 1 --2- 172.21.15.33:0/1714098494 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561369e36890 0x561369edb1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:49.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.427+0000 7fb8a2dff640 1 -- 172.21.15.33:0/1714098494 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x561369e0ad90 msgr2=0x561369ede760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:49.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.427+0000 7fb8a2dff640 1 --2- 172.21.15.33:0/1714098494 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x561369e0ad90 0x561369ede760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:49.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.427+0000 7fb8a2dff640 1 -- 172.21.15.33:0/1714098494 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561369e36890 msgr2=0x561369edb1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:49.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.427+0000 7fb8a2dff640 1 --2- 172.21.15.33:0/1714098494 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561369e36890 0x561369edb1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:49.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.427+0000 7fb8a2dff640 1 -- 172.21.15.33:0/1714098494 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561369ec5e60 con 0x561369edfb50 2024-05-08T10:55:49.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.427+0000 7fb8a1dfd640 1 --2- 172.21.15.33:0/1714098494 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561369e36890 0x561369edb1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:55:49.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.428+0000 7fb8a2dff640 1 --2- 172.21.15.33:0/1714098494 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561369edfb50 0x561369e51e00 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fb894025c30 tx=0x7fb894051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90cf48abee1d65cd server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:49.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.428+0000 7fb8a0dfb640 1 -- 172.21.15.33:0/1714098494 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb89405a070 con 0x561369edfb50 2024-05-08T10:55:49.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.428+0000 7fb8a0dfb640 1 -- 172.21.15.33:0/1714098494 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb894064070 con 0x561369edfb50 2024-05-08T10:55:49.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.428+0000 7fb8a0dfb640 1 -- 172.21.15.33:0/1714098494 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb894055cf0 con 0x561369edfb50 2024-05-08T10:55:49.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.428+0000 7fb8a580bf40 1 -- 172.21.15.33:0/1714098494 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561369edfb50 msgr2=0x561369e51e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:49.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.428+0000 7fb8a580bf40 1 --2- 172.21.15.33:0/1714098494 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561369edfb50 0x561369e51e00 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fb894025c30 tx=0x7fb894051000 comp rx=0 tx=0).stop 2024-05-08T10:55:49.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.428+0000 7fb8a580bf40 1 -- 172.21.15.33:0/1714098494 shutdown_connections 2024-05-08T10:55:49.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.428+0000 7fb8a580bf40 1 --2- 172.21.15.33:0/1714098494 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561369edfb50 0x561369e51e00 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:49.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.428+0000 7fb8a580bf40 1 --2- 172.21.15.33:0/1714098494 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561369e36890 0x561369edb1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:49.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.428+0000 7fb8a580bf40 1 --2- 172.21.15.33:0/1714098494 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x561369e0ad90 0x561369ede760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:49.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.428+0000 7fb8a580bf40 1 -- 172.21.15.33:0/1714098494 >> 172.21.15.33:0/1714098494 conn(0x561369e35d70 msgr2=0x561369edd2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:49.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.428+0000 7fb8a580bf40 1 -- 172.21.15.33:0/1714098494 shutdown_connections 2024-05-08T10:55:49.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.428+0000 7fb8a580bf40 1 -- 172.21.15.33:0/1714098494 wait complete. 2024-05-08T10:55:49.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.429+0000 7fb8a580bf40 1 Processor -- start 2024-05-08T10:55:49.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.429+0000 7fb8a580bf40 1 -- start start 2024-05-08T10:55:49.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.429+0000 7fb8a580bf40 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561369e0ad90 0x561369ec23b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:49.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.430+0000 7fb8a580bf40 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561369e36890 0x561369ebec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:49.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.430+0000 7fb8a580bf40 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x561369edfb50 0x561369ede1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:49.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.430+0000 7fb8a580bf40 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x561369edaa00 con 0x561369e36890 2024-05-08T10:55:49.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.430+0000 7fb8a580bf40 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x561369ed9e30 con 0x561369e0ad90 2024-05-08T10:55:49.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.430+0000 7fb8a580bf40 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x561369eda5a0 con 0x561369edfb50 2024-05-08T10:55:49.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.430+0000 7fb8a1dfd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561369e36890 0x561369ebec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:49.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.430+0000 7fb8a1dfd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561369e36890 0x561369ebec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37104/0 (socket says 172.21.15.33:37104) 2024-05-08T10:55:49.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.430+0000 7fb8a1dfd640 1 -- 172.21.15.33:0/1167488023 learned_addr learned my addr 172.21.15.33:0/1167488023 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:49.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.430+0000 7fb8a25fe640 1 --2- 172.21.15.33:0/1167488023 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561369e0ad90 0x561369ec23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:49.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.430+0000 7fb8a2dff640 1 --2- 172.21.15.33:0/1167488023 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x561369edfb50 0x561369ede1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:49.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.430+0000 7fb8a1dfd640 1 -- 172.21.15.33:0/1167488023 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x561369edfb50 msgr2=0x561369ede1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:49.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.430+0000 7fb8a1dfd640 1 --2- 172.21.15.33:0/1167488023 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x561369edfb50 0x561369ede1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:49.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.430+0000 7fb8a1dfd640 1 -- 172.21.15.33:0/1167488023 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561369e0ad90 msgr2=0x561369ec23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:49.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.430+0000 7fb8a1dfd640 1 --2- 172.21.15.33:0/1167488023 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561369e0ad90 0x561369ec23b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:49.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.430+0000 7fb8a1dfd640 1 -- 172.21.15.33:0/1167488023 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561369edf280 con 0x561369e36890 2024-05-08T10:55:49.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.430+0000 7fb8a1dfd640 1 --2- 172.21.15.33:0/1167488023 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561369e36890 0x561369ebec20 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fb88c00be70 tx=0x7fb88c00bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:49.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.430+0000 7fb89b7fe640 1 -- 172.21.15.33:0/1167488023 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb88c019070 con 0x561369e36890 2024-05-08T10:55:49.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.430+0000 7fb89b7fe640 1 -- 172.21.15.33:0/1167488023 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb88c007b80 con 0x561369e36890 2024-05-08T10:55:49.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.430+0000 7fb89b7fe640 1 -- 172.21.15.33:0/1167488023 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb88c014410 con 0x561369e36890 2024-05-08T10:55:49.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.430+0000 7fb8a580bf40 1 -- 172.21.15.33:0/1167488023 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x561369e54d10 con 0x561369e36890 2024-05-08T10:55:49.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.430+0000 7fb8a580bf40 1 -- 172.21.15.33:0/1167488023 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561369e52280 con 0x561369e36890 2024-05-08T10:55:49.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.432+0000 7fb89b7fe640 1 -- 172.21.15.33:0/1167488023 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb88c01c070 con 0x561369e36890 2024-05-08T10:55:49.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.432+0000 7fb89b7fe640 1 --2- 172.21.15.33:0/1167488023 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fb884069eb0 0x7fb88406c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:49.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.433+0000 7fb89b7fe640 1 -- 172.21.15.33:0/1167488023 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb88c087f10 con 0x561369e36890 2024-05-08T10:55:49.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.433+0000 7fb8a25fe640 1 --2- 172.21.15.33:0/1167488023 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fb884069eb0 0x7fb88406c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:49.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.433+0000 7fb8a580bf40 1 --2- 172.21.15.33:0/1167488023 >> [v2:172.21.15.33:6802/4029047077,v1:172.21.15.33:6804/4029047077] conn(0x561369ec2a30 0x561369ec0a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:49.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.433+0000 7fb8a580bf40 1 -- 172.21.15.33:0/1167488023 --> [v2:172.21.15.33:6802/4029047077,v1:172.21.15.33:6804/4029047077] -- osd_op(unknown.0.0:1 4.10 4:0cf6ad0f:::10000000000.00000000:head [omap-get-keys in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v9 -- 0x561369ec0fc0 con 0x561369ec2a30 2024-05-08T10:55:49.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.433+0000 7fb8a2dff640 1 --2- 172.21.15.33:0/1167488023 >> [v2:172.21.15.33:6802/4029047077,v1:172.21.15.33:6804/4029047077] conn(0x561369ec2a30 0x561369ec0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:49.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.433+0000 7fb8a2dff640 1 --2- 172.21.15.33:0/1167488023 >> [v2:172.21.15.33:6802/4029047077,v1:172.21.15.33:6804/4029047077] conn(0x561369ec2a30 0x561369ec0a80 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:49.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.433+0000 7fb8a25fe640 1 --2- 172.21.15.33:0/1167488023 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fb884069eb0 0x7fb88406c370 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb89c006820 tx=0x7fb89c006790 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:49.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.433+0000 7fb8a2dff640 1 -- 172.21.15.33:0/1167488023 <== osd.3 v2:172.21.15.33:6802/4029047077 1 ==== osd_op_reply(1 10000000000.00000000 [omap-get-keys] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x7fb89405d070 con 0x561369ec2a30 2024-05-08T10:55:49.434 INFO:teuthology.orchestra.run.smithi033.stderr:error getting omap key set cephfs_metadata/10000000000.00000000: (2) No such file or directory 2024-05-08T10:55:49.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.433+0000 7fb8a580bf40 1 -- 172.21.15.33:0/1167488023 >> [v2:172.21.15.33:6802/4029047077,v1:172.21.15.33:6804/4029047077] conn(0x561369ec2a30 msgr2=0x561369ec0a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:49.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.433+0000 7fb8a580bf40 1 --2- 172.21.15.33:0/1167488023 >> [v2:172.21.15.33:6802/4029047077,v1:172.21.15.33:6804/4029047077] conn(0x561369ec2a30 0x561369ec0a80 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:49.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.433+0000 7fb8a580bf40 1 -- 172.21.15.33:0/1167488023 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fb884069eb0 msgr2=0x7fb88406c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:49.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.434+0000 7fb8a580bf40 1 --2- 172.21.15.33:0/1167488023 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fb884069eb0 0x7fb88406c370 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb89c006820 tx=0x7fb89c006790 comp rx=0 tx=0).stop 2024-05-08T10:55:49.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.434+0000 7fb8a580bf40 1 -- 172.21.15.33:0/1167488023 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561369e36890 msgr2=0x561369ebec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:49.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.434+0000 7fb8a580bf40 1 --2- 172.21.15.33:0/1167488023 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561369e36890 0x561369ebec20 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fb88c00be70 tx=0x7fb88c00bf60 comp rx=0 tx=0).stop 2024-05-08T10:55:49.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.434+0000 7fb8a2dff640 1 -- 172.21.15.33:0/1167488023 reap_dead start 2024-05-08T10:55:49.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.434+0000 7fb8a580bf40 1 -- 172.21.15.33:0/1167488023 shutdown_connections 2024-05-08T10:55:49.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.434+0000 7fb8a580bf40 1 -- 172.21.15.33:0/1167488023 >> 172.21.15.33:0/1167488023 conn(0x561369e35d70 msgr2=0x561369edd220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:49.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.434+0000 7fb8a580bf40 1 -- 172.21.15.33:0/1167488023 shutdown_connections 2024-05-08T10:55:49.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.434+0000 7fb8a580bf40 1 -- 172.21.15.33:0/1167488023 wait complete. 2024-05-08T10:55:49.436 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T10:55:49.436 ERROR:tasks.cephfs.filesystem:Command failed on smithi033 with status 1: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata listomapkeys 10000000000.00000000' 2024-05-08T10:55:49.436 DEBUG:teuthology.orchestra.run.smithi033:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000001.00000000 parent 2024-05-08T10:55:49.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.523+0000 7f8df5904f40 1 Processor -- start 2024-05-08T10:55:49.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.523+0000 7f8df5904f40 1 -- start start 2024-05-08T10:55:49.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.524+0000 7f8df5904f40 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5580104799d0 0x5580104770b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:49.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.524+0000 7f8df5904f40 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5580104a2970 0x55801054bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:49.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.524+0000 7f8df5904f40 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x5580104c0da0 0x558010535750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:49.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.524+0000 7f8df5904f40 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x55801041fb70 con 0x5580104799d0 2024-05-08T10:55:49.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.524+0000 7f8df5904f40 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x558010423ad0 con 0x5580104a2970 2024-05-08T10:55:49.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.524+0000 7f8df5904f40 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x55801054d020 con 0x5580104c0da0 2024-05-08T10:55:49.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.524+0000 7f8df3405640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5580104799d0 0x5580104770b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:49.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.524+0000 7f8df3405640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5580104799d0 0x5580104770b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37122/0 (socket says 172.21.15.33:37122) 2024-05-08T10:55:49.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.524+0000 7f8df3405640 1 -- 172.21.15.33:0/2556185643 learned_addr learned my addr 172.21.15.33:0/2556185643 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:49.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.524+0000 7f8df3405640 1 -- 172.21.15.33:0/2556185643 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x5580104c0da0 msgr2=0x558010535750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:49.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.524+0000 7f8df3405640 1 --2- 172.21.15.33:0/2556185643 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x5580104c0da0 0x558010535750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:49.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.524+0000 7f8df3405640 1 -- 172.21.15.33:0/2556185643 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5580104a2970 msgr2=0x55801054bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:49.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.524+0000 7f8df2c04640 1 --2- 172.21.15.33:0/2556185643 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5580104a2970 0x55801054bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:49.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.524+0000 7f8df3405640 1 --2- 172.21.15.33:0/2556185643 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5580104a2970 0x55801054bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:49.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.524+0000 7f8df3405640 1 -- 172.21.15.33:0/2556185643 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5580105350e0 con 0x5580104799d0 2024-05-08T10:55:49.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.524+0000 7f8df2c04640 1 --2- 172.21.15.33:0/2556185643 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5580104a2970 0x55801054bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:55:49.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.525+0000 7f8df3405640 1 --2- 172.21.15.33:0/2556185643 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5580104799d0 0x5580104770b0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f8de4025b00 tx=0x7f8de4051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93d8567970cb8ed1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:49.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.525+0000 7f8df1c02640 1 -- 172.21.15.33:0/2556185643 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de4067070 con 0x5580104799d0 2024-05-08T10:55:49.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.525+0000 7f8df1c02640 1 -- 172.21.15.33:0/2556185643 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8de4050b60 con 0x5580104799d0 2024-05-08T10:55:49.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.525+0000 7f8df1c02640 1 -- 172.21.15.33:0/2556185643 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de4058400 con 0x5580104799d0 2024-05-08T10:55:49.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.525+0000 7f8df5904f40 1 -- 172.21.15.33:0/2556185643 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5580104799d0 msgr2=0x5580104770b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:49.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.525+0000 7f8df5904f40 1 --2- 172.21.15.33:0/2556185643 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5580104799d0 0x5580104770b0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f8de4025b00 tx=0x7f8de4051000 comp rx=0 tx=0).stop 2024-05-08T10:55:49.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.525+0000 7f8df5904f40 1 -- 172.21.15.33:0/2556185643 shutdown_connections 2024-05-08T10:55:49.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.525+0000 7f8df5904f40 1 --2- 172.21.15.33:0/2556185643 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x5580104c0da0 0x558010535750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:49.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.525+0000 7f8df5904f40 1 --2- 172.21.15.33:0/2556185643 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5580104a2970 0x55801054bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:49.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.525+0000 7f8df5904f40 1 --2- 172.21.15.33:0/2556185643 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5580104799d0 0x5580104770b0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:49.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.525+0000 7f8df5904f40 1 -- 172.21.15.33:0/2556185643 >> 172.21.15.33:0/2556185643 conn(0x5580104a3d70 msgr2=0x5580104c0400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:49.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.525+0000 7f8df5904f40 1 -- 172.21.15.33:0/2556185643 shutdown_connections 2024-05-08T10:55:49.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.525+0000 7f8df5904f40 1 -- 172.21.15.33:0/2556185643 wait complete. 2024-05-08T10:55:49.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.526+0000 7f8df5904f40 1 Processor -- start 2024-05-08T10:55:49.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.526+0000 7f8df5904f40 1 -- start start 2024-05-08T10:55:49.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.527+0000 7f8df5904f40 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x5580104799d0 0x558010530de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:49.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.527+0000 7f8df5904f40 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5580104a2970 0x558010537da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:49.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.527+0000 7f8df5904f40 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5580104c0da0 0x558010531b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:49.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.527+0000 7f8df5904f40 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580104c2590 con 0x5580104a2970 2024-05-08T10:55:49.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.527+0000 7f8df5904f40 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x558010548b10 con 0x5580104c0da0 2024-05-08T10:55:49.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.527+0000 7f8df5904f40 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x558010537320 con 0x5580104799d0 2024-05-08T10:55:49.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.527+0000 7f8df2c04640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5580104a2970 0x558010537da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:49.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.527+0000 7f8df2c04640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5580104a2970 0x558010537da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37124/0 (socket says 172.21.15.33:37124) 2024-05-08T10:55:49.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.527+0000 7f8df2c04640 1 -- 172.21.15.33:0/1698356077 learned_addr learned my addr 172.21.15.33:0/1698356077 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:49.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.527+0000 7f8df3405640 1 --2- 172.21.15.33:0/1698356077 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x5580104799d0 0x558010530de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:49.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.527+0000 7f8df3c06640 1 --2- 172.21.15.33:0/1698356077 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5580104c0da0 0x558010531b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:49.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.527+0000 7f8df2c04640 1 -- 172.21.15.33:0/1698356077 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x5580104799d0 msgr2=0x558010530de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:49.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.527+0000 7f8df2c04640 1 --2- 172.21.15.33:0/1698356077 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x5580104799d0 0x558010530de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:49.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.527+0000 7f8df2c04640 1 -- 172.21.15.33:0/1698356077 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5580104c0da0 msgr2=0x558010531b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:49.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.527+0000 7f8df2c04640 1 --2- 172.21.15.33:0/1698356077 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5580104c0da0 0x558010531b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:49.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.527+0000 7f8df2c04640 1 -- 172.21.15.33:0/1698356077 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558010534a10 con 0x5580104a2970 2024-05-08T10:55:49.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.527+0000 7f8df2c04640 1 --2- 172.21.15.33:0/1698356077 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5580104a2970 0x558010537da0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc00cf40 tx=0x7f8ddc00a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:49.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.527+0000 7f8df0c00640 1 -- 172.21.15.33:0/1698356077 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ddc014070 con 0x5580104a2970 2024-05-08T10:55:49.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.527+0000 7f8df0c00640 1 -- 172.21.15.33:0/1698356077 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ddc00ae30 con 0x5580104a2970 2024-05-08T10:55:49.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.527+0000 7f8df5904f40 1 -- 172.21.15.33:0/1698356077 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558010534cd0 con 0x5580104a2970 2024-05-08T10:55:49.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.527+0000 7f8df0c00640 1 -- 172.21.15.33:0/1698356077 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ddc010880 con 0x5580104a2970 2024-05-08T10:55:49.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.528+0000 7f8df5904f40 1 -- 172.21.15.33:0/1698356077 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5580105378a0 con 0x5580104a2970 2024-05-08T10:55:49.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.529+0000 7f8df0c00640 1 -- 172.21.15.33:0/1698356077 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8ddc00e040 con 0x5580104a2970 2024-05-08T10:55:49.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.529+0000 7f8df0c00640 1 --2- 172.21.15.33:0/1698356077 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f8dd4069ee0 0x7f8dd406c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:49.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.530+0000 7f8df0c00640 1 -- 172.21.15.33:0/1698356077 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8ddc088b70 con 0x5580104a2970 2024-05-08T10:55:49.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.530+0000 7f8df5904f40 1 --2- 172.21.15.33:0/1698356077 >> [v2:172.21.15.174:6824/1511860729,v1:172.21.15.174:6825/1511860729] conn(0x5580105320b0 0x5580105de410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:49.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.530+0000 7f8df5904f40 1 -- 172.21.15.33:0/1698356077 --> [v2:172.21.15.174:6824/1511860729,v1:172.21.15.174:6825/1511860729] -- osd_op(unknown.0.0:1 5.7 5:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v9 -- 0x5580105de950 con 0x5580105320b0 2024-05-08T10:55:49.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.530+0000 7f8df3405640 1 --2- 172.21.15.33:0/1698356077 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f8dd4069ee0 0x7f8dd406c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:49.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.530+0000 7f8df3c06640 1 --2- 172.21.15.33:0/1698356077 >> [v2:172.21.15.174:6824/1511860729,v1:172.21.15.174:6825/1511860729] conn(0x5580105320b0 0x5580105de410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:49.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.530+0000 7f8df3405640 1 --2- 172.21.15.33:0/1698356077 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f8dd4069ee0 0x7f8dd406c3a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f8de4005fd0 tx=0x7f8de4052000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:49.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.530+0000 7f8df3c06640 1 --2- 172.21.15.33:0/1698356077 >> [v2:172.21.15.174:6824/1511860729,v1:172.21.15.174:6825/1511860729] conn(0x5580105320b0 0x5580105de410 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:49.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.531+0000 7f8df3c06640 1 -- 172.21.15.33:0/1698356077 <== osd.5 v2:172.21.15.174:6824/1511860729 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x7f8dec00e500 con 0x5580105320b0 2024-05-08T10:55:49.531 INFO:teuthology.orchestra.run.smithi033.stderr:error getting xattr cephfs_data/10000000001.00000000/parent: (2) No such file or directory 2024-05-08T10:55:49.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.531+0000 7f8df5904f40 1 -- 172.21.15.33:0/1698356077 >> [v2:172.21.15.174:6824/1511860729,v1:172.21.15.174:6825/1511860729] conn(0x5580105320b0 msgr2=0x5580105de410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:49.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.531+0000 7f8df5904f40 1 --2- 172.21.15.33:0/1698356077 >> [v2:172.21.15.174:6824/1511860729,v1:172.21.15.174:6825/1511860729] conn(0x5580105320b0 0x5580105de410 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:49.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.531+0000 7f8df5904f40 1 -- 172.21.15.33:0/1698356077 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f8dd4069ee0 msgr2=0x7f8dd406c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:49.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.531+0000 7f8df5904f40 1 --2- 172.21.15.33:0/1698356077 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f8dd4069ee0 0x7f8dd406c3a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f8de4005fd0 tx=0x7f8de4052000 comp rx=0 tx=0).stop 2024-05-08T10:55:49.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.531+0000 7f8df5904f40 1 -- 172.21.15.33:0/1698356077 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5580104a2970 msgr2=0x558010537da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:49.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.531+0000 7f8df5904f40 1 --2- 172.21.15.33:0/1698356077 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5580104a2970 0x558010537da0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc00cf40 tx=0x7f8ddc00a660 comp rx=0 tx=0).stop 2024-05-08T10:55:49.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.531+0000 7f8df3c06640 1 -- 172.21.15.33:0/1698356077 reap_dead start 2024-05-08T10:55:49.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.531+0000 7f8df5904f40 1 -- 172.21.15.33:0/1698356077 shutdown_connections 2024-05-08T10:55:49.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.531+0000 7f8df5904f40 1 -- 172.21.15.33:0/1698356077 >> 172.21.15.33:0/1698356077 conn(0x5580104a3d70 msgr2=0x5580104bfb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:49.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.531+0000 7f8df5904f40 1 -- 172.21.15.33:0/1698356077 shutdown_connections 2024-05-08T10:55:49.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.531+0000 7f8df5904f40 1 -- 172.21.15.33:0/1698356077 wait complete. 2024-05-08T10:55:49.533 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T10:55:49.533 ERROR:tasks.cephfs.filesystem:Command failed on smithi033 with status 1: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000001.00000000 parent' 2024-05-08T10:55:49.533 DEBUG:teuthology.orchestra.run.smithi033:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata listomapkeys 1.00000000 2024-05-08T10:55:49.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.620+0000 7f6434ffef40 1 Processor -- start 2024-05-08T10:55:49.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.620+0000 7f6434ffef40 1 -- start start 2024-05-08T10:55:49.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.621+0000 7f6434ffef40 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x557ec36279d0 0x557ec36e1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:49.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.621+0000 7f6434ffef40 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557ec3650970 0x557ec3624e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:49.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.621+0000 7f6434ffef40 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557ec366eda0 0x557ec3625370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:49.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.621+0000 7f6434ffef40 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ec36fb020 con 0x557ec3650970 2024-05-08T10:55:49.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.621+0000 7f6434ffef40 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ec35cdb70 con 0x557ec366eda0 2024-05-08T10:55:49.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.621+0000 7f6434ffef40 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x557ec3670ad0 con 0x557ec36279d0 2024-05-08T10:55:49.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.621+0000 7f642bfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557ec3650970 0x557ec3624e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:49.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.621+0000 7f642bfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557ec3650970 0x557ec3624e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37142/0 (socket says 172.21.15.33:37142) 2024-05-08T10:55:49.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.621+0000 7f642bfff640 1 -- 172.21.15.33:0/2233384606 learned_addr learned my addr 172.21.15.33:0/2233384606 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:49.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.621+0000 7f642bfff640 1 -- 172.21.15.33:0/2233384606 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x557ec36279d0 msgr2=0x557ec36e1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:49.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.621+0000 7f642bfff640 1 --2- 172.21.15.33:0/2233384606 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x557ec36279d0 0x557ec36e1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:49.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.621+0000 7f642bfff640 1 -- 172.21.15.33:0/2233384606 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557ec366eda0 msgr2=0x557ec3625370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:49.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.621+0000 7f6433302640 1 --2- 172.21.15.33:0/2233384606 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557ec366eda0 0x557ec3625370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:49.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.621+0000 7f642bfff640 1 --2- 172.21.15.33:0/2233384606 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557ec366eda0 0x557ec3625370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:49.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.621+0000 7f642bfff640 1 -- 172.21.15.33:0/2233384606 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557ec3655be0 con 0x557ec3650970 2024-05-08T10:55:49.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.621+0000 7f6433302640 1 --2- 172.21.15.33:0/2233384606 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557ec366eda0 0x557ec3625370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:55:49.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.622+0000 7f642bfff640 1 --2- 172.21.15.33:0/2233384606 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557ec3650970 0x557ec3624e30 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f641c009570 tx=0x7f641c009a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b802e53bac26c149 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:49.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.622+0000 7f6431aff640 1 -- 172.21.15.33:0/2233384606 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f641c017070 con 0x557ec3650970 2024-05-08T10:55:49.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.622+0000 7f6431aff640 1 -- 172.21.15.33:0/2233384606 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f641c006600 con 0x557ec3650970 2024-05-08T10:55:49.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.622+0000 7f6431aff640 1 -- 172.21.15.33:0/2233384606 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f641c0069f0 con 0x557ec3650970 2024-05-08T10:55:49.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.622+0000 7f6434ffef40 1 -- 172.21.15.33:0/2233384606 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557ec3650970 msgr2=0x557ec3624e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:49.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.622+0000 7f6434ffef40 1 --2- 172.21.15.33:0/2233384606 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557ec3650970 0x557ec3624e30 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f641c009570 tx=0x7f641c009a30 comp rx=0 tx=0).stop 2024-05-08T10:55:49.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.622+0000 7f6434ffef40 1 -- 172.21.15.33:0/2233384606 shutdown_connections 2024-05-08T10:55:49.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.622+0000 7f6434ffef40 1 --2- 172.21.15.33:0/2233384606 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557ec366eda0 0x557ec3625370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:49.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.622+0000 7f6434ffef40 1 --2- 172.21.15.33:0/2233384606 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557ec3650970 0x557ec3624e30 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:49.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.622+0000 7f6434ffef40 1 --2- 172.21.15.33:0/2233384606 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x557ec36279d0 0x557ec36e1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:49.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.622+0000 7f6434ffef40 1 -- 172.21.15.33:0/2233384606 >> 172.21.15.33:0/2233384606 conn(0x557ec3651d70 msgr2=0x557ec36554d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:49.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.622+0000 7f6434ffef40 1 -- 172.21.15.33:0/2233384606 shutdown_connections 2024-05-08T10:55:49.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.622+0000 7f6434ffef40 1 -- 172.21.15.33:0/2233384606 wait complete. 2024-05-08T10:55:49.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.623+0000 7f6434ffef40 1 Processor -- start 2024-05-08T10:55:49.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.623+0000 7f6434ffef40 1 -- start start 2024-05-08T10:55:49.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.624+0000 7f6434ffef40 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557ec36279d0 0x557ec36fa440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:49.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.624+0000 7f6434ffef40 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x557ec3650970 0x557ec36d8920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:49.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.624+0000 7f6434ffef40 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557ec366eda0 0x557ec36e01f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:49.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.624+0000 7f6434ffef40 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ec36f7140 con 0x557ec36279d0 2024-05-08T10:55:49.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.624+0000 7f6434ffef40 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ec366e7b0 con 0x557ec366eda0 2024-05-08T10:55:49.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.624+0000 7f6434ffef40 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x557ec36deeb0 con 0x557ec3650970 2024-05-08T10:55:49.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.624+0000 7f6432b01640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557ec36279d0 0x557ec36fa440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:49.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.624+0000 7f6432b01640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557ec36279d0 0x557ec36fa440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37152/0 (socket says 172.21.15.33:37152) 2024-05-08T10:55:49.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.624+0000 7f6432b01640 1 -- 172.21.15.33:0/2772072182 learned_addr learned my addr 172.21.15.33:0/2772072182 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:49.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.624+0000 7f6433302640 1 --2- 172.21.15.33:0/2772072182 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557ec366eda0 0x557ec36e01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:49.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.624+0000 7f642bfff640 1 --2- 172.21.15.33:0/2772072182 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x557ec3650970 0x557ec36d8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:49.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.624+0000 7f6432b01640 1 -- 172.21.15.33:0/2772072182 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x557ec3650970 msgr2=0x557ec36d8920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:49.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.624+0000 7f6432b01640 1 --2- 172.21.15.33:0/2772072182 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x557ec3650970 0x557ec36d8920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:49.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.624+0000 7f6432b01640 1 -- 172.21.15.33:0/2772072182 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557ec366eda0 msgr2=0x557ec36e01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:49.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.624+0000 7f6432b01640 1 --2- 172.21.15.33:0/2772072182 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557ec366eda0 0x557ec36e01f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:49.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.624+0000 7f6432b01640 1 -- 172.21.15.33:0/2772072182 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557ec3666430 con 0x557ec36279d0 2024-05-08T10:55:49.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.624+0000 7f6432b01640 1 --2- 172.21.15.33:0/2772072182 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557ec36279d0 0x557ec36fa440 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f642400bdb0 tx=0x7f6424009560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:49.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.624+0000 7f6430afd640 1 -- 172.21.15.33:0/2772072182 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6424008070 con 0x557ec36279d0 2024-05-08T10:55:49.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.624+0000 7f6430afd640 1 -- 172.21.15.33:0/2772072182 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f642400f650 con 0x557ec36279d0 2024-05-08T10:55:49.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.624+0000 7f6434ffef40 1 -- 172.21.15.33:0/2772072182 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557ec3666710 con 0x557ec36279d0 2024-05-08T10:55:49.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.624+0000 7f6430afd640 1 -- 172.21.15.33:0/2772072182 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f642400fa40 con 0x557ec36279d0 2024-05-08T10:55:49.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.624+0000 7f6434ffef40 1 -- 172.21.15.33:0/2772072182 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557ec36de6b0 con 0x557ec36279d0 2024-05-08T10:55:49.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.626+0000 7f6430afd640 1 -- 172.21.15.33:0/2772072182 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f642400fbe0 con 0x557ec36279d0 2024-05-08T10:55:49.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.626+0000 7f6430afd640 1 --2- 172.21.15.33:0/2772072182 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f6414069ee0 0x7f641406c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:49.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.626+0000 7f6430afd640 1 -- 172.21.15.33:0/2772072182 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6424088db0 con 0x557ec36279d0 2024-05-08T10:55:49.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.626+0000 7f642bfff640 1 --2- 172.21.15.33:0/2772072182 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f6414069ee0 0x7f641406c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:49.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.626+0000 7f6434ffef40 1 --2- 172.21.15.33:0/2772072182 >> [v2:172.21.15.174:6816/2326407945,v1:172.21.15.174:6817/2326407945] conn(0x557ec3667eb0 0x557ec3668290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:49.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.627+0000 7f6434ffef40 1 -- 172.21.15.33:0/2772072182 --> [v2:172.21.15.174:6816/2326407945,v1:172.21.15.174:6817/2326407945] -- osd_op(unknown.0.0:1 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-keys in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v9 -- 0x557ec36d8e60 con 0x557ec3667eb0 2024-05-08T10:55:49.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.627+0000 7f6433302640 1 --2- 172.21.15.33:0/2772072182 >> [v2:172.21.15.174:6816/2326407945,v1:172.21.15.174:6817/2326407945] conn(0x557ec3667eb0 0x557ec3668290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:49.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.627+0000 7f642bfff640 1 --2- 172.21.15.33:0/2772072182 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f6414069ee0 0x7f641406c3a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f641c009a70 tx=0x7f641c00f000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:49.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.627+0000 7f6433302640 1 --2- 172.21.15.33:0/2772072182 >> [v2:172.21.15.174:6816/2326407945,v1:172.21.15.174:6817/2326407945] conn(0x557ec3667eb0 0x557ec3668290 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:49.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.628+0000 7f6433302640 1 -- 172.21.15.33:0/2772072182 <== osd.6 v2:172.21.15.174:6816/2326407945 1 ==== osd_op_reply(1 1.00000000 [omap-get-keys out=5b] v0'0 uv8 ondisk = 0) v8 ==== 154+0+5 (crc 0 0 0) 0x7f642c04e040 con 0x557ec3667eb0 2024-05-08T10:55:49.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.628+0000 7f6434ffef40 1 -- 172.21.15.33:0/2772072182 >> [v2:172.21.15.174:6816/2326407945,v1:172.21.15.174:6817/2326407945] conn(0x557ec3667eb0 msgr2=0x557ec3668290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:49.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.628+0000 7f6434ffef40 1 --2- 172.21.15.33:0/2772072182 >> [v2:172.21.15.174:6816/2326407945,v1:172.21.15.174:6817/2326407945] conn(0x557ec3667eb0 0x557ec3668290 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:49.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.628+0000 7f6434ffef40 1 -- 172.21.15.33:0/2772072182 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f6414069ee0 msgr2=0x7f641406c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:49.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.628+0000 7f6434ffef40 1 --2- 172.21.15.33:0/2772072182 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f6414069ee0 0x7f641406c3a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f641c009a70 tx=0x7f641c00f000 comp rx=0 tx=0).stop 2024-05-08T10:55:49.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.628+0000 7f6434ffef40 1 -- 172.21.15.33:0/2772072182 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557ec36279d0 msgr2=0x557ec36fa440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:49.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.628+0000 7f6434ffef40 1 --2- 172.21.15.33:0/2772072182 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557ec36279d0 0x557ec36fa440 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f642400bdb0 tx=0x7f6424009560 comp rx=0 tx=0).stop 2024-05-08T10:55:49.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.628+0000 7f6433302640 1 -- 172.21.15.33:0/2772072182 reap_dead start 2024-05-08T10:55:49.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.628+0000 7f6434ffef40 1 -- 172.21.15.33:0/2772072182 shutdown_connections 2024-05-08T10:55:49.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.628+0000 7f6434ffef40 1 -- 172.21.15.33:0/2772072182 >> 172.21.15.33:0/2772072182 conn(0x557ec3651d70 msgr2=0x557ec366db70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:49.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.628+0000 7f6434ffef40 1 -- 172.21.15.33:0/2772072182 shutdown_connections 2024-05-08T10:55:49.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.628+0000 7f6434ffef40 1 -- 172.21.15.33:0/2772072182 wait complete. 2024-05-08T10:55:49.630 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-05-08T10:55:49.630 DEBUG:teuthology.orchestra.run.smithi033:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-08T10:55:49.708 DEBUG:teuthology.orchestra.run.smithi174:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-08T10:55:49.767 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-05-08T10:55:49.767 INFO:tasks.cephfs.mount:Terminating background process 2024-05-08T10:55:49.767 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-05-08T10:55:49.767 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T10:55:49.783 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-05-08T10:55:49.784 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T10:55:49.840 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-08T10:55:49.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.988+0000 7f1917e38640 1 Processor -- start 2024-05-08T10:55:49.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.988+0000 7f1917e38640 1 -- start start 2024-05-08T10:55:49.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.989+0000 7f1917e38640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f191015e400 0x7f19100b4770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:49.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.989+0000 7f1917e38640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19100d4730 con 0x7f19100d0b70 2024-05-08T10:55:49.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.989+0000 7f1917e38640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19100d1d20 con 0x7f191015e020 2024-05-08T10:55:49.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.989+0000 7f1917e38640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19100ceac0 con 0x7f191015e400 2024-05-08T10:55:49.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.989+0000 7f19163d5640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f19100d0b70 0x7f19100cefe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:50704/0 (socket says 172.21.15.33:50704) 2024-05-08T10:55:49.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.989+0000 7f19163d5640 1 -- 172.21.15.33:0/3008259096 learned_addr learned my addr 172.21.15.33:0/3008259096 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-05-08T10:55:49.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.989+0000 7f19153d3640 1 --2- 172.21.15.33:0/3008259096 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f191015e400 0x7f19100b4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:49.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.989+0000 7f1914bd2640 1 -- 172.21.15.33:0/3008259096 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3906050808 0 0) 0x7f19100d4730 con 0x7f19100d0b70 2024-05-08T10:55:49.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.989+0000 7f1914bd2640 1 -- 172.21.15.33:0/3008259096 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18fc003520 con 0x7f19100d0b70 2024-05-08T10:55:49.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.989+0000 7f1914bd2640 1 -- 172.21.15.33:0/3008259096 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 82029293 0 0) 0x7f19100d1d20 con 0x7f191015e020 2024-05-08T10:55:49.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.989+0000 7f1914bd2640 1 -- 172.21.15.33:0/3008259096 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19100d4730 con 0x7f191015e020 2024-05-08T10:55:49.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.989+0000 7f1914bd2640 1 -- 172.21.15.33:0/3008259096 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3695269072 0 0) 0x7f18fc003520 con 0x7f19100d0b70 2024-05-08T10:55:49.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.989+0000 7f1914bd2640 1 -- 172.21.15.33:0/3008259096 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f191015e400 msgr2=0x7f19100b4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:49.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.989+0000 7f1914bd2640 1 --2- 172.21.15.33:0/3008259096 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f191015e400 0x7f19100b4770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:49.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.989+0000 7f1914bd2640 1 -- 172.21.15.33:0/3008259096 >> v1:172.21.15.174:6789/0 conn(0x7f191015e020 legacy=0x7f19100d0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:49.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.989+0000 7f1914bd2640 1 -- 172.21.15.33:0/3008259096 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19100d2000 con 0x7f19100d0b70 2024-05-08T10:55:49.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.990+0000 7f1914bd2640 1 -- 172.21.15.33:0/3008259096 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2948294915 0 0) 0x7f1908001a10 con 0x7f19100d0b70 2024-05-08T10:55:49.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.990+0000 7f19153d3640 1 --2- 172.21.15.33:0/3008259096 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f191015e400 0x7f19100b4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T10:55:49.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.990+0000 7f1914bd2640 1 -- 172.21.15.33:0/3008259096 >> v1:172.21.15.33:6789/0 conn(0x7f19100d0b70 legacy=0x7f19100cefe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:49.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.990+0000 7f1914bd2640 1 --2- 172.21.15.33:0/3008259096 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f18fc003b70 0x7f18fc003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:49.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.990+0000 7f1914bd2640 1 --2- 172.21.15.33:0/3008259096 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18fc004800 0x7f18fc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:49.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.990+0000 7f1914bd2640 1 --2- 172.21.15.33:0/3008259096 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f191015e400 0x7f18fc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:49.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.990+0000 7f1914bd2640 1 -- 172.21.15.33:0/3008259096 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19100ceac0 con 0x7f18fc004800 2024-05-08T10:55:49.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.990+0000 7f1914bd2640 1 -- 172.21.15.33:0/3008259096 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18fc00b9f0 con 0x7f18fc003b70 2024-05-08T10:55:49.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.990+0000 7f1914bd2640 1 -- 172.21.15.33:0/3008259096 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18fc00bbf0 con 0x7f191015e400 2024-05-08T10:55:49.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.990+0000 7f1915bd4640 1 --2- 172.21.15.33:0/3008259096 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f18fc003b70 0x7f18fc003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:49.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.990+0000 7f19153d3640 1 --2- 172.21.15.33:0/3008259096 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18fc004800 0x7f18fc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:49.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.990+0000 7f19163d5640 1 --2- 172.21.15.33:0/3008259096 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f191015e400 0x7f18fc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:49.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.990+0000 7f19163d5640 1 -- 172.21.15.33:0/3008259096 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f18fc003b70 msgr2=0x7f18fc003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:49.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.990+0000 7f19163d5640 1 --2- 172.21.15.33:0/3008259096 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f18fc003b70 0x7f18fc003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:49.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.990+0000 7f19163d5640 1 -- 172.21.15.33:0/3008259096 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18fc004800 msgr2=0x7f18fc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:49.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.990+0000 7f19163d5640 1 --2- 172.21.15.33:0/3008259096 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18fc004800 0x7f18fc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:49.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.990+0000 7f19163d5640 1 -- 172.21.15.33:0/3008259096 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18fc003520 con 0x7f191015e400 2024-05-08T10:55:49.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.990+0000 7f1915bd4640 1 --2- 172.21.15.33:0/3008259096 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f18fc003b70 0x7f18fc003f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T10:55:49.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.990+0000 7f19153d3640 1 --2- 172.21.15.33:0/3008259096 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18fc004800 0x7f18fc004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T10:55:49.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.991+0000 7f19163d5640 1 --2- 172.21.15.33:0/3008259096 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f191015e400 0x7f18fc0051c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f19100d4900 tx=0x7f18fc005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1cd846da02c66841 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:49.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.991+0000 7f1914bd2640 1 -- 172.21.15.33:0/3008259096 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f190800a450 con 0x7f191015e400 2024-05-08T10:55:49.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.991+0000 7f1914bd2640 1 -- 172.21.15.33:0/3008259096 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f190802f070 con 0x7f191015e400 2024-05-08T10:55:49.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.991+0000 7f1914bd2640 1 -- 172.21.15.33:0/3008259096 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f190802bc20 con 0x7f191015e400 2024-05-08T10:55:49.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.992+0000 7f1917e38640 1 -- 172.21.15.33:0/3008259096 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f191015e400 msgr2=0x7f18fc0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:49.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.992+0000 7f1917e38640 1 --2- 172.21.15.33:0/3008259096 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f191015e400 0x7f18fc0051c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f19100d4900 tx=0x7f18fc005830 comp rx=0 tx=0).stop 2024-05-08T10:55:49.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.992+0000 7f19163d5640 1 -- 172.21.15.33:0/3008259096 reap_dead start 2024-05-08T10:55:49.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.992+0000 7f1917e38640 1 -- 172.21.15.33:0/3008259096 shutdown_connections 2024-05-08T10:55:49.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.992+0000 7f1917e38640 1 -- 172.21.15.33:0/3008259096 >> 172.21.15.33:0/3008259096 conn(0x7f19100d3b70 msgr2=0x7f19100d3f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:49.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.992+0000 7f1917e38640 1 -- 172.21.15.33:0/3008259096 shutdown_connections 2024-05-08T10:55:49.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.992+0000 7f1917e38640 1 -- 172.21.15.33:0/3008259096 wait complete. 2024-05-08T10:55:49.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.993+0000 7f1917e38640 1 Processor -- start 2024-05-08T10:55:49.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.993+0000 7f1917e38640 1 -- start start 2024-05-08T10:55:49.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.994+0000 7f1917e38640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f191015e400 0x7f19100c75c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:49.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.994+0000 7f1917e38640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19100b1e90 0x7f191014b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:49.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.994+0000 7f1917e38640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f19100b2310 0x7f1910160f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:49.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.994+0000 7f1917e38640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19100d0fc0 con 0x7f19100b1e90 2024-05-08T10:55:49.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.994+0000 7f1917e38640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19100d49d0 con 0x7f191015e400 2024-05-08T10:55:49.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.994+0000 7f1917e38640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19100d1140 con 0x7f19100b2310 2024-05-08T10:55:49.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.994+0000 7f19153d3640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19100b1e90 0x7f191014b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:49.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.994+0000 7f19153d3640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19100b1e90 0x7f191014b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37168/0 (socket says 172.21.15.33:37168) 2024-05-08T10:55:49.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.994+0000 7f19153d3640 1 -- 172.21.15.33:0/3301129554 learned_addr learned my addr 172.21.15.33:0/3301129554 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:49.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.994+0000 7f1915bd4640 1 --2- 172.21.15.33:0/3301129554 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f191015e400 0x7f19100c75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:49.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.994+0000 7f19163d5640 1 --2- 172.21.15.33:0/3301129554 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f19100b2310 0x7f1910160f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:49.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.994+0000 7f19153d3640 1 -- 172.21.15.33:0/3301129554 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f19100b2310 msgr2=0x7f1910160f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:49.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.994+0000 7f19153d3640 1 --2- 172.21.15.33:0/3301129554 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f19100b2310 0x7f1910160f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:49.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.994+0000 7f19153d3640 1 -- 172.21.15.33:0/3301129554 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f191015e400 msgr2=0x7f19100c75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:49.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.994+0000 7f19153d3640 1 --2- 172.21.15.33:0/3301129554 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f191015e400 0x7f19100c75c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:49.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.994+0000 7f19153d3640 1 -- 172.21.15.33:0/3301129554 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f191015fe90 con 0x7f19100b1e90 2024-05-08T10:55:49.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.994+0000 7f19153d3640 1 --2- 172.21.15.33:0/3301129554 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19100b1e90 0x7f191014b7a0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f1900009df0 tx=0x7f1900016410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:49.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.995+0000 7f19067fc640 1 -- 172.21.15.33:0/3301129554 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f190001e790 con 0x7f19100b1e90 2024-05-08T10:55:49.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.995+0000 7f19067fc640 1 -- 172.21.15.33:0/3301129554 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1900024070 con 0x7f19100b1e90 2024-05-08T10:55:49.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.995+0000 7f1917e38640 1 -- 172.21.15.33:0/3301129554 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1910160170 con 0x7f19100b1e90 2024-05-08T10:55:49.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.995+0000 7f19067fc640 1 -- 172.21.15.33:0/3301129554 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f190001eb30 con 0x7f19100b1e90 2024-05-08T10:55:49.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.995+0000 7f1917e38640 1 -- 172.21.15.33:0/3301129554 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1910160730 con 0x7f19100b1e90 2024-05-08T10:55:49.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.996+0000 7f1917e38640 1 -- 172.21.15.33:0/3301129554 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1910075150 con 0x7f19100b1e90 2024-05-08T10:55:49.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.996+0000 7f19067fc640 1 -- 172.21.15.33:0/3301129554 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f190001ecd0 con 0x7f19100b1e90 2024-05-08T10:55:49.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.997+0000 7f19067fc640 1 --2- 172.21.15.33:0/3301129554 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f18f406b500 0x7f18f406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:49.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.997+0000 7f19067fc640 1 -- 172.21.15.33:0/3301129554 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1900092e30 con 0x7f19100b1e90 2024-05-08T10:55:49.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.997+0000 7f1915bd4640 1 --2- 172.21.15.33:0/3301129554 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f18f406b500 0x7f18f406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:49.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:49.997+0000 7f1915bd4640 1 --2- 172.21.15.33:0/3301129554 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f18f406b500 0x7f18f406d9c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f190c001a70 tx=0x7f190c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:49.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.001+0000 7f19067fc640 1 -- 172.21.15.33:0/3301129554 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1910075150 con 0x7f19100b1e90 2024-05-08T10:55:50.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.195+0000 7f1917e38640 1 -- 172.21.15.33:0/3301129554 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f19100d2260 con 0x7f19100b1e90 2024-05-08T10:55:50.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.195+0000 7f19067fc640 1 -- 172.21.15.33:0/3301129554 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v31) v1 ==== 80+0+0 (secure 0 0 0) 0x7f1900061cb0 con 0x7f19100b1e90 2024-05-08T10:55:50.193 INFO:teuthology.orchestra.run.smithi033.stderr:listed 0 entries 2024-05-08T10:55:50.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.197+0000 7f1917e38640 1 -- 172.21.15.33:0/3301129554 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f18f406b500 msgr2=0x7f18f406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:50.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.197+0000 7f1917e38640 1 --2- 172.21.15.33:0/3301129554 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f18f406b500 0x7f18f406d9c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f190c001a70 tx=0x7f190c009040 comp rx=0 tx=0).stop 2024-05-08T10:55:50.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.197+0000 7f1917e38640 1 -- 172.21.15.33:0/3301129554 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19100b1e90 msgr2=0x7f191014b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:50.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.197+0000 7f1917e38640 1 --2- 172.21.15.33:0/3301129554 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19100b1e90 0x7f191014b7a0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f1900009df0 tx=0x7f1900016410 comp rx=0 tx=0).stop 2024-05-08T10:55:50.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.197+0000 7f1917e38640 1 -- 172.21.15.33:0/3301129554 shutdown_connections 2024-05-08T10:55:50.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.197+0000 7f1917e38640 1 --2- 172.21.15.33:0/3301129554 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f18f406b500 0x7f18f406d9c0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:50.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.197+0000 7f1917e38640 1 --2- 172.21.15.33:0/3301129554 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f19100b2310 0x7f1910160f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:50.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.197+0000 7f1917e38640 1 --2- 172.21.15.33:0/3301129554 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19100b1e90 0x7f191014b7a0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:50.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.197+0000 7f1917e38640 1 --2- 172.21.15.33:0/3301129554 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f191015e400 0x7f19100c75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:50.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.197+0000 7f1917e38640 1 -- 172.21.15.33:0/3301129554 >> 172.21.15.33:0/3301129554 conn(0x7f19100d3b70 msgr2=0x7f19100b4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:50.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.197+0000 7f1917e38640 1 -- 172.21.15.33:0/3301129554 shutdown_connections 2024-05-08T10:55:50.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.198+0000 7f1917e38640 1 -- 172.21.15.33:0/3301129554 wait complete. 2024-05-08T10:55:50.206 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-08T10:55:50.206 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:55:50.207 DEBUG:teuthology.orchestra.run.smithi033:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-05-08T10:55:50.250 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi033.front.sepia.ceph.com 2024-05-08T10:55:50.250 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:55:50.250 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-08T10:55:50.311 INFO:tasks.cephfs.mount:Terminating background process 2024-05-08T10:55:50.311 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-05-08T10:55:50.311 DEBUG:teuthology.orchestra.run.smithi174:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T10:55:50.336 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056323,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497656k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=881 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248824k,nr_inodes=812206,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497656k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-08T10:55:50.336 INFO:tasks.cephfs.mount:Terminating background process 2024-05-08T10:55:50.336 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-05-08T10:55:50.336 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T10:55:50.372 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057103,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2352 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249452k,nr_inodes=812363,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-08T10:55:50.372 INFO:tasks.cephfs.mount:Terminating background process 2024-05-08T10:55:50.373 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-05-08T10:55:50.373 DEBUG:teuthology.orchestra.run.smithi174:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T10:55:50.400 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056323,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497656k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=881 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248824k,nr_inodes=812206,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497656k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-08T10:55:50.400 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T10:55:50.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.522+0000 7f74aaf34640 1 Processor -- start 2024-05-08T10:55:50.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.522+0000 7f74aaf34640 1 -- start start 2024-05-08T10:55:50.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.523+0000 7f74aaf34640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f74a40ce380 0x7f74a40ce760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:50.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.523+0000 7f74aaf34640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f74a40cdf30 0x7f74a40d01e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:50.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.523+0000 7f74aaf34640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f74a40d24d0 0x7f74a40cc4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:50.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.523+0000 7f74aaf34640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74a415d070 con 0x7f74a40ce380 2024-05-08T10:55:50.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.523+0000 7f74aaf34640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74a415cb10 con 0x7f74a40cdf30 2024-05-08T10:55:50.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.523+0000 7f74aaf34640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74a40cf2e0 con 0x7f74a40d24d0 2024-05-08T10:55:50.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.523+0000 7f74a8cd0640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f74a40ce380 0x7f74a40ce760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:50.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.523+0000 7f74a8cd0640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f74a40ce380 0x7f74a40ce760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37180/0 (socket says 172.21.15.33:37180) 2024-05-08T10:55:50.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.523+0000 7f74a8cd0640 1 -- 172.21.15.33:0/3546598134 learned_addr learned my addr 172.21.15.33:0/3546598134 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:50.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.523+0000 7f749bfff640 1 --2- 172.21.15.33:0/3546598134 >> v2:172.21.15.174:3300/0 conn(0x7f74a40cdf30 0x7f74a40d01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:50.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.523+0000 7f74a94d1640 1 --2- 172.21.15.33:0/3546598134 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f74a40d24d0 0x7f74a40cc4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:50.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.523+0000 7f74a8cd0640 1 -- 172.21.15.33:0/3546598134 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f74a40d24d0 msgr2=0x7f74a40cc4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:50.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.523+0000 7f74a8cd0640 1 --2- 172.21.15.33:0/3546598134 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f74a40d24d0 0x7f74a40cc4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:50.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.523+0000 7f74a8cd0640 1 -- 172.21.15.33:0/3546598134 >> v2:172.21.15.174:3300/0 conn(0x7f74a40cdf30 msgr2=0x7f74a40d01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:50.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.523+0000 7f74a8cd0640 1 --2- 172.21.15.33:0/3546598134 >> v2:172.21.15.174:3300/0 conn(0x7f74a40cdf30 0x7f74a40d01e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:50.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.523+0000 7f74a8cd0640 1 -- 172.21.15.33:0/3546598134 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74a40ceca0 con 0x7f74a40ce380 2024-05-08T10:55:50.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.524+0000 7f74a8cd0640 1 --2- 172.21.15.33:0/3546598134 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74a40ce380 0x7f74a40ce760 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f74a40b3430 tx=0x7f74a002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fa4f17f6d446c3e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:50.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.524+0000 7f749b7fe640 1 -- 172.21.15.33:0/3546598134 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a0037070 con 0x7f74a40ce380 2024-05-08T10:55:50.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.524+0000 7f749b7fe640 1 -- 172.21.15.33:0/3546598134 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74a0032440 con 0x7f74a40ce380 2024-05-08T10:55:50.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.524+0000 7f749b7fe640 1 -- 172.21.15.33:0/3546598134 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a0032810 con 0x7f74a40ce380 2024-05-08T10:55:50.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.525+0000 7f74aaf34640 1 -- 172.21.15.33:0/3546598134 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74a40ce380 msgr2=0x7f74a40ce760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:50.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.525+0000 7f74aaf34640 1 --2- 172.21.15.33:0/3546598134 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74a40ce380 0x7f74a40ce760 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f74a40b3430 tx=0x7f74a002a1e0 comp rx=0 tx=0).stop 2024-05-08T10:55:50.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.525+0000 7f74aaf34640 1 -- 172.21.15.33:0/3546598134 shutdown_connections 2024-05-08T10:55:50.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.525+0000 7f74aaf34640 1 --2- 172.21.15.33:0/3546598134 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f74a40d24d0 0x7f74a40cc4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:50.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.525+0000 7f74aaf34640 1 --2- 172.21.15.33:0/3546598134 >> v2:172.21.15.174:3300/0 conn(0x7f74a40cdf30 0x7f74a40d01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:50.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.525+0000 7f74aaf34640 1 --2- 172.21.15.33:0/3546598134 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74a40ce380 0x7f74a40ce760 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:50.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.525+0000 7f74aaf34640 1 -- 172.21.15.33:0/3546598134 >> 172.21.15.33:0/3546598134 conn(0x7f74a40d19b0 msgr2=0x7f74a40d1dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:50.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.525+0000 7f74aaf34640 1 -- 172.21.15.33:0/3546598134 shutdown_connections 2024-05-08T10:55:50.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.525+0000 7f74aaf34640 1 -- 172.21.15.33:0/3546598134 wait complete. 2024-05-08T10:55:50.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.526+0000 7f74aaf34640 1 Processor -- start 2024-05-08T10:55:50.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.526+0000 7f74aaf34640 1 -- start start 2024-05-08T10:55:50.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.527+0000 7f74aaf34640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f74a40cdf30 0x7f74a4155e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:50.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.527+0000 7f74aaf34640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74a40ce380 0x7f74a40b5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:50.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.527+0000 7f74aaf34640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f74a40d24d0 0x7f74a40b0530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:50.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.527+0000 7f74aaf34640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a40cf9e0 con 0x7f74a40ce380 2024-05-08T10:55:50.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.527+0000 7f74aaf34640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a40cf700 con 0x7f74a40d24d0 2024-05-08T10:55:50.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.527+0000 7f74aaf34640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74a40cfcc0 con 0x7f74a40cdf30 2024-05-08T10:55:50.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.527+0000 7f749bfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74a40ce380 0x7f74a40b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:50.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.527+0000 7f749bfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74a40ce380 0x7f74a40b5950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37192/0 (socket says 172.21.15.33:37192) 2024-05-08T10:55:50.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.527+0000 7f749bfff640 1 -- 172.21.15.33:0/1439049756 learned_addr learned my addr 172.21.15.33:0/1439049756 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:50.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.527+0000 7f74a94d1640 1 --2- 172.21.15.33:0/1439049756 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f74a40d24d0 0x7f74a40b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:50.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.527+0000 7f74a8cd0640 1 --2- 172.21.15.33:0/1439049756 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f74a40cdf30 0x7f74a4155e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:50.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.527+0000 7f749bfff640 1 -- 172.21.15.33:0/1439049756 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f74a40cdf30 msgr2=0x7f74a4155e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:50.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.527+0000 7f749bfff640 1 --2- 172.21.15.33:0/1439049756 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f74a40cdf30 0x7f74a4155e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:50.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.527+0000 7f749bfff640 1 -- 172.21.15.33:0/1439049756 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f74a40d24d0 msgr2=0x7f74a40b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:50.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.527+0000 7f749bfff640 1 --2- 172.21.15.33:0/1439049756 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f74a40d24d0 0x7f74a40b0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:50.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.527+0000 7f749bfff640 1 -- 172.21.15.33:0/1439049756 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74a40b48b0 con 0x7f74a40ce380 2024-05-08T10:55:50.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.527+0000 7f74a94d1640 1 --2- 172.21.15.33:0/1439049756 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f74a40d24d0 0x7f74a40b0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:55:50.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.527+0000 7f749bfff640 1 --2- 172.21.15.33:0/1439049756 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74a40ce380 0x7f74a40b5950 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f749400d830 tx=0x7f749400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:50.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.528+0000 7f74997fa640 1 -- 172.21.15.33:0/1439049756 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7494018030 con 0x7f74a40ce380 2024-05-08T10:55:50.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.528+0000 7f74997fa640 1 -- 172.21.15.33:0/1439049756 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f749400be10 con 0x7f74a40ce380 2024-05-08T10:55:50.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.528+0000 7f74aaf34640 1 -- 172.21.15.33:0/1439049756 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74a40b4b90 con 0x7f74a40ce380 2024-05-08T10:55:50.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.528+0000 7f74997fa640 1 -- 172.21.15.33:0/1439049756 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74940098b0 con 0x7f74a40ce380 2024-05-08T10:55:50.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.528+0000 7f74aaf34640 1 -- 172.21.15.33:0/1439049756 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74a40b5150 con 0x7f74a40ce380 2024-05-08T10:55:50.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.529+0000 7f74aaf34640 1 -- 172.21.15.33:0/1439049756 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74a40cbb40 con 0x7f74a40ce380 2024-05-08T10:55:50.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.529+0000 7f74997fa640 1 -- 172.21.15.33:0/1439049756 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f749401b070 con 0x7f74a40ce380 2024-05-08T10:55:50.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.530+0000 7f74997fa640 1 --2- 172.21.15.33:0/1439049756 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f749006b500 0x7f749006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:50.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.530+0000 7f74997fa640 1 -- 172.21.15.33:0/1439049756 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f749408a3c0 con 0x7f74a40ce380 2024-05-08T10:55:50.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.530+0000 7f74a8cd0640 1 --2- 172.21.15.33:0/1439049756 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f749006b500 0x7f749006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:50.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.530+0000 7f74a8cd0640 1 --2- 172.21.15.33:0/1439049756 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f749006b500 0x7f749006d9c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f74a0034000 tx=0x7f74a002e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:50.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.534+0000 7f74997fa640 1 -- 172.21.15.33:0/1439049756 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f74a40cbb40 con 0x7f74a40ce380 2024-05-08T10:55:50.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.750+0000 7f74aaf34640 1 -- 172.21.15.33:0/1439049756 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f74a4069d20 con 0x7f74a40ce380 2024-05-08T10:55:50.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.751+0000 7f74997fa640 1 -- 172.21.15.33:0/1439049756 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4941 (secure 0 0 0) 0x7f7494059240 con 0x7f74a40ce380 2024-05-08T10:55:50.749 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:55:50.749 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4592,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6836/2731663891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2731663891},{"type":"v1","addr":"172.21.15.174:6836","nonce":2731663891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":4598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/2004985147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6833","nonce":2004985147},{"type":"v1","addr":"172.21.15.33:6835","nonce":2004985147}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4702,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6837/3164144740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6835","nonce":3164144740},{"type":"v1","addr":"172.21.15.174:6837","nonce":3164144740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T10:55:31.311811+0000","modified":"2024-05-08T10:55:33.333600+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4708},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4708":{"gid":4708,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.33:6834/415400390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":415400390},{"type":"v1","addr":"172.21.15.33:6834","nonce":415400390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-05-08T10:55:50.749 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 14 2024-05-08T10:55:50.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.753+0000 7f74aaf34640 1 -- 172.21.15.33:0/1439049756 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f749006b500 msgr2=0x7f749006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:50.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.753+0000 7f74aaf34640 1 --2- 172.21.15.33:0/1439049756 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f749006b500 0x7f749006d9c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f74a0034000 tx=0x7f74a002e000 comp rx=0 tx=0).stop 2024-05-08T10:55:50.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.753+0000 7f74aaf34640 1 -- 172.21.15.33:0/1439049756 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74a40ce380 msgr2=0x7f74a40b5950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:50.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.753+0000 7f74aaf34640 1 --2- 172.21.15.33:0/1439049756 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74a40ce380 0x7f74a40b5950 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f749400d830 tx=0x7f749400dcf0 comp rx=0 tx=0).stop 2024-05-08T10:55:50.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.753+0000 7f74aaf34640 1 -- 172.21.15.33:0/1439049756 shutdown_connections 2024-05-08T10:55:50.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.753+0000 7f74aaf34640 1 --2- 172.21.15.33:0/1439049756 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f749006b500 0x7f749006d9c0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:50.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.753+0000 7f74aaf34640 1 --2- 172.21.15.33:0/1439049756 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f74a40d24d0 0x7f74a40b0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:50.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.753+0000 7f74aaf34640 1 --2- 172.21.15.33:0/1439049756 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74a40ce380 0x7f74a40b5950 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:50.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.753+0000 7f74aaf34640 1 --2- 172.21.15.33:0/1439049756 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f74a40cdf30 0x7f74a4155e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:50.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.753+0000 7f74aaf34640 1 -- 172.21.15.33:0/1439049756 >> 172.21.15.33:0/1439049756 conn(0x7f74a40d19b0 msgr2=0x7f74a40d00e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:50.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.753+0000 7f74aaf34640 1 -- 172.21.15.33:0/1439049756 shutdown_connections 2024-05-08T10:55:50.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.753+0000 7f74aaf34640 1 -- 172.21.15.33:0/1439049756 wait complete. 2024-05-08T10:55:50.762 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T10:55:50.794 DEBUG:teuthology.orchestra.run.smithi033:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T10:55:50.812 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T10:55:50.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.869+0000 7f6c5a19e640 1 Processor -- start 2024-05-08T10:55:50.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.869+0000 7f6c5a19e640 1 -- start start 2024-05-08T10:55:50.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.870+0000 7f6c5a19e640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f6c541455b0 0x7f6c5415cb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:50.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.870+0000 7f6c5a19e640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f6c540cdc70 0x7f6c540b43e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:50.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.870+0000 7f6c5a19e640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6c540b4920 0x7f6c5415f690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:50.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.870+0000 7f6c5a19e640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c54145990 con 0x7f6c541455b0 2024-05-08T10:55:50.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.870+0000 7f6c5a19e640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c5415d060 con 0x7f6c540cdc70 2024-05-08T10:55:50.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.870+0000 7f6c5a19e640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c540b4d30 con 0x7f6c540b4920 2024-05-08T10:55:50.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.870+0000 7f6c537fe640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f6c541455b0 0x7f6c5415cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:50.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.870+0000 7f6c537fe640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f6c541455b0 0x7f6c5415cb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37198/0 (socket says 172.21.15.33:37198) 2024-05-08T10:55:50.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.870+0000 7f6c537fe640 1 -- 172.21.15.33:0/2238112467 learned_addr learned my addr 172.21.15.33:0/2238112467 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:50.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.870+0000 7f6c53fff640 1 --2- 172.21.15.33:0/2238112467 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6c540b4920 0x7f6c5415f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:50.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.870+0000 7f6c4affd640 1 --2- 172.21.15.33:0/2238112467 >> v2:172.21.15.174:3300/0 conn(0x7f6c540cdc70 0x7f6c540b43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:50.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.870+0000 7f6c537fe640 1 -- 172.21.15.33:0/2238112467 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6c540b4920 msgr2=0x7f6c5415f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:50.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.870+0000 7f6c537fe640 1 --2- 172.21.15.33:0/2238112467 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6c540b4920 0x7f6c5415f690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:50.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.870+0000 7f6c537fe640 1 -- 172.21.15.33:0/2238112467 >> v2:172.21.15.174:3300/0 conn(0x7f6c540cdc70 msgr2=0x7f6c540b43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:50.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.870+0000 7f6c537fe640 1 --2- 172.21.15.33:0/2238112467 >> v2:172.21.15.174:3300/0 conn(0x7f6c540cdc70 0x7f6c540b43e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:50.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.870+0000 7f6c537fe640 1 -- 172.21.15.33:0/2238112467 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c540cfbd0 con 0x7f6c541455b0 2024-05-08T10:55:50.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.870+0000 7f6c53fff640 1 --2- 172.21.15.33:0/2238112467 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6c540b4920 0x7f6c5415f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:55:50.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.871+0000 7f6c537fe640 1 --2- 172.21.15.33:0/2238112467 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6c541455b0 0x7f6c5415cb20 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f6c54160730 tx=0x7f6c4402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de11a6ba396f15b0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:50.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.871+0000 7f6c52ffd640 1 -- 172.21.15.33:0/2238112467 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c44037070 con 0x7f6c541455b0 2024-05-08T10:55:50.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.871+0000 7f6c52ffd640 1 -- 172.21.15.33:0/2238112467 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c44032440 con 0x7f6c541455b0 2024-05-08T10:55:50.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.871+0000 7f6c52ffd640 1 -- 172.21.15.33:0/2238112467 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c44032810 con 0x7f6c541455b0 2024-05-08T10:55:50.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.872+0000 7f6c5a19e640 1 -- 172.21.15.33:0/2238112467 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6c541455b0 msgr2=0x7f6c5415cb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:50.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.872+0000 7f6c5a19e640 1 --2- 172.21.15.33:0/2238112467 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6c541455b0 0x7f6c5415cb20 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f6c54160730 tx=0x7f6c4402a140 comp rx=0 tx=0).stop 2024-05-08T10:55:50.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.872+0000 7f6c5a19e640 1 -- 172.21.15.33:0/2238112467 shutdown_connections 2024-05-08T10:55:50.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.872+0000 7f6c5a19e640 1 --2- 172.21.15.33:0/2238112467 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6c540b4920 0x7f6c5415f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:50.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.872+0000 7f6c5a19e640 1 --2- 172.21.15.33:0/2238112467 >> v2:172.21.15.174:3300/0 conn(0x7f6c540cdc70 0x7f6c540b43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:50.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.872+0000 7f6c5a19e640 1 --2- 172.21.15.33:0/2238112467 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6c541455b0 0x7f6c5415cb20 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:50.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.872+0000 7f6c5a19e640 1 -- 172.21.15.33:0/2238112467 >> 172.21.15.33:0/2238112467 conn(0x7f6c5406aba0 msgr2=0x7f6c5406afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:50.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.872+0000 7f6c5a19e640 1 -- 172.21.15.33:0/2238112467 shutdown_connections 2024-05-08T10:55:50.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.872+0000 7f6c5a19e640 1 -- 172.21.15.33:0/2238112467 wait complete. 2024-05-08T10:55:50.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.873+0000 7f6c5a19e640 1 Processor -- start 2024-05-08T10:55:50.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.873+0000 7f6c5a19e640 1 -- start start 2024-05-08T10:55:50.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.874+0000 7f6c5a19e640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6c540b4920 0x7f6c541f3730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:50.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.874+0000 7f6c5a19e640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6c540cdc70 0x7f6c541f6d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:50.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.874+0000 7f6c5a19e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6c541455b0 0x7f6c5412e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:50.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.874+0000 7f6c5a19e640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c5406d0d0 con 0x7f6c541455b0 2024-05-08T10:55:50.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.874+0000 7f6c5a19e640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c5406cdf0 con 0x7f6c540cdc70 2024-05-08T10:55:50.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.874+0000 7f6c5a19e640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c5406d3b0 con 0x7f6c540b4920 2024-05-08T10:55:50.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.874+0000 7f6c53fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6c541455b0 0x7f6c5412e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:50.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.874+0000 7f6c53fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6c541455b0 0x7f6c5412e120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37212/0 (socket says 172.21.15.33:37212) 2024-05-08T10:55:50.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.874+0000 7f6c53fff640 1 -- 172.21.15.33:0/1008114103 learned_addr learned my addr 172.21.15.33:0/1008114103 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:50.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.874+0000 7f6c537fe640 1 --2- 172.21.15.33:0/1008114103 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6c540b4920 0x7f6c541f3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:50.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.874+0000 7f6c4affd640 1 --2- 172.21.15.33:0/1008114103 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6c540cdc70 0x7f6c541f6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:50.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.874+0000 7f6c53fff640 1 -- 172.21.15.33:0/1008114103 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6c540b4920 msgr2=0x7f6c541f3730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:50.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.874+0000 7f6c53fff640 1 --2- 172.21.15.33:0/1008114103 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6c540b4920 0x7f6c541f3730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:50.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.874+0000 7f6c53fff640 1 -- 172.21.15.33:0/1008114103 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6c540cdc70 msgr2=0x7f6c541f6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:50.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.874+0000 7f6c53fff640 1 --2- 172.21.15.33:0/1008114103 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6c540cdc70 0x7f6c541f6d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:50.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.874+0000 7f6c53fff640 1 -- 172.21.15.33:0/1008114103 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c540708d0 con 0x7f6c541455b0 2024-05-08T10:55:50.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.875+0000 7f6c53fff640 1 --2- 172.21.15.33:0/1008114103 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6c541455b0 0x7f6c5412e120 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c00cd40 tx=0x7f6c4c00a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:50.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.875+0000 7f6c50ff9640 1 -- 172.21.15.33:0/1008114103 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c4c00f680 con 0x7f6c541455b0 2024-05-08T10:55:50.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.875+0000 7f6c50ff9640 1 -- 172.21.15.33:0/1008114103 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c4c00f840 con 0x7f6c541455b0 2024-05-08T10:55:50.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.875+0000 7f6c5a19e640 1 -- 172.21.15.33:0/1008114103 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c541f7400 con 0x7f6c541455b0 2024-05-08T10:55:50.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.875+0000 7f6c50ff9640 1 -- 172.21.15.33:0/1008114103 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c4c00fc30 con 0x7f6c541455b0 2024-05-08T10:55:50.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.875+0000 7f6c5a19e640 1 -- 172.21.15.33:0/1008114103 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c541f79c0 con 0x7f6c541455b0 2024-05-08T10:55:50.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.876+0000 7f6c5a19e640 1 -- 172.21.15.33:0/1008114103 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c54069d20 con 0x7f6c541455b0 2024-05-08T10:55:50.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.876+0000 7f6c50ff9640 1 -- 172.21.15.33:0/1008114103 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6c4c0213f0 con 0x7f6c541455b0 2024-05-08T10:55:50.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.877+0000 7f6c50ff9640 1 --2- 172.21.15.33:0/1008114103 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f6c3406b4d0 0x7f6c3406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:50.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.877+0000 7f6c50ff9640 1 -- 172.21.15.33:0/1008114103 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6c4c08afa0 con 0x7f6c541455b0 2024-05-08T10:55:50.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.877+0000 7f6c537fe640 1 --2- 172.21.15.33:0/1008114103 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f6c3406b4d0 0x7f6c3406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:50.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.878+0000 7f6c537fe640 1 --2- 172.21.15.33:0/1008114103 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f6c3406b4d0 0x7f6c3406d990 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6c44034000 tx=0x7f6c4402e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:50.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:50.882+0000 7f6c50ff9640 1 -- 172.21.15.33:0/1008114103 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6c4c014030 con 0x7f6c541455b0 2024-05-08T10:55:51.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.101+0000 7f6c5a19e640 1 -- 172.21.15.33:0/1008114103 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6c5406dcb0 con 0x7f6c541455b0 2024-05-08T10:55:51.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.101+0000 7f6c50ff9640 1 -- 172.21.15.33:0/1008114103 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4941 (secure 0 0 0) 0x7f6c4c059860 con 0x7f6c541455b0 2024-05-08T10:55:51.099 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:55:51.099 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4592,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6836/2731663891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2731663891},{"type":"v1","addr":"172.21.15.174:6836","nonce":2731663891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":4598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/2004985147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6833","nonce":2004985147},{"type":"v1","addr":"172.21.15.33:6835","nonce":2004985147}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4702,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6837/3164144740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6835","nonce":3164144740},{"type":"v1","addr":"172.21.15.174:6837","nonce":3164144740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T10:55:31.311811+0000","modified":"2024-05-08T10:55:33.333600+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4708},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4708":{"gid":4708,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.33:6834/415400390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":415400390},{"type":"v1","addr":"172.21.15.33:6834","nonce":415400390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-05-08T10:55:51.099 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 14 2024-05-08T10:55:51.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.103+0000 7f6c5a19e640 1 -- 172.21.15.33:0/1008114103 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f6c3406b4d0 msgr2=0x7f6c3406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:51.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.103+0000 7f6c5a19e640 1 --2- 172.21.15.33:0/1008114103 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f6c3406b4d0 0x7f6c3406d990 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6c44034000 tx=0x7f6c4402e000 comp rx=0 tx=0).stop 2024-05-08T10:55:51.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.103+0000 7f6c5a19e640 1 -- 172.21.15.33:0/1008114103 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6c541455b0 msgr2=0x7f6c5412e120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:51.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.103+0000 7f6c5a19e640 1 --2- 172.21.15.33:0/1008114103 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6c541455b0 0x7f6c5412e120 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c00cd40 tx=0x7f6c4c00a650 comp rx=0 tx=0).stop 2024-05-08T10:55:51.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.104+0000 7f6c5a19e640 1 -- 172.21.15.33:0/1008114103 shutdown_connections 2024-05-08T10:55:51.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.104+0000 7f6c5a19e640 1 --2- 172.21.15.33:0/1008114103 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f6c3406b4d0 0x7f6c3406d990 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:51.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.104+0000 7f6c5a19e640 1 --2- 172.21.15.33:0/1008114103 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6c541455b0 0x7f6c5412e120 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:51.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.104+0000 7f6c5a19e640 1 --2- 172.21.15.33:0/1008114103 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6c540cdc70 0x7f6c541f6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:51.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.104+0000 7f6c5a19e640 1 --2- 172.21.15.33:0/1008114103 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6c540b4920 0x7f6c541f3730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:51.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.104+0000 7f6c5a19e640 1 -- 172.21.15.33:0/1008114103 >> 172.21.15.33:0/1008114103 conn(0x7f6c5406aba0 msgr2=0x7f6c5415e000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:51.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.104+0000 7f6c5a19e640 1 -- 172.21.15.33:0/1008114103 shutdown_connections 2024-05-08T10:55:51.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.104+0000 7f6c5a19e640 1 -- 172.21.15.33:0/1008114103 wait complete. 2024-05-08T10:55:51.113 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T10:55:51.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.221+0000 7f9b7c2ee640 1 Processor -- start 2024-05-08T10:55:51.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.221+0000 7f9b7c2ee640 1 -- start start 2024-05-08T10:55:51.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.222+0000 7f9b7c2ee640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9b740cc290 0x7f9b7415b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:51.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.222+0000 7f9b7c2ee640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f9b74072110 0x7f9b7406dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:51.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.222+0000 7f9b7c2ee640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b740cfb60 con 0x7f9b7406d7d0 2024-05-08T10:55:51.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.222+0000 7f9b7c2ee640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b7406e170 con 0x7f9b74072110 2024-05-08T10:55:51.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.222+0000 7f9b7c2ee640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b7415bec0 con 0x7f9b740cc290 2024-05-08T10:55:51.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.222+0000 7f9b7a88b640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f9b74072110 0x7f9b7406dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:51.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.222+0000 7f9b7a88b640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f9b74072110 0x7f9b7406dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37226/0 (socket says 172.21.15.33:37226) 2024-05-08T10:55:51.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.222+0000 7f9b7a88b640 1 -- 172.21.15.33:0/31363357 learned_addr learned my addr 172.21.15.33:0/31363357 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:51.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.222+0000 7f9b7a88b640 1 -- 172.21.15.33:0/31363357 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9b740cc290 msgr2=0x7f9b7415b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:51.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.222+0000 7f9b7a08a640 1 --2- 172.21.15.33:0/31363357 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9b740cc290 0x7f9b7415b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:51.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.223+0000 7f9b7a88b640 1 --2- 172.21.15.33:0/31363357 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9b740cc290 0x7f9b7415b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:51.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.223+0000 7f9b7a88b640 1 -- 172.21.15.33:0/31363357 >> v1:172.21.15.174:6789/0 conn(0x7f9b7406d7d0 legacy=0x7f9b7415e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:51.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.223+0000 7f9b7a88b640 1 -- 172.21.15.33:0/31363357 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b740cfe40 con 0x7f9b74072110 2024-05-08T10:55:51.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.223+0000 7f9b7a08a640 1 --2- 172.21.15.33:0/31363357 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9b740cc290 0x7f9b7415b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:55:51.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.223+0000 7f9b7a88b640 1 --2- 172.21.15.33:0/31363357 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9b74072110 0x7f9b7406dc30 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f9b6c00d150 tx=0x7f9b6c02c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35590eb3fe45160d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:51.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.223+0000 7f9b79088640 1 -- 172.21.15.33:0/31363357 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b6c039070 con 0x7f9b74072110 2024-05-08T10:55:51.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.223+0000 7f9b79088640 1 -- 172.21.15.33:0/31363357 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b6c009600 con 0x7f9b74072110 2024-05-08T10:55:51.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.223+0000 7f9b79088640 1 -- 172.21.15.33:0/31363357 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b6c0099d0 con 0x7f9b74072110 2024-05-08T10:55:51.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.224+0000 7f9b7c2ee640 1 -- 172.21.15.33:0/31363357 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9b74072110 msgr2=0x7f9b7406dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:51.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.224+0000 7f9b7c2ee640 1 --2- 172.21.15.33:0/31363357 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9b74072110 0x7f9b7406dc30 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f9b6c00d150 tx=0x7f9b6c02c840 comp rx=0 tx=0).stop 2024-05-08T10:55:51.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.224+0000 7f9b7c2ee640 1 -- 172.21.15.33:0/31363357 shutdown_connections 2024-05-08T10:55:51.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.224+0000 7f9b7c2ee640 1 --2- 172.21.15.33:0/31363357 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9b74072110 0x7f9b7406dc30 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:51.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.224+0000 7f9b7c2ee640 1 --2- 172.21.15.33:0/31363357 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9b740cc290 0x7f9b7415b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:51.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.224+0000 7f9b7c2ee640 1 -- 172.21.15.33:0/31363357 >> 172.21.15.33:0/31363357 conn(0x7f9b7406aba0 msgr2=0x7f9b7406afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:51.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.224+0000 7f9b7c2ee640 1 -- 172.21.15.33:0/31363357 shutdown_connections 2024-05-08T10:55:51.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.224+0000 7f9b7c2ee640 1 -- 172.21.15.33:0/31363357 wait complete. 2024-05-08T10:55:51.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.225+0000 7f9b7c2ee640 1 Processor -- start 2024-05-08T10:55:51.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.225+0000 7f9b7c2ee640 1 -- start start 2024-05-08T10:55:51.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.226+0000 7f9b7c2ee640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9b7406d7d0 0x7f9b74151410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:51.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.226+0000 7f9b7c2ee640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9b74072110 0x7f9b740ad840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:51.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.226+0000 7f9b7c2ee640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9b740cc290 0x7f9b741e4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:51.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.226+0000 7f9b7c2ee640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b740d0400 con 0x7f9b7406d7d0 2024-05-08T10:55:51.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.226+0000 7f9b7c2ee640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b740d0770 con 0x7f9b740cc290 2024-05-08T10:55:51.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.226+0000 7f9b7c2ee640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b740b36b0 con 0x7f9b74072110 2024-05-08T10:55:51.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.226+0000 7f9b7a08a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9b7406d7d0 0x7f9b74151410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:51.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.226+0000 7f9b7a08a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9b7406d7d0 0x7f9b74151410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37230/0 (socket says 172.21.15.33:37230) 2024-05-08T10:55:51.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.226+0000 7f9b7a08a640 1 -- 172.21.15.33:0/2013203479 learned_addr learned my addr 172.21.15.33:0/2013203479 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:51.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.226+0000 7f9b7a88b640 1 --2- 172.21.15.33:0/2013203479 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9b740cc290 0x7f9b741e4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:51.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.226+0000 7f9b79889640 1 --2- 172.21.15.33:0/2013203479 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9b74072110 0x7f9b740ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:51.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.226+0000 7f9b7a08a640 1 -- 172.21.15.33:0/2013203479 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9b74072110 msgr2=0x7f9b740ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:51.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.226+0000 7f9b7a08a640 1 --2- 172.21.15.33:0/2013203479 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9b74072110 0x7f9b740ad840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:51.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.226+0000 7f9b7a08a640 1 -- 172.21.15.33:0/2013203479 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9b740cc290 msgr2=0x7f9b741e4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:51.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.226+0000 7f9b7a08a640 1 --2- 172.21.15.33:0/2013203479 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9b740cc290 0x7f9b741e4eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:51.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.226+0000 7f9b7a08a640 1 -- 172.21.15.33:0/2013203479 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b740add80 con 0x7f9b7406d7d0 2024-05-08T10:55:51.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.226+0000 7f9b7a88b640 1 --2- 172.21.15.33:0/2013203479 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9b740cc290 0x7f9b741e4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:55:51.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.226+0000 7f9b79889640 1 --2- 172.21.15.33:0/2013203479 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9b74072110 0x7f9b740ad840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:55:51.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.227+0000 7f9b7a08a640 1 --2- 172.21.15.33:0/2013203479 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9b7406d7d0 0x7f9b74151410 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f9b7000c7f0 tx=0x7f9b7000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:51.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.227+0000 7f9b6affd640 1 -- 172.21.15.33:0/2013203479 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b70015070 con 0x7f9b7406d7d0 2024-05-08T10:55:51.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.227+0000 7f9b6affd640 1 -- 172.21.15.33:0/2013203479 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b70007a30 con 0x7f9b7406d7d0 2024-05-08T10:55:51.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.227+0000 7f9b7c2ee640 1 -- 172.21.15.33:0/2013203479 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b740ae020 con 0x7f9b7406d7d0 2024-05-08T10:55:51.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.227+0000 7f9b6affd640 1 -- 172.21.15.33:0/2013203479 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b70007e00 con 0x7f9b7406d7d0 2024-05-08T10:55:51.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.227+0000 7f9b7c2ee640 1 -- 172.21.15.33:0/2013203479 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b740ae5e0 con 0x7f9b7406d7d0 2024-05-08T10:55:51.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.228+0000 7f9b7c2ee640 1 -- 172.21.15.33:0/2013203479 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b74069d20 con 0x7f9b7406d7d0 2024-05-08T10:55:51.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.228+0000 7f9b6affd640 1 -- 172.21.15.33:0/2013203479 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9b70018070 con 0x7f9b7406d7d0 2024-05-08T10:55:51.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.229+0000 7f9b6affd640 1 --2- 172.21.15.33:0/2013203479 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f9b5806b4d0 0x7f9b5806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:51.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.229+0000 7f9b6affd640 1 -- 172.21.15.33:0/2013203479 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9b7008a170 con 0x7f9b7406d7d0 2024-05-08T10:55:51.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.229+0000 7f9b79889640 1 --2- 172.21.15.33:0/2013203479 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f9b5806b4d0 0x7f9b5806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:51.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.230+0000 7f9b79889640 1 --2- 172.21.15.33:0/2013203479 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f9b5806b4d0 0x7f9b5806d990 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f9b7415d420 tx=0x7f9b64008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:51.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.233+0000 7f9b6affd640 1 -- 172.21.15.33:0/2013203479 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9b70058ff0 con 0x7f9b7406d7d0 2024-05-08T10:55:51.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.416+0000 7f9b7c2ee640 1 -- 172.21.15.33:0/2013203479 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9b740707a0 con 0x7f9b7406d7d0 2024-05-08T10:55:51.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.417+0000 7f9b6affd640 1 -- 172.21.15.33:0/2013203479 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+16681 (secure 0 0 0) 0x7f9b700588f0 con 0x7f9b7406d7d0 2024-05-08T10:55:51.414 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:55:51.414 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":31,"fsid":"963217b2-c375-4f5a-95cf-88e199dd38ff","created":"2024-05-08T10:54:26.711528+0000","modified":"2024-05-08T10:55:32.960990+0000","last_up_change":"2024-05-08T10:54:37.987478+0000","last_in_change":"2024-05-08T10:54:28.834106+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T10:54:38.989228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-05-08T10:55:29.133374+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-05-08T10:55:30.307270+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c5da4fb5-d4f2-4982-a804-2aa92fe77731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3990629207},{"type":"v1","addr":"172.21.15.33:6817","nonce":3990629207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3990629207},{"type":"v1","addr":"172.21.15.33:6819","nonce":3990629207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3990629207},{"type":"v1","addr":"172.21.15.33:6823","nonce":3990629207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3990629207},{"type":"v1","addr":"172.21.15.33:6821","nonce":3990629207}]},"public_addr":"172.21.15.33:6817/3990629207","cluster_addr":"172.21.15.33:6819/3990629207","heartbeat_back_addr":"172.21.15.33:6823/3990629207","heartbeat_front_addr":"172.21.15.33:6821/3990629207","state":["exists","up"]},{"osd":1,"uuid":"f8fdd8db-c2a3-4d28-81f3-b30f44bea7c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":1758076090},{"type":"v1","addr":"172.21.15.33:6825","nonce":1758076090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":1758076090},{"type":"v1","addr":"172.21.15.33:6827","nonce":1758076090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":1758076090},{"type":"v1","addr":"172.21.15.33:6831","nonce":1758076090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":1758076090},{"type":"v1","addr":"172.21.15.33:6829","nonce":1758076090}]},"public_addr":"172.21.15.33:6825/1758076090","cluster_addr":"172.21.15.33:6827/1758076090","heartbeat_back_addr":"172.21.15.33:6831/1758076090","heartbeat_front_addr":"172.21.15.33:6829/1758076090","state":["exists","up"]},{"osd":2,"uuid":"87d465f3-b40f-48dd-bae2-4c67904d4828","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":2940853479},{"type":"v1","addr":"172.21.15.33:6801","nonce":2940853479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6803","nonce":2940853479},{"type":"v1","addr":"172.21.15.33:6805","nonce":2940853479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6811","nonce":2940853479},{"type":"v1","addr":"172.21.15.33:6813","nonce":2940853479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6807","nonce":2940853479},{"type":"v1","addr":"172.21.15.33:6809","nonce":2940853479}]},"public_addr":"172.21.15.33:6801/2940853479","cluster_addr":"172.21.15.33:6805/2940853479","heartbeat_back_addr":"172.21.15.33:6813/2940853479","heartbeat_front_addr":"172.21.15.33:6809/2940853479","state":["exists","up"]},{"osd":3,"uuid":"79450edf-9637-4181-9372-e1cd5e91e73e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":4029047077},{"type":"v1","addr":"172.21.15.33:6804","nonce":4029047077}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":4029047077},{"type":"v1","addr":"172.21.15.33:6808","nonce":4029047077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":4029047077},{"type":"v1","addr":"172.21.15.33:6815","nonce":4029047077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":4029047077},{"type":"v1","addr":"172.21.15.33:6812","nonce":4029047077}]},"public_addr":"172.21.15.33:6804/4029047077","cluster_addr":"172.21.15.33:6808/4029047077","heartbeat_back_addr":"172.21.15.33:6815/4029047077","heartbeat_front_addr":"172.21.15.33:6812/4029047077","state":["exists","up"]},{"osd":4,"uuid":"bd0debfa-e559-4b1e-920d-6b2639c7085e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":1697399220},{"type":"v1","addr":"172.21.15.174:6801","nonce":1697399220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":1697399220},{"type":"v1","addr":"172.21.15.174:6803","nonce":1697399220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":1697399220},{"type":"v1","addr":"172.21.15.174:6807","nonce":1697399220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":1697399220},{"type":"v1","addr":"172.21.15.174:6805","nonce":1697399220}]},"public_addr":"172.21.15.174:6801/1697399220","cluster_addr":"172.21.15.174:6803/1697399220","heartbeat_back_addr":"172.21.15.174:6807/1697399220","heartbeat_front_addr":"172.21.15.174:6805/1697399220","state":["exists","up"]},{"osd":5,"uuid":"ff0f51c0-672b-448f-9de1-b9305ce8c00d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":1511860729},{"type":"v1","addr":"172.21.15.174:6825","nonce":1511860729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":1511860729},{"type":"v1","addr":"172.21.15.174:6827","nonce":1511860729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":1511860729},{"type":"v1","addr":"172.21.15.174:6831","nonce":1511860729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":1511860729},{"type":"v1","addr":"172.21.15.174:6829","nonce":1511860729}]},"public_addr":"172.21.15.174:6825/1511860729","cluster_addr":"172.21.15.174:6827/1511860729","heartbeat_back_addr":"172.21.15.174:6831/1511860729","heartbeat_front_addr":"172.21.15.174:6829/1511860729","state":["exists","up"]},{"osd":6,"uuid":"93061f6c-c0ce-47e9-88a0-1151c5ccb4e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":2326407945},{"type":"v1","addr":"172.21.15.174:6817","nonce":2326407945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":2326407945},{"type":"v1","addr":"172.21.15.174:6819","nonce":2326407945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":2326407945},{"type":"v1","addr":"172.21.15.174:6823","nonce":2326407945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":2326407945},{"type":"v1","addr":"172.21.15.174:6821","nonce":2326407945}]},"public_addr":"172.21.15.174:6817/2326407945","cluster_addr":"172.21.15.174:6819/2326407945","heartbeat_back_addr":"172.21.15.174:6823/2326407945","heartbeat_front_addr":"172.21.15.174:6821/2326407945","state":["exists","up"]},{"osd":7,"uuid":"7be1dcf3-1957-4ec3-bacf-f5f9fff580a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":1637570253},{"type":"v1","addr":"172.21.15.174:6809","nonce":1637570253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":1637570253},{"type":"v1","addr":"172.21.15.174:6811","nonce":1637570253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":1637570253},{"type":"v1","addr":"172.21.15.174:6815","nonce":1637570253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":1637570253},{"type":"v1","addr":"172.21.15.174:6813","nonce":1637570253}]},"public_addr":"172.21.15.174:6809/1637570253","cluster_addr":"172.21.15.174:6811/1637570253","heartbeat_back_addr":"172.21.15.174:6815/1637570253","heartbeat_front_addr":"172.21.15.174:6813/1637570253","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:33.997709+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:34.016568+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:33.990484+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:33.980666+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:33.920609+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:34.005069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:34.018345+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:34.061646+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T10:55:51.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.419+0000 7f9b7c2ee640 1 -- 172.21.15.33:0/2013203479 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f9b5806b4d0 msgr2=0x7f9b5806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:51.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.419+0000 7f9b7c2ee640 1 --2- 172.21.15.33:0/2013203479 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f9b5806b4d0 0x7f9b5806d990 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f9b7415d420 tx=0x7f9b64008040 comp rx=0 tx=0).stop 2024-05-08T10:55:51.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.419+0000 7f9b7c2ee640 1 -- 172.21.15.33:0/2013203479 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9b7406d7d0 msgr2=0x7f9b74151410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:51.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.419+0000 7f9b7c2ee640 1 --2- 172.21.15.33:0/2013203479 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9b7406d7d0 0x7f9b74151410 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f9b7000c7f0 tx=0x7f9b7000cbf0 comp rx=0 tx=0).stop 2024-05-08T10:55:51.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.419+0000 7f9b7c2ee640 1 -- 172.21.15.33:0/2013203479 shutdown_connections 2024-05-08T10:55:51.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.419+0000 7f9b7c2ee640 1 --2- 172.21.15.33:0/2013203479 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f9b5806b4d0 0x7f9b5806d990 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:51.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.419+0000 7f9b7c2ee640 1 --2- 172.21.15.33:0/2013203479 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9b740cc290 0x7f9b741e4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:51.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.419+0000 7f9b7c2ee640 1 --2- 172.21.15.33:0/2013203479 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9b74072110 0x7f9b740ad840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:51.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.419+0000 7f9b7c2ee640 1 --2- 172.21.15.33:0/2013203479 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9b7406d7d0 0x7f9b74151410 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:51.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.419+0000 7f9b7c2ee640 1 -- 172.21.15.33:0/2013203479 >> 172.21.15.33:0/2013203479 conn(0x7f9b7406aba0 msgr2=0x7f9b7415e290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:51.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.419+0000 7f9b7c2ee640 1 -- 172.21.15.33:0/2013203479 shutdown_connections 2024-05-08T10:55:51.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.419+0000 7f9b7c2ee640 1 -- 172.21.15.33:0/2013203479 wait complete. 2024-05-08T10:55:51.428 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-08T10:55:51.428 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T10:55:51.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.534+0000 7f4a796ac640 1 Processor -- start 2024-05-08T10:55:51.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.534+0000 7f4a796ac640 1 -- start start 2024-05-08T10:55:51.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.535+0000 7f4a796ac640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f4a740b4c60 0x7f4a7415e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:51.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.535+0000 7f4a796ac640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a740d4910 con 0x7f4a740d0920 2024-05-08T10:55:51.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.535+0000 7f4a796ac640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a740d25e0 con 0x7f4a740d0540 2024-05-08T10:55:51.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.535+0000 7f4a796ac640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a740d46c0 con 0x7f4a740b4c60 2024-05-08T10:55:51.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.535+0000 7f4a727fc640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f4a740d0920 0x7f4a740ce7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:50708/0 (socket says 172.21.15.33:50708) 2024-05-08T10:55:51.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.535+0000 7f4a727fc640 1 -- 172.21.15.33:0/1896117377 learned_addr learned my addr 172.21.15.33:0/1896117377 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-05-08T10:55:51.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.536+0000 7f4a737fe640 1 --2- 172.21.15.33:0/1896117377 >> v2:172.21.15.174:3300/0 conn(0x7f4a740b4c60 0x7f4a7415e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:51.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.536+0000 7f4a71ffb640 1 -- 172.21.15.33:0/1896117377 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2519232234 0 0) 0x7f4a740d4910 con 0x7f4a740d0920 2024-05-08T10:55:51.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.536+0000 7f4a71ffb640 1 -- 172.21.15.33:0/1896117377 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a60003520 con 0x7f4a740d0920 2024-05-08T10:55:51.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.536+0000 7f4a71ffb640 1 -- 172.21.15.33:0/1896117377 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 504129455 0 0) 0x7f4a60003520 con 0x7f4a740d0920 2024-05-08T10:55:51.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.536+0000 7f4a737fe640 1 -- 172.21.15.33:0/1896117377 >> v1:172.21.15.174:6789/0 conn(0x7f4a740d0540 legacy=0x7f4a7415dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:51.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.536+0000 7f4a737fe640 1 -- 172.21.15.33:0/1896117377 >> v1:172.21.15.33:6789/0 conn(0x7f4a740d0920 legacy=0x7f4a740ce7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:51.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.536+0000 7f4a737fe640 1 -- 172.21.15.33:0/1896117377 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a740b4730 con 0x7f4a740b4c60 2024-05-08T10:55:51.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.537+0000 7f4a737fe640 1 --2- 172.21.15.33:0/1896117377 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4a740b4c60 0x7f4a7415e2e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c0097a0 tx=0x7f4a6c02a0a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c615ed9b7af09d20 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:51.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.537+0000 7f4a71ffb640 1 -- 172.21.15.33:0/1896117377 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a6c037070 con 0x7f4a740b4c60 2024-05-08T10:55:51.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.537+0000 7f4a71ffb640 1 -- 172.21.15.33:0/1896117377 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a6c02ab30 con 0x7f4a740b4c60 2024-05-08T10:55:51.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.537+0000 7f4a71ffb640 1 -- 172.21.15.33:0/1896117377 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a5c001670 con 0x7f4a740b4c60 2024-05-08T10:55:51.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.538+0000 7f4a796ac640 1 -- 172.21.15.33:0/1896117377 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4a740b4c60 msgr2=0x7f4a7415e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:51.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.538+0000 7f4a796ac640 1 --2- 172.21.15.33:0/1896117377 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4a740b4c60 0x7f4a7415e2e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c0097a0 tx=0x7f4a6c02a0a0 comp rx=0 tx=0).stop 2024-05-08T10:55:51.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.538+0000 7f4a796ac640 1 -- 172.21.15.33:0/1896117377 shutdown_connections 2024-05-08T10:55:51.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.538+0000 7f4a796ac640 1 --2- 172.21.15.33:0/1896117377 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4a740b4c60 0x7f4a7415e2e0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:51.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.538+0000 7f4a796ac640 1 -- 172.21.15.33:0/1896117377 >> 172.21.15.33:0/1896117377 conn(0x7f4a740d3ba0 msgr2=0x7f4a740d3fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:51.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.538+0000 7f4a796ac640 1 -- 172.21.15.33:0/1896117377 shutdown_connections 2024-05-08T10:55:51.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.538+0000 7f4a796ac640 1 -- 172.21.15.33:0/1896117377 wait complete. 2024-05-08T10:55:51.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.539+0000 7f4a796ac640 1 Processor -- start 2024-05-08T10:55:51.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.539+0000 7f4a796ac640 1 -- start start 2024-05-08T10:55:51.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.540+0000 7f4a796ac640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4a740b4c60 0x7f4a741f33a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:51.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.540+0000 7f4a796ac640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4a740d0540 0x7f4a740b8d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:51.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.540+0000 7f4a796ac640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a740d0920 0x7f4a7409f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:51.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.540+0000 7f4a796ac640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a740d2950 con 0x7f4a740d0920 2024-05-08T10:55:51.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.540+0000 7f4a796ac640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a740d2390 con 0x7f4a740b4c60 2024-05-08T10:55:51.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.540+0000 7f4a796ac640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a740ceec0 con 0x7f4a740d0540 2024-05-08T10:55:51.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.540+0000 7f4a737fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a740d0920 0x7f4a7409f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:51.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.540+0000 7f4a737fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a740d0920 0x7f4a7409f6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37238/0 (socket says 172.21.15.33:37238) 2024-05-08T10:55:51.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.540+0000 7f4a737fe640 1 -- 172.21.15.33:0/2172465463 learned_addr learned my addr 172.21.15.33:0/2172465463 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:51.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.540+0000 7f4a727fc640 1 --2- 172.21.15.33:0/2172465463 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4a740d0540 0x7f4a740b8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:51.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.540+0000 7f4a72ffd640 1 --2- 172.21.15.33:0/2172465463 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4a740b4c60 0x7f4a741f33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:51.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.540+0000 7f4a737fe640 1 -- 172.21.15.33:0/2172465463 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4a740d0540 msgr2=0x7f4a740b8d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:51.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.540+0000 7f4a737fe640 1 --2- 172.21.15.33:0/2172465463 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4a740d0540 0x7f4a740b8d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:51.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.540+0000 7f4a737fe640 1 -- 172.21.15.33:0/2172465463 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4a740b4c60 msgr2=0x7f4a741f33a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:51.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.540+0000 7f4a737fe640 1 --2- 172.21.15.33:0/2172465463 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4a740b4c60 0x7f4a741f33a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:51.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.540+0000 7f4a737fe640 1 -- 172.21.15.33:0/2172465463 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a741594e0 con 0x7f4a740d0920 2024-05-08T10:55:51.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.540+0000 7f4a72ffd640 1 --2- 172.21.15.33:0/2172465463 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4a740b4c60 0x7f4a741f33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:55:51.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.540+0000 7f4a727fc640 1 --2- 172.21.15.33:0/2172465463 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4a740d0540 0x7f4a740b8d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:55:51.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.541+0000 7f4a737fe640 1 --2- 172.21.15.33:0/2172465463 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a740d0920 0x7f4a7409f6a0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c0097a0 tx=0x7f4a6c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:51.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.541+0000 7f4a6b7fe640 1 -- 172.21.15.33:0/2172465463 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a6c042020 con 0x7f4a740d0920 2024-05-08T10:55:51.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.541+0000 7f4a6b7fe640 1 -- 172.21.15.33:0/2172465463 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a6c003a40 con 0x7f4a740d0920 2024-05-08T10:55:51.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.541+0000 7f4a796ac640 1 -- 172.21.15.33:0/2172465463 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a740b9890 con 0x7f4a740d0920 2024-05-08T10:55:51.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.541+0000 7f4a6b7fe640 1 -- 172.21.15.33:0/2172465463 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a6c037040 con 0x7f4a740d0920 2024-05-08T10:55:51.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.541+0000 7f4a796ac640 1 -- 172.21.15.33:0/2172465463 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a7409e960 con 0x7f4a740d0920 2024-05-08T10:55:51.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.542+0000 7f4a796ac640 1 -- 172.21.15.33:0/2172465463 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a74067440 con 0x7f4a740d0920 2024-05-08T10:55:51.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.542+0000 7f4a6b7fe640 1 -- 172.21.15.33:0/2172465463 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4a6c045020 con 0x7f4a740d0920 2024-05-08T10:55:51.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.543+0000 7f4a6b7fe640 1 --2- 172.21.15.33:0/2172465463 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f4a5406b4d0 0x7f4a5406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:51.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.543+0000 7f4a6b7fe640 1 -- 172.21.15.33:0/2172465463 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4a6c0aa8a0 con 0x7f4a740d0920 2024-05-08T10:55:51.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.543+0000 7f4a72ffd640 1 --2- 172.21.15.33:0/2172465463 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f4a5406b4d0 0x7f4a5406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:51.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.543+0000 7f4a72ffd640 1 --2- 172.21.15.33:0/2172465463 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f4a5406b4d0 0x7f4a5406d990 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4a640012e0 tx=0x7f4a64009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:51.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.547+0000 7f4a6b7fe640 1 -- 172.21.15.33:0/2172465463 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4a6c04c030 con 0x7f4a740d0920 2024-05-08T10:55:51.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.765+0000 7f4a796ac640 1 -- 172.21.15.33:0/2172465463 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4a74069d20 con 0x7f4a740d0920 2024-05-08T10:55:51.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.765+0000 7f4a6b7fe640 1 -- 172.21.15.33:0/2172465463 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4941 (secure 0 0 0) 0x7f4a741594e0 con 0x7f4a740d0920 2024-05-08T10:55:51.763 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:55:51.763 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4592,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6836/2731663891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2731663891},{"type":"v1","addr":"172.21.15.174:6836","nonce":2731663891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":4598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/2004985147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6833","nonce":2004985147},{"type":"v1","addr":"172.21.15.33:6835","nonce":2004985147}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4702,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6837/3164144740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6835","nonce":3164144740},{"type":"v1","addr":"172.21.15.174:6837","nonce":3164144740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T10:55:31.311811+0000","modified":"2024-05-08T10:55:33.333600+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4708},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4708":{"gid":4708,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.33:6834/415400390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":415400390},{"type":"v1","addr":"172.21.15.33:6834","nonce":415400390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-05-08T10:55:51.763 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 14 2024-05-08T10:55:51.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.767+0000 7f4a796ac640 1 -- 172.21.15.33:0/2172465463 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f4a5406b4d0 msgr2=0x7f4a5406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:51.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.767+0000 7f4a796ac640 1 --2- 172.21.15.33:0/2172465463 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f4a5406b4d0 0x7f4a5406d990 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4a640012e0 tx=0x7f4a64009040 comp rx=0 tx=0).stop 2024-05-08T10:55:51.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.767+0000 7f4a796ac640 1 -- 172.21.15.33:0/2172465463 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a740d0920 msgr2=0x7f4a7409f6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:51.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.767+0000 7f4a796ac640 1 --2- 172.21.15.33:0/2172465463 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a740d0920 0x7f4a7409f6a0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c0097a0 tx=0x7f4a6c0046c0 comp rx=0 tx=0).stop 2024-05-08T10:55:51.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.767+0000 7f4a796ac640 1 -- 172.21.15.33:0/2172465463 shutdown_connections 2024-05-08T10:55:51.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.767+0000 7f4a796ac640 1 --2- 172.21.15.33:0/2172465463 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f4a5406b4d0 0x7f4a5406d990 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:51.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.767+0000 7f4a796ac640 1 --2- 172.21.15.33:0/2172465463 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a740d0920 0x7f4a7409f6a0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:51.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.767+0000 7f4a796ac640 1 --2- 172.21.15.33:0/2172465463 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4a740d0540 0x7f4a740b8d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:51.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.767+0000 7f4a796ac640 1 --2- 172.21.15.33:0/2172465463 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4a740b4c60 0x7f4a741f33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:51.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.767+0000 7f4a796ac640 1 -- 172.21.15.33:0/2172465463 >> 172.21.15.33:0/2172465463 conn(0x7f4a740d3ba0 msgr2=0x7f4a740ce770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:51.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.767+0000 7f4a796ac640 1 -- 172.21.15.33:0/2172465463 shutdown_connections 2024-05-08T10:55:51.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.767+0000 7f4a796ac640 1 -- 172.21.15.33:0/2172465463 wait complete. 2024-05-08T10:55:51.776 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T10:55:51.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.882+0000 7fbdd5f55640 1 Processor -- start 2024-05-08T10:55:51.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.882+0000 7fbdd5f55640 1 -- start start 2024-05-08T10:55:51.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.882+0000 7fbdd5f55640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbdd015df80 0x7fbdd01619d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:51.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.883+0000 7fbdd5f55640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdd00d0b80 con 0x7fbdd006c830 2024-05-08T10:55:51.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.883+0000 7fbdd5f55640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdd006bd50 con 0x7fbdd00d0610 2024-05-08T10:55:51.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.883+0000 7fbdd5f55640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd006c3a0 con 0x7fbdd015df80 2024-05-08T10:55:51.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.883+0000 7fbdcffff640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fbdd006c830 0x7fbdd006ccc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:50712/0 (socket says 172.21.15.33:50712) 2024-05-08T10:55:51.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.883+0000 7fbdcffff640 1 -- 172.21.15.33:0/671574994 learned_addr learned my addr 172.21.15.33:0/671574994 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-05-08T10:55:51.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.883+0000 7fbdcf7fe640 1 --2- 172.21.15.33:0/671574994 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbdd015df80 0x7fbdd01619d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:51.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.883+0000 7fbdce7fc640 1 -- 172.21.15.33:0/671574994 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2762296869 0 0) 0x7fbdd00d0b80 con 0x7fbdd006c830 2024-05-08T10:55:51.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.883+0000 7fbdce7fc640 1 -- 172.21.15.33:0/671574994 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbdb8003520 con 0x7fbdd006c830 2024-05-08T10:55:51.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.883+0000 7fbdce7fc640 1 -- 172.21.15.33:0/671574994 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 982259237 0 0) 0x7fbdb8003520 con 0x7fbdd006c830 2024-05-08T10:55:51.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.883+0000 7fbdce7fc640 1 -- 172.21.15.33:0/671574994 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbdd015df80 msgr2=0x7fbdd01619d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:51.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.883+0000 7fbdce7fc640 1 --2- 172.21.15.33:0/671574994 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbdd015df80 0x7fbdd01619d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:51.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.883+0000 7fbdce7fc640 1 -- 172.21.15.33:0/671574994 >> v1:172.21.15.174:6789/0 conn(0x7fbdd00d0610 legacy=0x7fbdd0161f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:51.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.883+0000 7fbdce7fc640 1 -- 172.21.15.33:0/671574994 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdd006c030 con 0x7fbdd006c830 2024-05-08T10:55:51.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.883+0000 7fbdce7fc640 1 -- 172.21.15.33:0/671574994 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2948294915 0 0) 0x7fbdc80019f0 con 0x7fbdd006c830 2024-05-08T10:55:51.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.883+0000 7fbdce7fc640 1 -- 172.21.15.33:0/671574994 >> v1:172.21.15.33:6789/0 conn(0x7fbdd006c830 legacy=0x7fbdd006ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:51.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.883+0000 7fbdce7fc640 1 --2- 172.21.15.33:0/671574994 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbdd015df80 0x7fbdb80039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:51.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.883+0000 7fbdce7fc640 1 --2- 172.21.15.33:0/671574994 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbdb8003f20 0x7fbdb8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:51.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.883+0000 7fbdce7fc640 1 --2- 172.21.15.33:0/671574994 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbdb8004d40 0x7fbdb80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:51.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.883+0000 7fbdce7fc640 1 -- 172.21.15.33:0/671574994 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd006c3a0 con 0x7fbdb8003f20 2024-05-08T10:55:51.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.883+0000 7fbdce7fc640 1 -- 172.21.15.33:0/671574994 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdb800ba20 con 0x7fbdb8004d40 2024-05-08T10:55:51.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.883+0000 7fbdce7fc640 1 -- 172.21.15.33:0/671574994 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdb800bc20 con 0x7fbdd015df80 2024-05-08T10:55:51.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.884+0000 7fbdceffd640 1 --2- 172.21.15.33:0/671574994 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbdb8003f20 0x7fbdb8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:51.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.884+0000 7fbdcf7fe640 1 --2- 172.21.15.33:0/671574994 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbdd015df80 0x7fbdb80039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:51.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.884+0000 7fbdcffff640 1 --2- 172.21.15.33:0/671574994 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbdb8004d40 0x7fbdb80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:51.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.884+0000 7fbdceffd640 1 -- 172.21.15.33:0/671574994 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbdd015df80 msgr2=0x7fbdb80039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:51.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.884+0000 7fbdceffd640 1 --2- 172.21.15.33:0/671574994 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbdd015df80 0x7fbdb80039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:51.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.884+0000 7fbdceffd640 1 -- 172.21.15.33:0/671574994 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbdb8004d40 msgr2=0x7fbdb80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:51.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.884+0000 7fbdceffd640 1 --2- 172.21.15.33:0/671574994 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbdb8004d40 0x7fbdb80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:51.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.884+0000 7fbdceffd640 1 -- 172.21.15.33:0/671574994 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdb8003520 con 0x7fbdb8003f20 2024-05-08T10:55:51.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.885+0000 7fbdceffd640 1 --2- 172.21.15.33:0/671574994 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbdb8003f20 0x7fbdb8004800 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fbdc4001860 tx=0x7fbdb8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b25a540ec722bd79 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:51.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.885+0000 7fbdce7fc640 1 -- 172.21.15.33:0/671574994 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc4037070 con 0x7fbdb8003f20 2024-05-08T10:55:51.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.885+0000 7fbdce7fc640 1 -- 172.21.15.33:0/671574994 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdc402ab60 con 0x7fbdb8003f20 2024-05-08T10:55:51.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.885+0000 7fbdce7fc640 1 -- 172.21.15.33:0/671574994 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc4001430 con 0x7fbdb8003f20 2024-05-08T10:55:51.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.885+0000 7fbdd5f55640 1 -- 172.21.15.33:0/671574994 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbdb8003f20 msgr2=0x7fbdb8004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:51.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.885+0000 7fbdd5f55640 1 --2- 172.21.15.33:0/671574994 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbdb8003f20 0x7fbdb8004800 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fbdc4001860 tx=0x7fbdb8005830 comp rx=0 tx=0).stop 2024-05-08T10:55:51.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.885+0000 7fbdcffff640 1 -- 172.21.15.33:0/671574994 reap_dead start 2024-05-08T10:55:51.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.885+0000 7fbdd5f55640 1 -- 172.21.15.33:0/671574994 shutdown_connections 2024-05-08T10:55:51.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.885+0000 7fbdd5f55640 1 -- 172.21.15.33:0/671574994 >> 172.21.15.33:0/671574994 conn(0x7fbdd00d19b0 msgr2=0x7fbdd00d1dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:51.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.885+0000 7fbdd5f55640 1 -- 172.21.15.33:0/671574994 shutdown_connections 2024-05-08T10:55:51.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.885+0000 7fbdd5f55640 1 -- 172.21.15.33:0/671574994 wait complete. 2024-05-08T10:55:51.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.887+0000 7fbdd5f55640 1 Processor -- start 2024-05-08T10:55:51.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.887+0000 7fbdd5f55640 1 -- start start 2024-05-08T10:55:51.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.887+0000 7fbdd5f55640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbdb8003f20 0x7fbdd0158b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:51.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.887+0000 7fbdd5f55640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbdd00b23b0 0x7fbdd00c7c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:51.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.887+0000 7fbdd5f55640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbdd00b3470 0x7fbdd00b38f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:51.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.887+0000 7fbdd5f55640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd006fa90 con 0x7fbdd00b23b0 2024-05-08T10:55:51.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.887+0000 7fbdd5f55640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd006f910 con 0x7fbdb8003f20 2024-05-08T10:55:51.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.887+0000 7fbdd5f55640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd0162620 con 0x7fbdd00b3470 2024-05-08T10:55:51.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.888+0000 7fbdceffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbdd00b23b0 0x7fbdd00c7c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:51.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.888+0000 7fbdceffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbdd00b23b0 0x7fbdd00c7c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37252/0 (socket says 172.21.15.33:37252) 2024-05-08T10:55:51.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.888+0000 7fbdceffd640 1 -- 172.21.15.33:0/3067839906 learned_addr learned my addr 172.21.15.33:0/3067839906 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:51.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.888+0000 7fbdcf7fe640 1 --2- 172.21.15.33:0/3067839906 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbdb8003f20 0x7fbdd0158b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:51.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.888+0000 7fbdcffff640 1 --2- 172.21.15.33:0/3067839906 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbdd00b3470 0x7fbdd00b38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:51.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.888+0000 7fbdceffd640 1 -- 172.21.15.33:0/3067839906 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbdd00b3470 msgr2=0x7fbdd00b38f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:51.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.888+0000 7fbdceffd640 1 --2- 172.21.15.33:0/3067839906 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbdd00b3470 0x7fbdd00b38f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:51.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.888+0000 7fbdceffd640 1 -- 172.21.15.33:0/3067839906 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbdb8003f20 msgr2=0x7fbdd0158b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:51.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.888+0000 7fbdceffd640 1 --2- 172.21.15.33:0/3067839906 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbdb8003f20 0x7fbdd0158b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:51.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.888+0000 7fbdceffd640 1 -- 172.21.15.33:0/3067839906 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdd00c5f30 con 0x7fbdd00b23b0 2024-05-08T10:55:51.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.888+0000 7fbdcf7fe640 1 --2- 172.21.15.33:0/3067839906 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbdb8003f20 0x7fbdd0158b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:55:51.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.888+0000 7fbdceffd640 1 --2- 172.21.15.33:0/3067839906 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbdd00b23b0 0x7fbdd00c7c00 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fbdc40018c0 tx=0x7fbdc4001230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:51.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.888+0000 7fbdb7fff640 1 -- 172.21.15.33:0/3067839906 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc403f020 con 0x7fbdd00b23b0 2024-05-08T10:55:51.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.888+0000 7fbdb7fff640 1 -- 172.21.15.33:0/3067839906 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdc4005270 con 0x7fbdd00b23b0 2024-05-08T10:55:51.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.888+0000 7fbdd5f55640 1 -- 172.21.15.33:0/3067839906 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdd00c6210 con 0x7fbdd00b23b0 2024-05-08T10:55:51.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.888+0000 7fbdb7fff640 1 -- 172.21.15.33:0/3067839906 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc4037040 con 0x7fbdd00b23b0 2024-05-08T10:55:51.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.888+0000 7fbdd5f55640 1 -- 172.21.15.33:0/3067839906 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdd00c67d0 con 0x7fbdd00b23b0 2024-05-08T10:55:51.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.889+0000 7fbdd5f55640 1 -- 172.21.15.33:0/3067839906 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdd0069d20 con 0x7fbdd00b23b0 2024-05-08T10:55:51.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.890+0000 7fbdb7fff640 1 -- 172.21.15.33:0/3067839906 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fbdc4042020 con 0x7fbdd00b23b0 2024-05-08T10:55:51.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.890+0000 7fbdb7fff640 1 --2- 172.21.15.33:0/3067839906 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fbdbc06b500 0x7fbdbc06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:51.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.890+0000 7fbdb7fff640 1 -- 172.21.15.33:0/3067839906 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbdc40aa060 con 0x7fbdd00b23b0 2024-05-08T10:55:51.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.891+0000 7fbdcf7fe640 1 --2- 172.21.15.33:0/3067839906 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fbdbc06b500 0x7fbdbc06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:51.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.891+0000 7fbdcf7fe640 1 --2- 172.21.15.33:0/3067839906 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fbdbc06b500 0x7fbdbc06d9c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fbdc0009ab0 tx=0x7fbdc0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:51.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:51.895+0000 7fbdb7fff640 1 -- 172.21.15.33:0/3067839906 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fbdc4049030 con 0x7fbdd00b23b0 2024-05-08T10:55:52.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.113+0000 7fbdd5f55640 1 -- 172.21.15.33:0/3067839906 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbdd015c340 con 0x7fbdd00b23b0 2024-05-08T10:55:52.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.114+0000 7fbdb7fff640 1 -- 172.21.15.33:0/3067839906 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4941 (secure 0 0 0) 0x7fbdc4078e40 con 0x7fbdd00b23b0 2024-05-08T10:55:52.111 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:55:52.112 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4592,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6836/2731663891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2731663891},{"type":"v1","addr":"172.21.15.174:6836","nonce":2731663891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":4598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/2004985147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6833","nonce":2004985147},{"type":"v1","addr":"172.21.15.33:6835","nonce":2004985147}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4702,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6837/3164144740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6835","nonce":3164144740},{"type":"v1","addr":"172.21.15.174:6837","nonce":3164144740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T10:55:31.311811+0000","modified":"2024-05-08T10:55:33.333600+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4708},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4708":{"gid":4708,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.33:6834/415400390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":415400390},{"type":"v1","addr":"172.21.15.33:6834","nonce":415400390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-05-08T10:55:52.112 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 14 2024-05-08T10:55:52.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.116+0000 7fbdd5f55640 1 -- 172.21.15.33:0/3067839906 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fbdbc06b500 msgr2=0x7fbdbc06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:52.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.116+0000 7fbdd5f55640 1 --2- 172.21.15.33:0/3067839906 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fbdbc06b500 0x7fbdbc06d9c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fbdc0009ab0 tx=0x7fbdc0008040 comp rx=0 tx=0).stop 2024-05-08T10:55:52.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.116+0000 7fbdd5f55640 1 -- 172.21.15.33:0/3067839906 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbdd00b23b0 msgr2=0x7fbdd00c7c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:52.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.116+0000 7fbdd5f55640 1 --2- 172.21.15.33:0/3067839906 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbdd00b23b0 0x7fbdd00c7c00 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fbdc40018c0 tx=0x7fbdc4001230 comp rx=0 tx=0).stop 2024-05-08T10:55:52.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.116+0000 7fbdd5f55640 1 -- 172.21.15.33:0/3067839906 shutdown_connections 2024-05-08T10:55:52.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.116+0000 7fbdd5f55640 1 --2- 172.21.15.33:0/3067839906 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fbdbc06b500 0x7fbdbc06d9c0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:52.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.116+0000 7fbdd5f55640 1 --2- 172.21.15.33:0/3067839906 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbdd00b3470 0x7fbdd00b38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:52.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.116+0000 7fbdd5f55640 1 --2- 172.21.15.33:0/3067839906 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbdd00b23b0 0x7fbdd00c7c00 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:52.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.116+0000 7fbdd5f55640 1 --2- 172.21.15.33:0/3067839906 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbdb8003f20 0x7fbdd0158b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:52.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.116+0000 7fbdd5f55640 1 -- 172.21.15.33:0/3067839906 >> 172.21.15.33:0/3067839906 conn(0x7fbdd00d19b0 msgr2=0x7fbdd015bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:52.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.116+0000 7fbdd5f55640 1 -- 172.21.15.33:0/3067839906 shutdown_connections 2024-05-08T10:55:52.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.116+0000 7fbdd5f55640 1 -- 172.21.15.33:0/3067839906 wait complete. 2024-05-08T10:55:52.125 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T10:55:52.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.231+0000 7f088970a640 1 Processor -- start 2024-05-08T10:55:52.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.231+0000 7f088970a640 1 -- start start 2024-05-08T10:55:52.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.232+0000 7f088970a640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f088415dfb0 0x7f08840d13a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:52.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.232+0000 7f088970a640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0884071730 con 0x7f0884071f80 2024-05-08T10:55:52.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.232+0000 7f088970a640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0884071a10 con 0x7f088406b2b0 2024-05-08T10:55:52.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.232+0000 7f088970a640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0884071cf0 con 0x7f088415dfb0 2024-05-08T10:55:52.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.232+0000 7f08827fc640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f0884071f80 0x7f088406aba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:50724/0 (socket says 172.21.15.33:50724) 2024-05-08T10:55:52.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.232+0000 7f08827fc640 1 -- 172.21.15.33:0/4060950543 learned_addr learned my addr 172.21.15.33:0/4060950543 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-05-08T10:55:52.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.232+0000 7f0882ffd640 1 --2- 172.21.15.33:0/4060950543 >> v2:172.21.15.174:3300/0 conn(0x7f088415dfb0 0x7f08840d13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:52.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.232+0000 7f0881ffb640 1 -- 172.21.15.33:0/4060950543 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 817593804 0 0) 0x7f0884071730 con 0x7f0884071f80 2024-05-08T10:55:52.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.232+0000 7f0881ffb640 1 -- 172.21.15.33:0/4060950543 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f086c003520 con 0x7f0884071f80 2024-05-08T10:55:52.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.233+0000 7f0881ffb640 1 -- 172.21.15.33:0/4060950543 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 542895000 0 0) 0x7f086c003520 con 0x7f0884071f80 2024-05-08T10:55:52.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.233+0000 7f0881ffb640 1 -- 172.21.15.33:0/4060950543 >> v2:172.21.15.174:3300/0 conn(0x7f088415dfb0 msgr2=0x7f08840d13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:52.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.233+0000 7f0881ffb640 1 --2- 172.21.15.33:0/4060950543 >> v2:172.21.15.174:3300/0 conn(0x7f088415dfb0 0x7f08840d13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:52.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.233+0000 7f0881ffb640 1 -- 172.21.15.33:0/4060950543 >> v1:172.21.15.174:6789/0 conn(0x7f088406b2b0 legacy=0x7f088406dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:52.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.233+0000 7f0881ffb640 1 -- 172.21.15.33:0/4060950543 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08840ce850 con 0x7f0884071f80 2024-05-08T10:55:52.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.233+0000 7f0881ffb640 1 -- 172.21.15.33:0/4060950543 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2948294915 0 0) 0x7f0878001670 con 0x7f0884071f80 2024-05-08T10:55:52.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.233+0000 7f0881ffb640 1 -- 172.21.15.33:0/4060950543 >> v1:172.21.15.33:6789/0 conn(0x7f0884071f80 legacy=0x7f088406aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:52.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.233+0000 7f0881ffb640 1 --2- 172.21.15.33:0/4060950543 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f086c0039b0 0x7f086c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:52.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.233+0000 7f0881ffb640 1 --2- 172.21.15.33:0/4060950543 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f086c0043b0 0x7f086c004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:52.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.233+0000 7f0881ffb640 1 --2- 172.21.15.33:0/4060950543 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f086c005080 0x7f086c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:52.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.233+0000 7f0881ffb640 1 -- 172.21.15.33:0/4060950543 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0884071cf0 con 0x7f086c0043b0 2024-05-08T10:55:52.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.233+0000 7f0881ffb640 1 -- 172.21.15.33:0/4060950543 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f086c00bfe0 con 0x7f086c0039b0 2024-05-08T10:55:52.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.233+0000 7f0881ffb640 1 -- 172.21.15.33:0/4060950543 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f086c00c1e0 con 0x7f086c005080 2024-05-08T10:55:52.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.233+0000 7f08827fc640 1 --2- 172.21.15.33:0/4060950543 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f086c0043b0 0x7f086c004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:52.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.233+0000 7f0882ffd640 1 --2- 172.21.15.33:0/4060950543 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f086c0039b0 0x7f086c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:52.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.233+0000 7f08837fe640 1 --2- 172.21.15.33:0/4060950543 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f086c005080 0x7f086c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:52.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.233+0000 7f08827fc640 1 -- 172.21.15.33:0/4060950543 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f086c005080 msgr2=0x7f086c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:52.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.233+0000 7f08827fc640 1 --2- 172.21.15.33:0/4060950543 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f086c005080 0x7f086c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:52.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.233+0000 7f08827fc640 1 -- 172.21.15.33:0/4060950543 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f086c0039b0 msgr2=0x7f086c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:52.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.233+0000 7f08827fc640 1 --2- 172.21.15.33:0/4060950543 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f086c0039b0 0x7f086c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:52.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.233+0000 7f08827fc640 1 -- 172.21.15.33:0/4060950543 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f086c003520 con 0x7f086c0043b0 2024-05-08T10:55:52.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.233+0000 7f08837fe640 1 -- 172.21.15.33:0/4060950543 reap_dead start 2024-05-08T10:55:52.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.234+0000 7f08827fc640 1 --2- 172.21.15.33:0/4060950543 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f086c0043b0 0x7f086c004880 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f087800c210 tx=0x7f086c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4fc3308bf07d6f9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:52.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.234+0000 7f0881ffb640 1 -- 172.21.15.33:0/4060950543 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0878007ce0 con 0x7f086c0043b0 2024-05-08T10:55:52.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.234+0000 7f0881ffb640 1 -- 172.21.15.33:0/4060950543 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0878005af0 con 0x7f086c0043b0 2024-05-08T10:55:52.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.234+0000 7f0881ffb640 1 -- 172.21.15.33:0/4060950543 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0878007070 con 0x7f086c0043b0 2024-05-08T10:55:52.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.235+0000 7f088970a640 1 -- 172.21.15.33:0/4060950543 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f086c0043b0 msgr2=0x7f086c004880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:52.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.235+0000 7f088970a640 1 --2- 172.21.15.33:0/4060950543 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f086c0043b0 0x7f086c004880 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f087800c210 tx=0x7f086c005830 comp rx=0 tx=0).stop 2024-05-08T10:55:52.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.235+0000 7f088970a640 1 -- 172.21.15.33:0/4060950543 shutdown_connections 2024-05-08T10:55:52.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.235+0000 7f088970a640 1 --2- 172.21.15.33:0/4060950543 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f086c0043b0 0x7f086c004880 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:52.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.235+0000 7f088970a640 1 -- 172.21.15.33:0/4060950543 >> 172.21.15.33:0/4060950543 conn(0x7f08840d08b0 msgr2=0x7f08840d0c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:52.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.235+0000 7f088970a640 1 -- 172.21.15.33:0/4060950543 shutdown_connections 2024-05-08T10:55:52.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.235+0000 7f088970a640 1 -- 172.21.15.33:0/4060950543 wait complete. 2024-05-08T10:55:52.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.236+0000 7f088970a640 1 Processor -- start 2024-05-08T10:55:52.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.236+0000 7f088970a640 1 -- start start 2024-05-08T10:55:52.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.237+0000 7f088970a640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f086c0043b0 0x7f088414dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:52.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.237+0000 7f088970a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f088415e420 0x7f0884147320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:52.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.237+0000 7f088970a640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f088415d450 0x7f08840b4900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:52.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.237+0000 7f088970a640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08840cf050 con 0x7f088415e420 2024-05-08T10:55:52.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.237+0000 7f088970a640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0884072700 con 0x7f086c0043b0 2024-05-08T10:55:52.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.237+0000 7f088970a640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08840cf1d0 con 0x7f088415d450 2024-05-08T10:55:52.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.237+0000 7f08827fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f088415e420 0x7f0884147320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:52.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.237+0000 7f08827fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f088415e420 0x7f0884147320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37258/0 (socket says 172.21.15.33:37258) 2024-05-08T10:55:52.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.237+0000 7f08827fc640 1 -- 172.21.15.33:0/798702828 learned_addr learned my addr 172.21.15.33:0/798702828 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:52.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.237+0000 7f0882ffd640 1 --2- 172.21.15.33:0/798702828 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f086c0043b0 0x7f088414dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:52.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.237+0000 7f08837fe640 1 --2- 172.21.15.33:0/798702828 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f088415d450 0x7f08840b4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:52.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.237+0000 7f08827fc640 1 -- 172.21.15.33:0/798702828 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f088415d450 msgr2=0x7f08840b4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:52.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.237+0000 7f08827fc640 1 --2- 172.21.15.33:0/798702828 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f088415d450 0x7f08840b4900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:52.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.237+0000 7f08827fc640 1 -- 172.21.15.33:0/798702828 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f086c0043b0 msgr2=0x7f088414dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:52.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.237+0000 7f08827fc640 1 --2- 172.21.15.33:0/798702828 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f086c0043b0 0x7f088414dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:52.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.237+0000 7f08827fc640 1 -- 172.21.15.33:0/798702828 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0884147860 con 0x7f088415e420 2024-05-08T10:55:52.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.237+0000 7f08827fc640 1 --2- 172.21.15.33:0/798702828 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f088415e420 0x7f0884147320 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f08780018f0 tx=0x7f0884071900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:52.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.238+0000 7f086b7fe640 1 -- 172.21.15.33:0/798702828 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0878040030 con 0x7f088415e420 2024-05-08T10:55:52.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.238+0000 7f086b7fe640 1 -- 172.21.15.33:0/798702828 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0878001470 con 0x7f088415e420 2024-05-08T10:55:52.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.238+0000 7f088970a640 1 -- 172.21.15.33:0/798702828 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f088414b230 con 0x7f088415e420 2024-05-08T10:55:52.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.238+0000 7f086b7fe640 1 -- 172.21.15.33:0/798702828 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0878037040 con 0x7f088415e420 2024-05-08T10:55:52.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.238+0000 7f088970a640 1 -- 172.21.15.33:0/798702828 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f088414b7f0 con 0x7f088415e420 2024-05-08T10:55:52.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.239+0000 7f088970a640 1 -- 172.21.15.33:0/798702828 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0884161770 con 0x7f088415e420 2024-05-08T10:55:52.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.239+0000 7f086b7fe640 1 -- 172.21.15.33:0/798702828 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0878043070 con 0x7f088415e420 2024-05-08T10:55:52.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.240+0000 7f086b7fe640 1 --2- 172.21.15.33:0/798702828 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f087006b4d0 0x7f087006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:52.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.240+0000 7f086b7fe640 1 -- 172.21.15.33:0/798702828 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f08780a9c90 con 0x7f088415e420 2024-05-08T10:55:52.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.240+0000 7f0882ffd640 1 --2- 172.21.15.33:0/798702828 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f087006b4d0 0x7f087006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:52.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.241+0000 7f0882ffd640 1 --2- 172.21.15.33:0/798702828 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f087006b4d0 0x7f087006d990 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0874014510 tx=0x7f087400b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:52.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.244+0000 7f086b7fe640 1 -- 172.21.15.33:0/798702828 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f08780784c0 con 0x7f088415e420 2024-05-08T10:55:52.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.425+0000 7f088970a640 1 -- 172.21.15.33:0/798702828 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0884069d20 con 0x7f088415e420 2024-05-08T10:55:52.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.426+0000 7f086b7fe640 1 -- 172.21.15.33:0/798702828 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+16681 (secure 0 0 0) 0x7f087807c560 con 0x7f088415e420 2024-05-08T10:55:52.424 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:55:52.424 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":31,"fsid":"963217b2-c375-4f5a-95cf-88e199dd38ff","created":"2024-05-08T10:54:26.711528+0000","modified":"2024-05-08T10:55:32.960990+0000","last_up_change":"2024-05-08T10:54:37.987478+0000","last_in_change":"2024-05-08T10:54:28.834106+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T10:54:38.989228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-05-08T10:55:29.133374+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-05-08T10:55:30.307270+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c5da4fb5-d4f2-4982-a804-2aa92fe77731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3990629207},{"type":"v1","addr":"172.21.15.33:6817","nonce":3990629207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3990629207},{"type":"v1","addr":"172.21.15.33:6819","nonce":3990629207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3990629207},{"type":"v1","addr":"172.21.15.33:6823","nonce":3990629207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3990629207},{"type":"v1","addr":"172.21.15.33:6821","nonce":3990629207}]},"public_addr":"172.21.15.33:6817/3990629207","cluster_addr":"172.21.15.33:6819/3990629207","heartbeat_back_addr":"172.21.15.33:6823/3990629207","heartbeat_front_addr":"172.21.15.33:6821/3990629207","state":["exists","up"]},{"osd":1,"uuid":"f8fdd8db-c2a3-4d28-81f3-b30f44bea7c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":1758076090},{"type":"v1","addr":"172.21.15.33:6825","nonce":1758076090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":1758076090},{"type":"v1","addr":"172.21.15.33:6827","nonce":1758076090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":1758076090},{"type":"v1","addr":"172.21.15.33:6831","nonce":1758076090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":1758076090},{"type":"v1","addr":"172.21.15.33:6829","nonce":1758076090}]},"public_addr":"172.21.15.33:6825/1758076090","cluster_addr":"172.21.15.33:6827/1758076090","heartbeat_back_addr":"172.21.15.33:6831/1758076090","heartbeat_front_addr":"172.21.15.33:6829/1758076090","state":["exists","up"]},{"osd":2,"uuid":"87d465f3-b40f-48dd-bae2-4c67904d4828","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":2940853479},{"type":"v1","addr":"172.21.15.33:6801","nonce":2940853479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6803","nonce":2940853479},{"type":"v1","addr":"172.21.15.33:6805","nonce":2940853479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6811","nonce":2940853479},{"type":"v1","addr":"172.21.15.33:6813","nonce":2940853479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6807","nonce":2940853479},{"type":"v1","addr":"172.21.15.33:6809","nonce":2940853479}]},"public_addr":"172.21.15.33:6801/2940853479","cluster_addr":"172.21.15.33:6805/2940853479","heartbeat_back_addr":"172.21.15.33:6813/2940853479","heartbeat_front_addr":"172.21.15.33:6809/2940853479","state":["exists","up"]},{"osd":3,"uuid":"79450edf-9637-4181-9372-e1cd5e91e73e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":4029047077},{"type":"v1","addr":"172.21.15.33:6804","nonce":4029047077}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":4029047077},{"type":"v1","addr":"172.21.15.33:6808","nonce":4029047077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":4029047077},{"type":"v1","addr":"172.21.15.33:6815","nonce":4029047077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":4029047077},{"type":"v1","addr":"172.21.15.33:6812","nonce":4029047077}]},"public_addr":"172.21.15.33:6804/4029047077","cluster_addr":"172.21.15.33:6808/4029047077","heartbeat_back_addr":"172.21.15.33:6815/4029047077","heartbeat_front_addr":"172.21.15.33:6812/4029047077","state":["exists","up"]},{"osd":4,"uuid":"bd0debfa-e559-4b1e-920d-6b2639c7085e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":1697399220},{"type":"v1","addr":"172.21.15.174:6801","nonce":1697399220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":1697399220},{"type":"v1","addr":"172.21.15.174:6803","nonce":1697399220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":1697399220},{"type":"v1","addr":"172.21.15.174:6807","nonce":1697399220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":1697399220},{"type":"v1","addr":"172.21.15.174:6805","nonce":1697399220}]},"public_addr":"172.21.15.174:6801/1697399220","cluster_addr":"172.21.15.174:6803/1697399220","heartbeat_back_addr":"172.21.15.174:6807/1697399220","heartbeat_front_addr":"172.21.15.174:6805/1697399220","state":["exists","up"]},{"osd":5,"uuid":"ff0f51c0-672b-448f-9de1-b9305ce8c00d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":1511860729},{"type":"v1","addr":"172.21.15.174:6825","nonce":1511860729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":1511860729},{"type":"v1","addr":"172.21.15.174:6827","nonce":1511860729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":1511860729},{"type":"v1","addr":"172.21.15.174:6831","nonce":1511860729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":1511860729},{"type":"v1","addr":"172.21.15.174:6829","nonce":1511860729}]},"public_addr":"172.21.15.174:6825/1511860729","cluster_addr":"172.21.15.174:6827/1511860729","heartbeat_back_addr":"172.21.15.174:6831/1511860729","heartbeat_front_addr":"172.21.15.174:6829/1511860729","state":["exists","up"]},{"osd":6,"uuid":"93061f6c-c0ce-47e9-88a0-1151c5ccb4e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":2326407945},{"type":"v1","addr":"172.21.15.174:6817","nonce":2326407945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":2326407945},{"type":"v1","addr":"172.21.15.174:6819","nonce":2326407945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":2326407945},{"type":"v1","addr":"172.21.15.174:6823","nonce":2326407945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":2326407945},{"type":"v1","addr":"172.21.15.174:6821","nonce":2326407945}]},"public_addr":"172.21.15.174:6817/2326407945","cluster_addr":"172.21.15.174:6819/2326407945","heartbeat_back_addr":"172.21.15.174:6823/2326407945","heartbeat_front_addr":"172.21.15.174:6821/2326407945","state":["exists","up"]},{"osd":7,"uuid":"7be1dcf3-1957-4ec3-bacf-f5f9fff580a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":1637570253},{"type":"v1","addr":"172.21.15.174:6809","nonce":1637570253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":1637570253},{"type":"v1","addr":"172.21.15.174:6811","nonce":1637570253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":1637570253},{"type":"v1","addr":"172.21.15.174:6815","nonce":1637570253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":1637570253},{"type":"v1","addr":"172.21.15.174:6813","nonce":1637570253}]},"public_addr":"172.21.15.174:6809/1637570253","cluster_addr":"172.21.15.174:6811/1637570253","heartbeat_back_addr":"172.21.15.174:6815/1637570253","heartbeat_front_addr":"172.21.15.174:6813/1637570253","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:33.997709+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:34.016568+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:33.990484+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:33.980666+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:33.920609+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:34.005069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:34.018345+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:34.061646+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T10:55:52.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.428+0000 7f088970a640 1 -- 172.21.15.33:0/798702828 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f087006b4d0 msgr2=0x7f087006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:52.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.428+0000 7f088970a640 1 --2- 172.21.15.33:0/798702828 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f087006b4d0 0x7f087006d990 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0874014510 tx=0x7f087400b040 comp rx=0 tx=0).stop 2024-05-08T10:55:52.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.428+0000 7f088970a640 1 -- 172.21.15.33:0/798702828 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f088415e420 msgr2=0x7f0884147320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:52.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.428+0000 7f088970a640 1 --2- 172.21.15.33:0/798702828 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f088415e420 0x7f0884147320 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f08780018f0 tx=0x7f0884071900 comp rx=0 tx=0).stop 2024-05-08T10:55:52.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.428+0000 7f088970a640 1 -- 172.21.15.33:0/798702828 shutdown_connections 2024-05-08T10:55:52.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.428+0000 7f088970a640 1 --2- 172.21.15.33:0/798702828 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f087006b4d0 0x7f087006d990 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:52.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.428+0000 7f088970a640 1 --2- 172.21.15.33:0/798702828 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f088415d450 0x7f08840b4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:52.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.428+0000 7f088970a640 1 --2- 172.21.15.33:0/798702828 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f088415e420 0x7f0884147320 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:52.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.428+0000 7f088970a640 1 --2- 172.21.15.33:0/798702828 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f086c0043b0 0x7f088414dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:52.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.428+0000 7f088970a640 1 -- 172.21.15.33:0/798702828 >> 172.21.15.33:0/798702828 conn(0x7f08840d08b0 msgr2=0x7f088406aba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:52.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.428+0000 7f088970a640 1 -- 172.21.15.33:0/798702828 shutdown_connections 2024-05-08T10:55:52.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.428+0000 7f088970a640 1 -- 172.21.15.33:0/798702828 wait complete. 2024-05-08T10:55:52.437 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-08T10:55:52.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.545+0000 7faeaba6b640 1 Processor -- start 2024-05-08T10:55:52.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.545+0000 7faeaba6b640 1 -- start start 2024-05-08T10:55:52.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.546+0000 7faeaba6b640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7faea415e2c0 0x7faea40b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:52.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.546+0000 7faeaba6b640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faea40b40a0 0x7faea4162380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:52.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.546+0000 7faeaba6b640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faea406c3f0 con 0x7faea415dee0 2024-05-08T10:55:52.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.546+0000 7faeaba6b640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faea406bec0 con 0x7faea415e2c0 2024-05-08T10:55:52.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.546+0000 7faeaba6b640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faea41629f0 con 0x7faea40b40a0 2024-05-08T10:55:52.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.546+0000 7faea9006640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7faea415e2c0 0x7faea40b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:52.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.546+0000 7faea9807640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7faea415dee0 0x7faea4161c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:50728/0 (socket says 172.21.15.33:50728) 2024-05-08T10:55:52.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.546+0000 7faea9807640 1 -- 172.21.15.33:0/1028353526 learned_addr learned my addr 172.21.15.33:0/1028353526 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-05-08T10:55:52.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.546+0000 7faeaa008640 1 --2- 172.21.15.33:0/1028353526 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faea40b40a0 0x7faea4162380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:52.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.546+0000 7faea9006640 1 -- 172.21.15.33:0/1028353526 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faea40b40a0 msgr2=0x7faea4162380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:52.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.546+0000 7faea9006640 1 --2- 172.21.15.33:0/1028353526 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faea40b40a0 0x7faea4162380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:52.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.546+0000 7faea9006640 1 -- 172.21.15.33:0/1028353526 >> v1:172.21.15.33:6789/0 conn(0x7faea415dee0 legacy=0x7faea4161c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:52.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.546+0000 7faea9006640 1 -- 172.21.15.33:0/1028353526 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faea406c110 con 0x7faea415e2c0 2024-05-08T10:55:52.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.546+0000 7faea8805640 1 -- 172.21.15.33:0/1028353526 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 495713328 0 0) 0x7faea406c3f0 con 0x7faea415dee0 2024-05-08T10:55:52.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.546+0000 7faeaa008640 1 --2- 172.21.15.33:0/1028353526 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faea40b40a0 0x7faea4162380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:55:52.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.547+0000 7faea9006640 1 --2- 172.21.15.33:0/1028353526 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faea415e2c0 0x7faea40b2c50 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fae940097a0 tx=0x7fae9402a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e751641003bedc09 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:52.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.547+0000 7faea8805640 1 -- 172.21.15.33:0/1028353526 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae94037070 con 0x7faea415e2c0 2024-05-08T10:55:52.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.547+0000 7faea8805640 1 -- 172.21.15.33:0/1028353526 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae9402adb0 con 0x7faea415e2c0 2024-05-08T10:55:52.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.547+0000 7faea8805640 1 -- 172.21.15.33:0/1028353526 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae94032660 con 0x7faea415e2c0 2024-05-08T10:55:52.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.548+0000 7faeaba6b640 1 -- 172.21.15.33:0/1028353526 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faea415e2c0 msgr2=0x7faea40b2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:52.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.548+0000 7faeaba6b640 1 --2- 172.21.15.33:0/1028353526 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faea415e2c0 0x7faea40b2c50 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fae940097a0 tx=0x7fae9402a060 comp rx=0 tx=0).stop 2024-05-08T10:55:52.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.548+0000 7faeaba6b640 1 -- 172.21.15.33:0/1028353526 shutdown_connections 2024-05-08T10:55:52.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.548+0000 7faeaba6b640 1 --2- 172.21.15.33:0/1028353526 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faea40b40a0 0x7faea4162380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:52.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.548+0000 7faeaba6b640 1 --2- 172.21.15.33:0/1028353526 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faea415e2c0 0x7faea40b2c50 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:52.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.548+0000 7faeaba6b640 1 -- 172.21.15.33:0/1028353526 >> 172.21.15.33:0/1028353526 conn(0x7faea40b3580 msgr2=0x7faea40b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:52.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.548+0000 7faeaba6b640 1 -- 172.21.15.33:0/1028353526 shutdown_connections 2024-05-08T10:55:52.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.548+0000 7faeaba6b640 1 -- 172.21.15.33:0/1028353526 wait complete. 2024-05-08T10:55:52.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.549+0000 7faeaba6b640 1 Processor -- start 2024-05-08T10:55:52.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.549+0000 7faeaba6b640 1 -- start start 2024-05-08T10:55:52.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.550+0000 7faeaba6b640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faea40b40a0 0x7faea4160ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:52.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.550+0000 7faeaba6b640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faea415dee0 0x7faea41549a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:52.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.550+0000 7faeaba6b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faea415e2c0 0x7faea4151b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:52.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.550+0000 7faeaba6b640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faea40b4fc0 con 0x7faea415e2c0 2024-05-08T10:55:52.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.550+0000 7faeaba6b640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faea40b4e40 con 0x7faea40b40a0 2024-05-08T10:55:52.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.550+0000 7faeaba6b640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faea40b5140 con 0x7faea415dee0 2024-05-08T10:55:52.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.550+0000 7faeaa008640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faea415e2c0 0x7faea4151b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:52.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.550+0000 7faeaa008640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faea415e2c0 0x7faea4151b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37268/0 (socket says 172.21.15.33:37268) 2024-05-08T10:55:52.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.550+0000 7faeaa008640 1 -- 172.21.15.33:0/3838788639 learned_addr learned my addr 172.21.15.33:0/3838788639 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:52.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.550+0000 7faea9006640 1 --2- 172.21.15.33:0/3838788639 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faea415dee0 0x7faea41549a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:52.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.550+0000 7faea9807640 1 --2- 172.21.15.33:0/3838788639 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faea40b40a0 0x7faea4160ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:52.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.550+0000 7faeaa008640 1 -- 172.21.15.33:0/3838788639 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faea415dee0 msgr2=0x7faea41549a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:52.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.550+0000 7faeaa008640 1 --2- 172.21.15.33:0/3838788639 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faea415dee0 0x7faea41549a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:52.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.550+0000 7faeaa008640 1 -- 172.21.15.33:0/3838788639 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faea40b40a0 msgr2=0x7faea4160ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:52.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.550+0000 7faeaa008640 1 --2- 172.21.15.33:0/3838788639 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faea40b40a0 0x7faea4160ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:52.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.550+0000 7faeaa008640 1 -- 172.21.15.33:0/3838788639 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faea4152a20 con 0x7faea415e2c0 2024-05-08T10:55:52.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.550+0000 7faea9006640 1 --2- 172.21.15.33:0/3838788639 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faea415dee0 0x7faea41549a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:55:52.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.550+0000 7faeaa008640 1 --2- 172.21.15.33:0/3838788639 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faea415e2c0 0x7faea4151b10 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fae9c007ef0 tx=0x7fae9c00d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:52.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.550+0000 7fae9a7fc640 1 -- 172.21.15.33:0/3838788639 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae9c01a070 con 0x7faea415e2c0 2024-05-08T10:55:52.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.550+0000 7fae9a7fc640 1 -- 172.21.15.33:0/3838788639 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae9c003b90 con 0x7faea415e2c0 2024-05-08T10:55:52.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.550+0000 7faeaba6b640 1 -- 172.21.15.33:0/3838788639 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faea4161530 con 0x7faea415e2c0 2024-05-08T10:55:52.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.550+0000 7fae9a7fc640 1 -- 172.21.15.33:0/3838788639 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae9c004030 con 0x7faea415e2c0 2024-05-08T10:55:52.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.550+0000 7faeaba6b640 1 -- 172.21.15.33:0/3838788639 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faea4152fa0 con 0x7faea415e2c0 2024-05-08T10:55:52.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.551+0000 7faeaba6b640 1 -- 172.21.15.33:0/3838788639 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faea4069d20 con 0x7faea415e2c0 2024-05-08T10:55:52.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.552+0000 7fae9a7fc640 1 -- 172.21.15.33:0/3838788639 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fae9c01d070 con 0x7faea415e2c0 2024-05-08T10:55:52.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.552+0000 7fae9a7fc640 1 --2- 172.21.15.33:0/3838788639 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fae8806b4d0 0x7fae8806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:52.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.552+0000 7fae9a7fc640 1 -- 172.21.15.33:0/3838788639 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fae9c08a3b0 con 0x7faea415e2c0 2024-05-08T10:55:52.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.553+0000 7faea9807640 1 --2- 172.21.15.33:0/3838788639 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fae8806b4d0 0x7fae8806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:52.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.553+0000 7faea9807640 1 --2- 172.21.15.33:0/3838788639 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fae8806b4d0 0x7fae8806d990 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7faea0000f60 tx=0x7faea0007b70 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:52.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.557+0000 7fae9a7fc640 1 -- 172.21.15.33:0/3838788639 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fae9c010070 con 0x7faea415e2c0 2024-05-08T10:55:52.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.775+0000 7faeaba6b640 1 -- 172.21.15.33:0/3838788639 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7faea40d2940 con 0x7faea415e2c0 2024-05-08T10:55:52.772 INFO:tasks.ceph.mon.a.smithi033.stderr:2024-05-08T10:55:52.775+0000 7fe618144640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-08T10:55:52.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.777+0000 7fae9a7fc640 1 -- 172.21.15.33:0/3838788639 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v15) v1 ==== 161+0+0 (secure 0 0 0) 0x7fae9c058be0 con 0x7faea415e2c0 2024-05-08T10:55:52.774 INFO:teuthology.orchestra.run.smithi033.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-08T10:55:52.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.779+0000 7faeaba6b640 1 -- 172.21.15.33:0/3838788639 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fae8806b4d0 msgr2=0x7fae8806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:52.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.779+0000 7faeaba6b640 1 --2- 172.21.15.33:0/3838788639 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fae8806b4d0 0x7fae8806d990 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7faea0000f60 tx=0x7faea0007b70 comp rx=0 tx=0).stop 2024-05-08T10:55:52.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.780+0000 7faeaba6b640 1 -- 172.21.15.33:0/3838788639 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faea415e2c0 msgr2=0x7faea4151b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:52.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.780+0000 7faeaba6b640 1 --2- 172.21.15.33:0/3838788639 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faea415e2c0 0x7faea4151b10 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fae9c007ef0 tx=0x7fae9c00d4a0 comp rx=0 tx=0).stop 2024-05-08T10:55:52.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.780+0000 7faeaba6b640 1 -- 172.21.15.33:0/3838788639 shutdown_connections 2024-05-08T10:55:52.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.780+0000 7faeaba6b640 1 --2- 172.21.15.33:0/3838788639 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fae8806b4d0 0x7fae8806d990 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:52.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.780+0000 7faeaba6b640 1 --2- 172.21.15.33:0/3838788639 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faea415e2c0 0x7faea4151b10 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:52.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.780+0000 7faeaba6b640 1 --2- 172.21.15.33:0/3838788639 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faea415dee0 0x7faea41549a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:52.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.780+0000 7faeaba6b640 1 --2- 172.21.15.33:0/3838788639 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faea40b40a0 0x7faea4160ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:52.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.780+0000 7faeaba6b640 1 -- 172.21.15.33:0/3838788639 >> 172.21.15.33:0/3838788639 conn(0x7faea40b3580 msgr2=0x7faea40b6470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:52.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.780+0000 7faeaba6b640 1 -- 172.21.15.33:0/3838788639 shutdown_connections 2024-05-08T10:55:52.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.780+0000 7faeaba6b640 1 -- 172.21.15.33:0/3838788639 wait complete. 2024-05-08T10:55:52.781 INFO:tasks.ceph.mds.c.smithi033.stderr: -6378> 2024-05-08T10:55:36.781+0000 7f54cfc3b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-08T10:55:52.790 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-08T10:55:52.814 INFO:tasks.ceph.mds.c.smithi033.stdout:starting mds.c at 2024-05-08T10:55:52.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.900+0000 7f7f92fc8640 1 Processor -- start 2024-05-08T10:55:52.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.900+0000 7f7f92fc8640 1 -- start start 2024-05-08T10:55:52.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.901+0000 7f7f92fc8640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7f8c1565c0 0x7f7f8c0cc220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:52.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.901+0000 7f7f92fc8640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f7f8c0cc760 0x7f7f8c0b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:52.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.901+0000 7f7f92fc8640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f8c15c440 con 0x7f7f8c0b39f0 2024-05-08T10:55:52.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.901+0000 7f7f92fc8640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f8c0b3e40 con 0x7f7f8c0cc760 2024-05-08T10:55:52.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.901+0000 7f7f92fc8640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f8c0b2ab0 con 0x7f7f8c1565c0 2024-05-08T10:55:52.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.901+0000 7f7f91565640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f7f8c0b39f0 0x7f7f8c070da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:50732/0 (socket says 172.21.15.33:50732) 2024-05-08T10:55:52.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.901+0000 7f7f91565640 1 -- 172.21.15.33:0/1648668677 learned_addr learned my addr 172.21.15.33:0/1648668677 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-05-08T10:55:52.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.901+0000 7f7f8bfff640 1 --2- 172.21.15.33:0/1648668677 >> v2:172.21.15.174:3300/0 conn(0x7f7f8c0cc760 0x7f7f8c0b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:52.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.901+0000 7f7f90d64640 1 --2- 172.21.15.33:0/1648668677 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7f8c1565c0 0x7f7f8c0cc220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:52.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.901+0000 7f7f8b7fe640 1 -- 172.21.15.33:0/1648668677 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4176459859 0 0) 0x7f7f8c15c440 con 0x7f7f8c0b39f0 2024-05-08T10:55:52.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.901+0000 7f7f8b7fe640 1 -- 172.21.15.33:0/1648668677 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f7c003520 con 0x7f7f8c0b39f0 2024-05-08T10:55:52.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.902+0000 7f7f8bfff640 1 -- 172.21.15.33:0/1648668677 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7f8c1565c0 msgr2=0x7f7f8c0cc220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:52.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.902+0000 7f7f8bfff640 1 --2- 172.21.15.33:0/1648668677 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7f8c1565c0 0x7f7f8c0cc220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:52.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.902+0000 7f7f8bfff640 1 -- 172.21.15.33:0/1648668677 >> v1:172.21.15.33:6789/0 conn(0x7f7f8c0b39f0 legacy=0x7f7f8c070da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:52.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.902+0000 7f7f8b7fe640 1 -- 172.21.15.33:0/1648668677 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3238240411 0 0) 0x7f7f7c003520 con 0x7f7f8c0b39f0 2024-05-08T10:55:52.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.902+0000 7f7f8bfff640 1 -- 172.21.15.33:0/1648668677 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f8c15c720 con 0x7f7f8c0cc760 2024-05-08T10:55:52.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.902+0000 7f7f8bfff640 1 --2- 172.21.15.33:0/1648668677 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7f8c0cc760 0x7f7f8c0b34b0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f7f780097a0 tx=0x7f7f7802a080 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a1e3e3c86971e30f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:52.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.902+0000 7f7f8b7fe640 1 -- 172.21.15.33:0/1648668677 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f78037070 con 0x7f7f8c0cc760 2024-05-08T10:55:52.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.903+0000 7f7f8b7fe640 1 -- 172.21.15.33:0/1648668677 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f7802ab10 con 0x7f7f8c0cc760 2024-05-08T10:55:52.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.903+0000 7f7f8b7fe640 1 -- 172.21.15.33:0/1648668677 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f840019f0 con 0x7f7f8c0cc760 2024-05-08T10:55:52.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.903+0000 7f7f92fc8640 1 -- 172.21.15.33:0/1648668677 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7f8c0cc760 msgr2=0x7f7f8c0b34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:52.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.903+0000 7f7f92fc8640 1 --2- 172.21.15.33:0/1648668677 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7f8c0cc760 0x7f7f8c0b34b0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f7f780097a0 tx=0x7f7f7802a080 comp rx=0 tx=0).stop 2024-05-08T10:55:52.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.903+0000 7f7f92fc8640 1 -- 172.21.15.33:0/1648668677 shutdown_connections 2024-05-08T10:55:52.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.903+0000 7f7f92fc8640 1 --2- 172.21.15.33:0/1648668677 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7f8c0cc760 0x7f7f8c0b34b0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:52.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.903+0000 7f7f92fc8640 1 --2- 172.21.15.33:0/1648668677 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7f8c1565c0 0x7f7f8c0cc220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:52.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.903+0000 7f7f92fc8640 1 -- 172.21.15.33:0/1648668677 >> 172.21.15.33:0/1648668677 conn(0x7f7f8c0b1400 msgr2=0x7f7f8c0b1810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:52.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.903+0000 7f7f92fc8640 1 -- 172.21.15.33:0/1648668677 shutdown_connections 2024-05-08T10:55:52.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.903+0000 7f7f92fc8640 1 -- 172.21.15.33:0/1648668677 wait complete. 2024-05-08T10:55:52.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.904+0000 7f7f92fc8640 1 Processor -- start 2024-05-08T10:55:52.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.904+0000 7f7f92fc8640 1 -- start start 2024-05-08T10:55:52.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.905+0000 7f7f92fc8640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7f8c0b39f0 0x7f7f8c151940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:52.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.905+0000 7f7f92fc8640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7f8c0cc760 0x7f7f8c1569f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:52.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.905+0000 7f7f92fc8640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7f8c1565c0 0x7f7f8c148190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:52.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.905+0000 7f7f92fc8640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f8c15d200 con 0x7f7f8c0b39f0 2024-05-08T10:55:52.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.905+0000 7f7f92fc8640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f8c15cce0 con 0x7f7f8c0cc760 2024-05-08T10:55:52.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.905+0000 7f7f92fc8640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f8c0b4090 con 0x7f7f8c1565c0 2024-05-08T10:55:52.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.905+0000 7f7f90d64640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7f8c0b39f0 0x7f7f8c151940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:52.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.905+0000 7f7f90d64640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7f8c0b39f0 0x7f7f8c151940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37296/0 (socket says 172.21.15.33:37296) 2024-05-08T10:55:52.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.905+0000 7f7f90d64640 1 -- 172.21.15.33:0/3962101490 learned_addr learned my addr 172.21.15.33:0/3962101490 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:52.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.906+0000 7f7f91565640 1 --2- 172.21.15.33:0/3962101490 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7f8c1565c0 0x7f7f8c148190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:52.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.906+0000 7f7f8bfff640 1 --2- 172.21.15.33:0/3962101490 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7f8c0cc760 0x7f7f8c1569f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:52.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.906+0000 7f7f90d64640 1 -- 172.21.15.33:0/3962101490 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7f8c1565c0 msgr2=0x7f7f8c148190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:52.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.906+0000 7f7f90d64640 1 --2- 172.21.15.33:0/3962101490 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7f8c1565c0 0x7f7f8c148190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:52.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.906+0000 7f7f90d64640 1 -- 172.21.15.33:0/3962101490 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7f8c0cc760 msgr2=0x7f7f8c1569f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:52.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.906+0000 7f7f90d64640 1 --2- 172.21.15.33:0/3962101490 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7f8c0cc760 0x7f7f8c1569f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:52.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.906+0000 7f7f90d64640 1 -- 172.21.15.33:0/3962101490 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f8c1486d0 con 0x7f7f8c0b39f0 2024-05-08T10:55:52.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.906+0000 7f7f90d64640 1 --2- 172.21.15.33:0/3962101490 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7f8c0b39f0 0x7f7f8c151940 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f7f8000e8a0 tx=0x7f7f8000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:52.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.906+0000 7f7f897fa640 1 -- 172.21.15.33:0/3962101490 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f80017070 con 0x7f7f8c0b39f0 2024-05-08T10:55:52.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.906+0000 7f7f897fa640 1 -- 172.21.15.33:0/3962101490 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f8000c940 con 0x7f7f8c0b39f0 2024-05-08T10:55:52.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.906+0000 7f7f92fc8640 1 -- 172.21.15.33:0/3962101490 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f8c157160 con 0x7f7f8c0b39f0 2024-05-08T10:55:52.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.906+0000 7f7f897fa640 1 -- 172.21.15.33:0/3962101490 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f8000cd30 con 0x7f7f8c0b39f0 2024-05-08T10:55:52.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.906+0000 7f7f92fc8640 1 -- 172.21.15.33:0/3962101490 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f8c157720 con 0x7f7f8c0b39f0 2024-05-08T10:55:52.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.907+0000 7f7f92fc8640 1 -- 172.21.15.33:0/3962101490 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f8c069d20 con 0x7f7f8c0b39f0 2024-05-08T10:55:52.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.908+0000 7f7f897fa640 1 -- 172.21.15.33:0/3962101490 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7f8001a070 con 0x7f7f8c0b39f0 2024-05-08T10:55:52.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.908+0000 7f7f897fa640 1 --2- 172.21.15.33:0/3962101490 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f7f7006b4d0 0x7f7f7006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:52.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.908+0000 7f7f897fa640 1 -- 172.21.15.33:0/3962101490 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f7f8008a0f0 con 0x7f7f8c0b39f0 2024-05-08T10:55:52.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.908+0000 7f7f8bfff640 1 --2- 172.21.15.33:0/3962101490 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f7f7006b4d0 0x7f7f7006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:52.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.909+0000 7f7f8bfff640 1 --2- 172.21.15.33:0/3962101490 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f7f7006b4d0 0x7f7f7006d990 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f7f78034000 tx=0x7f7f7802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:52.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:52.912+0000 7f7f897fa640 1 -- 172.21.15.33:0/3962101490 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7f80058f10 con 0x7f7f8c0b39f0 2024-05-08T10:55:53.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:53.131+0000 7f7f92fc8640 1 -- 172.21.15.33:0/3962101490 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f7f8c153970 con 0x7f7f8c0b39f0 2024-05-08T10:55:53.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:53.783+0000 7f7f897fa640 1 -- 172.21.15.33:0/3962101490 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v16) v1 ==== 104+0+0 (secure 0 0 0) 0x7f7f80058810 con 0x7f7f8c0b39f0 2024-05-08T10:55:53.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:53.785+0000 7f7f92fc8640 1 -- 172.21.15.33:0/3962101490 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f7f7006b4d0 msgr2=0x7f7f7006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:53.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:53.785+0000 7f7f92fc8640 1 --2- 172.21.15.33:0/3962101490 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f7f7006b4d0 0x7f7f7006d990 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f7f78034000 tx=0x7f7f7802e000 comp rx=0 tx=0).stop 2024-05-08T10:55:53.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:53.785+0000 7f7f92fc8640 1 -- 172.21.15.33:0/3962101490 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7f8c0b39f0 msgr2=0x7f7f8c151940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:53.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:53.785+0000 7f7f92fc8640 1 --2- 172.21.15.33:0/3962101490 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7f8c0b39f0 0x7f7f8c151940 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f7f8000e8a0 tx=0x7f7f8000ed60 comp rx=0 tx=0).stop 2024-05-08T10:55:53.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:53.786+0000 7f7f92fc8640 1 -- 172.21.15.33:0/3962101490 shutdown_connections 2024-05-08T10:55:53.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:53.786+0000 7f7f92fc8640 1 --2- 172.21.15.33:0/3962101490 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f7f7006b4d0 0x7f7f7006d990 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:53.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:53.786+0000 7f7f92fc8640 1 --2- 172.21.15.33:0/3962101490 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7f8c1565c0 0x7f7f8c148190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:53.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:53.786+0000 7f7f92fc8640 1 --2- 172.21.15.33:0/3962101490 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7f8c0cc760 0x7f7f8c1569f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:53.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:53.786+0000 7f7f92fc8640 1 --2- 172.21.15.33:0/3962101490 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7f8c0b39f0 0x7f7f8c151940 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:53.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:53.786+0000 7f7f92fc8640 1 -- 172.21.15.33:0/3962101490 >> 172.21.15.33:0/3962101490 conn(0x7f7f8c0b1400 msgr2=0x7f7f8c070d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:53.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:53.786+0000 7f7f92fc8640 1 -- 172.21.15.33:0/3962101490 shutdown_connections 2024-05-08T10:55:53.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:53.786+0000 7f7f92fc8640 1 -- 172.21.15.33:0/3962101490 wait complete. 2024-05-08T10:55:53.797 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-08T10:55:53.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:53.954+0000 7fa4dc858640 1 Processor -- start 2024-05-08T10:55:53.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:53.954+0000 7fa4dc858640 1 -- start start 2024-05-08T10:55:53.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:53.955+0000 7fa4dc858640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fa4d81619a0 0x7fa4d8161e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:53.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:53.955+0000 7fa4dc858640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa4d80d1800 0x7fa4d80d1c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:53.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:53.955+0000 7fa4dc858640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4d815f590 con 0x7fa4d815e040 2024-05-08T10:55:53.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:53.955+0000 7fa4dc858640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4d8162890 con 0x7fa4d81619a0 2024-05-08T10:55:53.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:53.955+0000 7fa4dc858640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d80ced40 con 0x7fa4d80d1800 2024-05-08T10:55:53.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:53.955+0000 7fa4d5d9b640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fa4d81619a0 0x7fa4d8161e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:53.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:53.955+0000 7fa4d5d9b640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fa4d81619a0 0x7fa4d8161e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37304/0 (socket says 172.21.15.33:37304) 2024-05-08T10:55:53.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:53.955+0000 7fa4d5d9b640 1 -- 172.21.15.33:0/124922570 learned_addr learned my addr 172.21.15.33:0/124922570 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:53.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:53.955+0000 7fa4d6d9d640 1 --2- 172.21.15.33:0/124922570 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa4d80d1800 0x7fa4d80d1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:53.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:53.956+0000 7fa4d5d9b640 1 -- 172.21.15.33:0/124922570 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa4d80d1800 msgr2=0x7fa4d80d1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:53.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:53.956+0000 7fa4d5d9b640 1 --2- 172.21.15.33:0/124922570 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa4d80d1800 0x7fa4d80d1c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:53.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:53.956+0000 7fa4d5d9b640 1 -- 172.21.15.33:0/124922570 >> v1:172.21.15.33:6789/0 conn(0x7fa4d815e040 legacy=0x7fa4d815ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:53.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:53.956+0000 7fa4d5d9b640 1 -- 172.21.15.33:0/124922570 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4d80cf020 con 0x7fa4d81619a0 2024-05-08T10:55:53.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:53.956+0000 7fa4d5d9b640 1 --2- 172.21.15.33:0/124922570 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa4d81619a0 0x7fa4d8161e30 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc009870 tx=0x7fa4cc02a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efd12310d7699e0b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:53.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:53.956+0000 7fa4d559a640 1 -- 172.21.15.33:0/124922570 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4cc037070 con 0x7fa4d81619a0 2024-05-08T10:55:53.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:53.956+0000 7fa4d559a640 1 -- 172.21.15.33:0/124922570 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4cc032440 con 0x7fa4d81619a0 2024-05-08T10:55:53.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:53.957+0000 7fa4d559a640 1 -- 172.21.15.33:0/124922570 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4cc032810 con 0x7fa4d81619a0 2024-05-08T10:55:53.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:53.957+0000 7fa4dc858640 1 -- 172.21.15.33:0/124922570 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa4d81619a0 msgr2=0x7fa4d8161e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:53.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:53.957+0000 7fa4dc858640 1 --2- 172.21.15.33:0/124922570 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa4d81619a0 0x7fa4d8161e30 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc009870 tx=0x7fa4cc02a250 comp rx=0 tx=0).stop 2024-05-08T10:55:53.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:53.957+0000 7fa4dc858640 1 -- 172.21.15.33:0/124922570 shutdown_connections 2024-05-08T10:55:53.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:53.957+0000 7fa4dc858640 1 --2- 172.21.15.33:0/124922570 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa4d80d1800 0x7fa4d80d1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:53.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:53.957+0000 7fa4dc858640 1 --2- 172.21.15.33:0/124922570 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa4d81619a0 0x7fa4d8161e30 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:53.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:53.957+0000 7fa4dc858640 1 -- 172.21.15.33:0/124922570 >> 172.21.15.33:0/124922570 conn(0x7fa4d809cec0 msgr2=0x7fa4d80d3c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:53.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:53.957+0000 7fa4dc858640 1 -- 172.21.15.33:0/124922570 shutdown_connections 2024-05-08T10:55:53.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:53.957+0000 7fa4dc858640 1 -- 172.21.15.33:0/124922570 wait complete. 2024-05-08T10:55:53.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:53.959+0000 7fa4dc858640 1 Processor -- start 2024-05-08T10:55:53.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:53.959+0000 7fa4dc858640 1 -- start start 2024-05-08T10:55:53.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:53.959+0000 7fa4dc858640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa4d80d1800 0x7fa4d8156fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:53.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:53.959+0000 7fa4dc858640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa4d81619a0 0x7fa4d80c8320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:53.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:53.959+0000 7fa4dc858640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa4d80b8600 0x7fa4d80b8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:53.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:53.959+0000 7fa4dc858640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d80cf8c0 con 0x7fa4d80b8600 2024-05-08T10:55:53.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:53.959+0000 7fa4dc858640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d80cf5e0 con 0x7fa4d81619a0 2024-05-08T10:55:53.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:53.959+0000 7fa4dc858640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d80ce8f0 con 0x7fa4d80d1800 2024-05-08T10:55:53.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:53.959+0000 7fa4d6d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa4d80b8600 0x7fa4d80b8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:53.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:53.959+0000 7fa4d6d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa4d80b8600 0x7fa4d80b8a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37306/0 (socket says 172.21.15.33:37306) 2024-05-08T10:55:53.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:53.959+0000 7fa4d6d9d640 1 -- 172.21.15.33:0/2000192911 learned_addr learned my addr 172.21.15.33:0/2000192911 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:53.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:53.960+0000 7fa4d5d9b640 1 --2- 172.21.15.33:0/2000192911 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa4d81619a0 0x7fa4d80c8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:53.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:53.960+0000 7fa4d659c640 1 --2- 172.21.15.33:0/2000192911 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa4d80d1800 0x7fa4d8156fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:53.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:53.960+0000 7fa4d6d9d640 1 -- 172.21.15.33:0/2000192911 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa4d80d1800 msgr2=0x7fa4d8156fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:53.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:53.960+0000 7fa4d6d9d640 1 --2- 172.21.15.33:0/2000192911 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa4d80d1800 0x7fa4d8156fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:53.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:53.960+0000 7fa4d6d9d640 1 -- 172.21.15.33:0/2000192911 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa4d81619a0 msgr2=0x7fa4d80c8320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:53.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:53.960+0000 7fa4d6d9d640 1 --2- 172.21.15.33:0/2000192911 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa4d81619a0 0x7fa4d80c8320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:53.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:53.960+0000 7fa4d6d9d640 1 -- 172.21.15.33:0/2000192911 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4d8160bb0 con 0x7fa4d80b8600 2024-05-08T10:55:53.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:53.960+0000 7fa4d5d9b640 1 --2- 172.21.15.33:0/2000192911 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa4d81619a0 0x7fa4d80c8320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:55:53.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:53.960+0000 7fa4d6d9d640 1 --2- 172.21.15.33:0/2000192911 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa4d80b8600 0x7fa4d80b8a90 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fa4d0007e70 tx=0x7fa4d000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:53.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:53.960+0000 7fa4c6ffd640 1 -- 172.21.15.33:0/2000192911 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d0014620 con 0x7fa4d80b8600 2024-05-08T10:55:53.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:53.960+0000 7fa4c6ffd640 1 -- 172.21.15.33:0/2000192911 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4d0019070 con 0x7fa4d80b8600 2024-05-08T10:55:53.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:53.960+0000 7fa4dc858640 1 -- 172.21.15.33:0/2000192911 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4d8160e90 con 0x7fa4d80b8600 2024-05-08T10:55:53.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:53.960+0000 7fa4c6ffd640 1 -- 172.21.15.33:0/2000192911 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d0014a20 con 0x7fa4d80b8600 2024-05-08T10:55:53.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:53.960+0000 7fa4dc858640 1 -- 172.21.15.33:0/2000192911 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4d8161450 con 0x7fa4d80b8600 2024-05-08T10:55:53.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:53.961+0000 7fa4dc858640 1 -- 172.21.15.33:0/2000192911 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4d8069d20 con 0x7fa4d80b8600 2024-05-08T10:55:53.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:53.962+0000 7fa4c6ffd640 1 -- 172.21.15.33:0/2000192911 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa4d0014bc0 con 0x7fa4d80b8600 2024-05-08T10:55:53.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:53.962+0000 7fa4c6ffd640 1 --2- 172.21.15.33:0/2000192911 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fa4b806b4d0 0x7fa4b806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:53.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:53.962+0000 7fa4c6ffd640 1 -- 172.21.15.33:0/2000192911 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fa4d008aa60 con 0x7fa4d80b8600 2024-05-08T10:55:53.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:53.963+0000 7fa4d659c640 1 --2- 172.21.15.33:0/2000192911 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fa4b806b4d0 0x7fa4b806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:53.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:53.963+0000 7fa4d659c640 1 --2- 172.21.15.33:0/2000192911 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fa4b806b4d0 0x7fa4b806d990 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa4c8001780 tx=0x7fa4c8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:53.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:53.966+0000 7fa4c6ffd640 1 -- 172.21.15.33:0/2000192911 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa4d0059880 con 0x7fa4d80b8600 2024-05-08T10:55:54.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:54.151+0000 7fa4dc858640 1 -- 172.21.15.33:0/2000192911 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa4d80cdfd0 con 0x7fa4d80b8600 2024-05-08T10:55:55.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:55.051+0000 7fa4c6ffd640 1 -- 172.21.15.33:0/2000192911 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v33) v1 ==== 181+0+0 (secure 0 0 0) 0x7fa4d0059180 con 0x7fa4d80b8600 2024-05-08T10:55:55.048 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_metadata' removed 2024-05-08T10:55:55.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:55.054+0000 7fa4dc858640 1 -- 172.21.15.33:0/2000192911 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fa4b806b4d0 msgr2=0x7fa4b806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:55.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:55.054+0000 7fa4dc858640 1 --2- 172.21.15.33:0/2000192911 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fa4b806b4d0 0x7fa4b806d990 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa4c8001780 tx=0x7fa4c8009040 comp rx=0 tx=0).stop 2024-05-08T10:55:55.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:55.054+0000 7fa4dc858640 1 -- 172.21.15.33:0/2000192911 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa4d80b8600 msgr2=0x7fa4d80b8a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:55.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:55.054+0000 7fa4dc858640 1 --2- 172.21.15.33:0/2000192911 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa4d80b8600 0x7fa4d80b8a90 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fa4d0007e70 tx=0x7fa4d000e4b0 comp rx=0 tx=0).stop 2024-05-08T10:55:55.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:55.054+0000 7fa4dc858640 1 -- 172.21.15.33:0/2000192911 shutdown_connections 2024-05-08T10:55:55.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:55.054+0000 7fa4dc858640 1 --2- 172.21.15.33:0/2000192911 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fa4b806b4d0 0x7fa4b806d990 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:55.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:55.054+0000 7fa4dc858640 1 --2- 172.21.15.33:0/2000192911 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa4d80b8600 0x7fa4d80b8a90 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:55.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:55.054+0000 7fa4dc858640 1 --2- 172.21.15.33:0/2000192911 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa4d81619a0 0x7fa4d80c8320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:55.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:55.054+0000 7fa4dc858640 1 --2- 172.21.15.33:0/2000192911 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa4d80d1800 0x7fa4d8156fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:55.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:55.054+0000 7fa4dc858640 1 -- 172.21.15.33:0/2000192911 >> 172.21.15.33:0/2000192911 conn(0x7fa4d809cec0 msgr2=0x7fa4d80b40e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:55.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:55.054+0000 7fa4dc858640 1 -- 172.21.15.33:0/2000192911 shutdown_connections 2024-05-08T10:55:55.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:55.054+0000 7fa4dc858640 1 -- 172.21.15.33:0/2000192911 wait complete. 2024-05-08T10:55:55.066 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-08T10:55:55.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:55.183+0000 7fc531858640 1 Processor -- start 2024-05-08T10:55:55.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:55.183+0000 7fc531858640 1 -- start start 2024-05-08T10:55:55.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:55.184+0000 7fc531858640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fc52c15e040 0x7fc52c15ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:55.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:55.184+0000 7fc531858640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc52c1620b0 0x7fc52c0d1800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:55.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:55.184+0000 7fc531858640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc52c0ced40 con 0x7fc52c15f3c0 2024-05-08T10:55:55.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:55.184+0000 7fc531858640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc52c162890 con 0x7fc52c15e040 2024-05-08T10:55:55.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:55.184+0000 7fc531858640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc52c0cf020 con 0x7fc52c1620b0 2024-05-08T10:55:55.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:55.184+0000 7fc52affd640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fc52c15e040 0x7fc52c15ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:55.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:55.184+0000 7fc52a7fc640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fc52c15f3c0 0x7fc52c1619a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:50746/0 (socket says 172.21.15.33:50746) 2024-05-08T10:55:55.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:55.184+0000 7fc52affd640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fc52c15e040 0x7fc52c15ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37314/0 (socket says 172.21.15.33:37314) 2024-05-08T10:55:55.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:55.184+0000 7fc52a7fc640 1 -- 172.21.15.33:0/1157451115 learned_addr learned my addr 172.21.15.33:0/1157451115 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-05-08T10:55:55.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:55.184+0000 7fc52affd640 1 -- 172.21.15.33:0/1157451115 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc52c1620b0 msgr2=0x7fc52c0d1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:55.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:55.184+0000 7fc52affd640 1 --2- 172.21.15.33:0/1157451115 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc52c1620b0 0x7fc52c0d1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:55.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:55.184+0000 7fc52affd640 1 -- 172.21.15.33:0/1157451115 >> v1:172.21.15.33:6789/0 conn(0x7fc52c15f3c0 legacy=0x7fc52c1619a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:55.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:55.184+0000 7fc52affd640 1 -- 172.21.15.33:0/1157451115 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc52c0cf300 con 0x7fc52c15e040 2024-05-08T10:55:55.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:55.184+0000 7fc529ffb640 1 -- 172.21.15.33:0/1157451115 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 174057185 0 0) 0x7fc52c0ced40 con 0x7fc52c15f3c0 2024-05-08T10:55:55.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:55.185+0000 7fc52affd640 1 --2- 172.21.15.33:0/1157451115 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc52c15e040 0x7fc52c15ee80 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fc51c0097a0 tx=0x7fc51c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2313e734d31159f4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:55.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:55.185+0000 7fc529ffb640 1 -- 172.21.15.33:0/1157451115 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc51c037070 con 0x7fc52c15e040 2024-05-08T10:55:55.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:55.185+0000 7fc529ffb640 1 -- 172.21.15.33:0/1157451115 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc51c032440 con 0x7fc52c15e040 2024-05-08T10:55:55.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:55.185+0000 7fc529ffb640 1 -- 172.21.15.33:0/1157451115 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc51c032810 con 0x7fc52c15e040 2024-05-08T10:55:55.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:55.186+0000 7fc531858640 1 -- 172.21.15.33:0/1157451115 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc52c15e040 msgr2=0x7fc52c15ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:55.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:55.186+0000 7fc531858640 1 --2- 172.21.15.33:0/1157451115 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc52c15e040 0x7fc52c15ee80 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fc51c0097a0 tx=0x7fc51c02a1a0 comp rx=0 tx=0).stop 2024-05-08T10:55:55.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:55.186+0000 7fc531858640 1 -- 172.21.15.33:0/1157451115 shutdown_connections 2024-05-08T10:55:55.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:55.186+0000 7fc531858640 1 --2- 172.21.15.33:0/1157451115 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc52c1620b0 0x7fc52c0d1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:55.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:55.186+0000 7fc531858640 1 --2- 172.21.15.33:0/1157451115 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc52c15e040 0x7fc52c15ee80 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:55.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:55.186+0000 7fc531858640 1 -- 172.21.15.33:0/1157451115 >> 172.21.15.33:0/1157451115 conn(0x7fc52c09cec0 msgr2=0x7fc52c0d3c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:55.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:55.186+0000 7fc531858640 1 -- 172.21.15.33:0/1157451115 shutdown_connections 2024-05-08T10:55:55.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:55.186+0000 7fc531858640 1 -- 172.21.15.33:0/1157451115 wait complete. 2024-05-08T10:55:55.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:55.187+0000 7fc531858640 1 Processor -- start 2024-05-08T10:55:55.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:55.187+0000 7fc531858640 1 -- start start 2024-05-08T10:55:55.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:55.188+0000 7fc531858640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc52c15f3c0 0x7fc52c0cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:55.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:55.188+0000 7fc531858640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc52c1620b0 0x7fc52c0b6820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:55.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:55.188+0000 7fc531858640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc52c0b7fa0 0x7fc52c14ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:55.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:55.188+0000 7fc531858640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc52c0ce8f0 con 0x7fc52c0b7fa0 2024-05-08T10:55:55.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:55.188+0000 7fc531858640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc52c0cf8c0 con 0x7fc52c1620b0 2024-05-08T10:55:55.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:55.188+0000 7fc531858640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc52c0cea70 con 0x7fc52c15f3c0 2024-05-08T10:55:55.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:55.188+0000 7fc52b7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc52c0b7fa0 0x7fc52c14ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:55.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:55.188+0000 7fc52b7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc52c0b7fa0 0x7fc52c14ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37316/0 (socket says 172.21.15.33:37316) 2024-05-08T10:55:55.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:55.188+0000 7fc52b7fe640 1 -- 172.21.15.33:0/827507500 learned_addr learned my addr 172.21.15.33:0/827507500 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:55.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:55.188+0000 7fc52a7fc640 1 --2- 172.21.15.33:0/827507500 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc52c1620b0 0x7fc52c0b6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:55.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:55.188+0000 7fc52affd640 1 --2- 172.21.15.33:0/827507500 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc52c15f3c0 0x7fc52c0cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:55.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:55.189+0000 7fc52b7fe640 1 -- 172.21.15.33:0/827507500 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc52c15f3c0 msgr2=0x7fc52c0cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:55.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:55.189+0000 7fc52b7fe640 1 --2- 172.21.15.33:0/827507500 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc52c15f3c0 0x7fc52c0cbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:55.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:55.189+0000 7fc52b7fe640 1 -- 172.21.15.33:0/827507500 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc52c1620b0 msgr2=0x7fc52c0b6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:55.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:55.189+0000 7fc52b7fe640 1 --2- 172.21.15.33:0/827507500 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc52c1620b0 0x7fc52c0b6820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:55.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:55.189+0000 7fc52b7fe640 1 -- 172.21.15.33:0/827507500 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc52c0b6f00 con 0x7fc52c0b7fa0 2024-05-08T10:55:55.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:55.189+0000 7fc52b7fe640 1 --2- 172.21.15.33:0/827507500 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc52c0b7fa0 0x7fc52c14ff60 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fc52400b9e0 tx=0x7fc52400bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:55.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:55.189+0000 7fc513fff640 1 -- 172.21.15.33:0/827507500 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc524019070 con 0x7fc52c0b7fa0 2024-05-08T10:55:55.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:55.189+0000 7fc513fff640 1 -- 172.21.15.33:0/827507500 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc52400cb20 con 0x7fc52c0b7fa0 2024-05-08T10:55:55.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:55.189+0000 7fc531858640 1 -- 172.21.15.33:0/827507500 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc52c0b71e0 con 0x7fc52c0b7fa0 2024-05-08T10:55:55.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:55.189+0000 7fc513fff640 1 -- 172.21.15.33:0/827507500 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc524014440 con 0x7fc52c0b7fa0 2024-05-08T10:55:55.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:55.189+0000 7fc531858640 1 -- 172.21.15.33:0/827507500 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc52c0b77a0 con 0x7fc52c0b7fa0 2024-05-08T10:55:55.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:55.190+0000 7fc531858640 1 -- 172.21.15.33:0/827507500 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc52c069d20 con 0x7fc52c0b7fa0 2024-05-08T10:55:55.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:55.190+0000 7fc513fff640 1 -- 172.21.15.33:0/827507500 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc52401c070 con 0x7fc52c0b7fa0 2024-05-08T10:55:55.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:55.191+0000 7fc513fff640 1 --2- 172.21.15.33:0/827507500 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fc51806b4d0 0x7fc51806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:55.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:55.191+0000 7fc513fff640 1 -- 172.21.15.33:0/827507500 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5357+0+0 (secure 0 0 0) 0x7fc524089cd0 con 0x7fc52c0b7fa0 2024-05-08T10:55:55.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:55.191+0000 7fc52affd640 1 --2- 172.21.15.33:0/827507500 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fc51806b4d0 0x7fc51806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:55.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:55.192+0000 7fc52affd640 1 --2- 172.21.15.33:0/827507500 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fc51806b4d0 0x7fc51806d990 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc51c034000 tx=0x7fc51c02e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:55.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:55.195+0000 7fc513fff640 1 -- 172.21.15.33:0/827507500 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc524058d40 con 0x7fc52c0b7fa0 2024-05-08T10:55:55.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:55.374+0000 7fc531858640 1 -- 172.21.15.33:0/827507500 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc52c0b9a60 con 0x7fc52c0b7fa0 2024-05-08T10:55:56.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.052+0000 7fc513fff640 1 -- 172.21.15.33:0/827507500 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v34) v1 ==== 169+0+0 (secure 0 0 0) 0x7fc524058640 con 0x7fc52c0b7fa0 2024-05-08T10:55:56.050 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_data' removed 2024-05-08T10:55:56.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.056+0000 7fc531858640 1 -- 172.21.15.33:0/827507500 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fc51806b4d0 msgr2=0x7fc51806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:56.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.056+0000 7fc531858640 1 --2- 172.21.15.33:0/827507500 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fc51806b4d0 0x7fc51806d990 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc51c034000 tx=0x7fc51c02e000 comp rx=0 tx=0).stop 2024-05-08T10:55:56.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.056+0000 7fc531858640 1 -- 172.21.15.33:0/827507500 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc52c0b7fa0 msgr2=0x7fc52c14ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:56.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.056+0000 7fc531858640 1 --2- 172.21.15.33:0/827507500 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc52c0b7fa0 0x7fc52c14ff60 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fc52400b9e0 tx=0x7fc52400bea0 comp rx=0 tx=0).stop 2024-05-08T10:55:56.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.056+0000 7fc531858640 1 -- 172.21.15.33:0/827507500 shutdown_connections 2024-05-08T10:55:56.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.056+0000 7fc531858640 1 --2- 172.21.15.33:0/827507500 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fc51806b4d0 0x7fc51806d990 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:56.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.056+0000 7fc531858640 1 --2- 172.21.15.33:0/827507500 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc52c0b7fa0 0x7fc52c14ff60 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:56.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.056+0000 7fc531858640 1 --2- 172.21.15.33:0/827507500 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc52c1620b0 0x7fc52c0b6820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:56.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.056+0000 7fc531858640 1 --2- 172.21.15.33:0/827507500 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc52c15f3c0 0x7fc52c0cbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:56.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.056+0000 7fc531858640 1 -- 172.21.15.33:0/827507500 >> 172.21.15.33:0/827507500 conn(0x7fc52c09cec0 msgr2=0x7fc52c1618b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:56.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.057+0000 7fc531858640 1 -- 172.21.15.33:0/827507500 shutdown_connections 2024-05-08T10:55:56.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.057+0000 7fc531858640 1 -- 172.21.15.33:0/827507500 wait complete. 2024-05-08T10:55:56.071 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-05-08T10:55:56.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.189+0000 7f7766bf5640 1 Processor -- start 2024-05-08T10:55:56.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.189+0000 7f7766bf5640 1 -- start start 2024-05-08T10:55:56.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.190+0000 7f7766bf5640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f77600d0c20 0x7f77600d1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:56.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.190+0000 7f7766bf5640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77600cfb90 con 0x7f77600b33b0 2024-05-08T10:55:56.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.190+0000 7f7766bf5640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77600cf5d0 con 0x7f77600b4320 2024-05-08T10:55:56.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.190+0000 7f7766bf5640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77600cf8b0 con 0x7f77600d0c20 2024-05-08T10:55:56.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.190+0000 7f7765192640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f77600d0c20 0x7f77600d1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:56.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.190+0000 7f7765192640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f77600d0c20 0x7f77600d1fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46138/0 (socket says 172.21.15.33:46138) 2024-05-08T10:55:56.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.190+0000 7f775ffff640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f77600b33b0 0x7f77600d0510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:44620/0 (socket says 172.21.15.33:44620) 2024-05-08T10:55:56.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.190+0000 7f7765192640 1 -- 172.21.15.33:0/2211660956 learned_addr learned my addr 172.21.15.33:0/2211660956 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:56.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.191+0000 7f7765192640 1 -- 172.21.15.33:0/2211660956 >> v1:172.21.15.174:6789/0 conn(0x7f77600b4320 legacy=0x7f77600d4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:56.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.191+0000 7f7765192640 1 -- 172.21.15.33:0/2211660956 >> v1:172.21.15.33:6789/0 conn(0x7f77600b33b0 legacy=0x7f77600d0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:56.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.191+0000 7f7765192640 1 -- 172.21.15.33:0/2211660956 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77600d17b0 con 0x7f77600d0c20 2024-05-08T10:55:56.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.191+0000 7f775f7fe640 1 -- 172.21.15.33:0/2211660956 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3720383448 0 0) 0x7f77600cfb90 con 0x7f77600b33b0 2024-05-08T10:55:56.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.191+0000 7f7765192640 1 --2- 172.21.15.33:0/2211660956 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f77600d0c20 0x7f77600d1fb0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f7758009e50 tx=0x7f775802a7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28d06bd0f36bca94 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:56.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.192+0000 7f775f7fe640 1 -- 172.21.15.33:0/2211660956 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7758036070 con 0x7f77600d0c20 2024-05-08T10:55:56.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.192+0000 7f775f7fe640 1 -- 172.21.15.33:0/2211660956 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7758031600 con 0x7f77600d0c20 2024-05-08T10:55:56.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.192+0000 7f775f7fe640 1 -- 172.21.15.33:0/2211660956 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77580319f0 con 0x7f77600d0c20 2024-05-08T10:55:56.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.192+0000 7f7766bf5640 1 -- 172.21.15.33:0/2211660956 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f77600d0c20 msgr2=0x7f77600d1fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:56.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.192+0000 7f7766bf5640 1 --2- 172.21.15.33:0/2211660956 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f77600d0c20 0x7f77600d1fb0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f7758009e50 tx=0x7f775802a7c0 comp rx=0 tx=0).stop 2024-05-08T10:55:56.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.192+0000 7f7766bf5640 1 -- 172.21.15.33:0/2211660956 shutdown_connections 2024-05-08T10:55:56.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.192+0000 7f7766bf5640 1 --2- 172.21.15.33:0/2211660956 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f77600d0c20 0x7f77600d1fb0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:56.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.192+0000 7f7766bf5640 1 -- 172.21.15.33:0/2211660956 >> 172.21.15.33:0/2211660956 conn(0x7f776009ce90 msgr2=0x7f77600d3b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:56.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.192+0000 7f7766bf5640 1 -- 172.21.15.33:0/2211660956 shutdown_connections 2024-05-08T10:55:56.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.192+0000 7f7766bf5640 1 -- 172.21.15.33:0/2211660956 wait complete. 2024-05-08T10:55:56.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.193+0000 7f7766bf5640 1 Processor -- start 2024-05-08T10:55:56.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.194+0000 7f7766bf5640 1 -- start start 2024-05-08T10:55:56.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.194+0000 7f7766bf5640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f77600b33b0 0x7f77601f6870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:56.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.194+0000 7f7766bf5640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f77600b4320 0x7f77600b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:56.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.194+0000 7f7766bf5640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f77600d0c20 0x7f77600cd280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:56.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.194+0000 7f7766bf5640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77600b4ca0 con 0x7f77600d0c20 2024-05-08T10:55:56.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.194+0000 7f7766bf5640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77600b3860 con 0x7f77600b4320 2024-05-08T10:55:56.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.194+0000 7f7766bf5640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77600cf230 con 0x7f77600b33b0 2024-05-08T10:55:56.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.195+0000 7f7765192640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f77600d0c20 0x7f77600cd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:56.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.195+0000 7f7765192640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f77600d0c20 0x7f77600cd280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46146/0 (socket says 172.21.15.33:46146) 2024-05-08T10:55:56.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.195+0000 7f7765192640 1 -- 172.21.15.33:0/4199013327 learned_addr learned my addr 172.21.15.33:0/4199013327 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:56.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.195+0000 7f775ffff640 1 --2- 172.21.15.33:0/4199013327 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f77600b4320 0x7f77600b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:56.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.195+0000 7f7764991640 1 --2- 172.21.15.33:0/4199013327 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f77600b33b0 0x7f77601f6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:56.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.195+0000 7f7765192640 1 -- 172.21.15.33:0/4199013327 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f77600b33b0 msgr2=0x7f77601f6870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:56.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.195+0000 7f7765192640 1 --2- 172.21.15.33:0/4199013327 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f77600b33b0 0x7f77601f6870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:56.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.195+0000 7f7765192640 1 -- 172.21.15.33:0/4199013327 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f77600b4320 msgr2=0x7f77600b71b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:56.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.195+0000 7f7765192640 1 --2- 172.21.15.33:0/4199013327 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f77600b4320 0x7f77600b71b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:56.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.195+0000 7f7765192640 1 -- 172.21.15.33:0/4199013327 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77601f6db0 con 0x7f77600d0c20 2024-05-08T10:55:56.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.195+0000 7f775ffff640 1 --2- 172.21.15.33:0/4199013327 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f77600b4320 0x7f77600b71b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:55:56.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.195+0000 7f7764991640 1 --2- 172.21.15.33:0/4199013327 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f77600b33b0 0x7f77601f6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:55:56.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.195+0000 7f7765192640 1 --2- 172.21.15.33:0/4199013327 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f77600d0c20 0x7f77600cd280 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f7758009f70 tx=0x7f7758004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:56.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.195+0000 7f775d7fa640 1 -- 172.21.15.33:0/4199013327 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7758036050 con 0x7f77600d0c20 2024-05-08T10:55:56.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.195+0000 7f775d7fa640 1 -- 172.21.15.33:0/4199013327 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7758042070 con 0x7f77600d0c20 2024-05-08T10:55:56.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.195+0000 7f7766bf5640 1 -- 172.21.15.33:0/4199013327 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77601f57d0 con 0x7f77600d0c20 2024-05-08T10:55:56.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.195+0000 7f775d7fa640 1 -- 172.21.15.33:0/4199013327 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7758009510 con 0x7f77600d0c20 2024-05-08T10:55:56.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.195+0000 7f7766bf5640 1 -- 172.21.15.33:0/4199013327 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77601f5d90 con 0x7f77600d0c20 2024-05-08T10:55:56.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.196+0000 7f7766bf5640 1 -- 172.21.15.33:0/4199013327 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7760069d20 con 0x7f77600d0c20 2024-05-08T10:55:56.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.197+0000 7f775d7fa640 1 -- 172.21.15.33:0/4199013327 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7758004450 con 0x7f77600d0c20 2024-05-08T10:55:56.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.197+0000 7f775d7fa640 1 --2- 172.21.15.33:0/4199013327 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f774006b4d0 0x7f774006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:56.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.198+0000 7f775d7fa640 1 -- 172.21.15.33:0/4199013327 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f77580aabe0 con 0x7f77600d0c20 2024-05-08T10:55:56.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.198+0000 7f7764991640 1 --2- 172.21.15.33:0/4199013327 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f774006b4d0 0x7f774006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:56.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.198+0000 7f7764991640 1 --2- 172.21.15.33:0/4199013327 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f774006b4d0 0x7f774006d990 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7750000f60 tx=0x7f7750009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:56.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.202+0000 7f775d7fa640 1 -- 172.21.15.33:0/4199013327 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f775804c020 con 0x7f77600d0c20 2024-05-08T10:55:56.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.388+0000 7f7766bf5640 1 -- 172.21.15.33:0/4199013327 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f77600d11c0 con 0x7f77600d0c20 2024-05-08T10:55:56.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.391+0000 7f775d7fa640 1 -- 172.21.15.33:0/4199013327 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f7758079d60 con 0x7f77600d0c20 2024-05-08T10:55:56.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.393+0000 7f7766bf5640 1 -- 172.21.15.33:0/4199013327 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f774006b4d0 msgr2=0x7f774006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:56.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.393+0000 7f7766bf5640 1 --2- 172.21.15.33:0/4199013327 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f774006b4d0 0x7f774006d990 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7750000f60 tx=0x7f7750009040 comp rx=0 tx=0).stop 2024-05-08T10:55:56.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.393+0000 7f7766bf5640 1 -- 172.21.15.33:0/4199013327 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f77600d0c20 msgr2=0x7f77600cd280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:56.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.393+0000 7f7766bf5640 1 --2- 172.21.15.33:0/4199013327 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f77600d0c20 0x7f77600cd280 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f7758009f70 tx=0x7f7758004a40 comp rx=0 tx=0).stop 2024-05-08T10:55:56.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.393+0000 7f7766bf5640 1 -- 172.21.15.33:0/4199013327 shutdown_connections 2024-05-08T10:55:56.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.393+0000 7f7766bf5640 1 --2- 172.21.15.33:0/4199013327 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f774006b4d0 0x7f774006d990 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:56.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.393+0000 7f7766bf5640 1 --2- 172.21.15.33:0/4199013327 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f77600d0c20 0x7f77600cd280 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:56.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.393+0000 7f7766bf5640 1 --2- 172.21.15.33:0/4199013327 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f77600b4320 0x7f77600b71b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:56.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.393+0000 7f7766bf5640 1 --2- 172.21.15.33:0/4199013327 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f77600b33b0 0x7f77601f6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:56.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.393+0000 7f7766bf5640 1 -- 172.21.15.33:0/4199013327 >> 172.21.15.33:0/4199013327 conn(0x7f776009ce90 msgr2=0x7f77600b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:56.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.394+0000 7f7766bf5640 1 -- 172.21.15.33:0/4199013327 shutdown_connections 2024-05-08T10:55:56.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.394+0000 7f7766bf5640 1 -- 172.21.15.33:0/4199013327 wait complete. 2024-05-08T10:55:56.402 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_flush.TestFlush.test_flush' 2024-05-08T10:55:56.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.509+0000 7f1f31a9a640 1 Processor -- start 2024-05-08T10:55:56.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.509+0000 7f1f31a9a640 1 -- start start 2024-05-08T10:55:56.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.510+0000 7f1f31a9a640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1f2c0d4960 0x7f1f2c0d17e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:56.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.510+0000 7f1f31a9a640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f1f2c0d1e10 0x7f1f2c0d2240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:56.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.510+0000 7f1f31a9a640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f2c0ce720 con 0x7f1f2c1613a0 2024-05-08T10:55:56.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.510+0000 7f1f31a9a640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f2c0cf010 con 0x7f1f2c0d1e10 2024-05-08T10:55:56.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.510+0000 7f1f31a9a640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f2c0d2780 con 0x7f1f2c0d4960 2024-05-08T10:55:56.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.510+0000 7f1f2bfff640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f1f2c0d1e10 0x7f1f2c0d2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:56.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.510+0000 7f1f2bfff640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f1f2c0d1e10 0x7f1f2c0d2240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46162/0 (socket says 172.21.15.33:46162) 2024-05-08T10:55:56.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.510+0000 7f1f2b7fe640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f1f2c1613a0 0x7f1f2c0cf4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:44630/0 (socket says 172.21.15.33:44630) 2024-05-08T10:55:56.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.510+0000 7f1f2bfff640 1 -- 172.21.15.33:0/1072933320 learned_addr learned my addr 172.21.15.33:0/1072933320 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:56.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.510+0000 7f1f2bfff640 1 -- 172.21.15.33:0/1072933320 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1f2c0d4960 msgr2=0x7f1f2c0d17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:56.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.510+0000 7f1f2affd640 1 --2- 172.21.15.33:0/1072933320 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1f2c0d4960 0x7f1f2c0d17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:56.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.510+0000 7f1f2a7fc640 1 -- 172.21.15.33:0/1072933320 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3807321353 0 0) 0x7f1f2c0ce720 con 0x7f1f2c1613a0 2024-05-08T10:55:56.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.510+0000 7f1f2bfff640 1 --2- 172.21.15.33:0/1072933320 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1f2c0d4960 0x7f1f2c0d17e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:56.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.510+0000 7f1f2bfff640 1 -- 172.21.15.33:0/1072933320 >> v1:172.21.15.33:6789/0 conn(0x7f1f2c1613a0 legacy=0x7f1f2c0cf4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:56.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.510+0000 7f1f2bfff640 1 -- 172.21.15.33:0/1072933320 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f2c0d12d0 con 0x7f1f2c0d1e10 2024-05-08T10:55:56.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.511+0000 7f1f2bfff640 1 --2- 172.21.15.33:0/1072933320 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f2c0d1e10 0x7f1f2c0d2240 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f1f24009e50 tx=0x7f1f2402a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ead0762e8cd3354 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:56.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.511+0000 7f1f2a7fc640 1 -- 172.21.15.33:0/1072933320 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f24036070 con 0x7f1f2c0d1e10 2024-05-08T10:55:56.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.511+0000 7f1f2a7fc640 1 -- 172.21.15.33:0/1072933320 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f24031600 con 0x7f1f2c0d1e10 2024-05-08T10:55:56.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.511+0000 7f1f2a7fc640 1 -- 172.21.15.33:0/1072933320 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f240319d0 con 0x7f1f2c0d1e10 2024-05-08T10:55:56.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.512+0000 7f1f31a9a640 1 -- 172.21.15.33:0/1072933320 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f2c0d1e10 msgr2=0x7f1f2c0d2240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:56.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.512+0000 7f1f31a9a640 1 --2- 172.21.15.33:0/1072933320 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f2c0d1e10 0x7f1f2c0d2240 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f1f24009e50 tx=0x7f1f2402a710 comp rx=0 tx=0).stop 2024-05-08T10:55:56.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.512+0000 7f1f31a9a640 1 -- 172.21.15.33:0/1072933320 shutdown_connections 2024-05-08T10:55:56.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.512+0000 7f1f31a9a640 1 --2- 172.21.15.33:0/1072933320 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1f2c0d4960 0x7f1f2c0d17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:56.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.512+0000 7f1f31a9a640 1 --2- 172.21.15.33:0/1072933320 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f2c0d1e10 0x7f1f2c0d2240 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:56.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.512+0000 7f1f31a9a640 1 -- 172.21.15.33:0/1072933320 >> 172.21.15.33:0/1072933320 conn(0x7f1f2c0d3c10 msgr2=0x7f1f2c0d4020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:56.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.512+0000 7f1f31a9a640 1 -- 172.21.15.33:0/1072933320 shutdown_connections 2024-05-08T10:55:56.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.512+0000 7f1f31a9a640 1 -- 172.21.15.33:0/1072933320 wait complete. 2024-05-08T10:55:56.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.513+0000 7f1f31a9a640 1 Processor -- start 2024-05-08T10:55:56.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.513+0000 7f1f31a9a640 1 -- start start 2024-05-08T10:55:56.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.514+0000 7f1f31a9a640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1f2c0d1e10 0x7f1f2c0c7720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:56.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.514+0000 7f1f31a9a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f2c0d4960 0x7f1f2c0b1770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:56.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.514+0000 7f1f31a9a640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f2c1613a0 0x7f1f2c0b1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:56.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.514+0000 7f1f31a9a640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f2c0cfbb0 con 0x7f1f2c0d4960 2024-05-08T10:55:56.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.514+0000 7f1f31a9a640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f2c0ceca0 con 0x7f1f2c1613a0 2024-05-08T10:55:56.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.514+0000 7f1f31a9a640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f2c0d0f80 con 0x7f1f2c0d1e10 2024-05-08T10:55:56.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.514+0000 7f1f2affd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f2c0d4960 0x7f1f2c0b1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:56.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.514+0000 7f1f2affd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f2c0d4960 0x7f1f2c0b1770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46172/0 (socket says 172.21.15.33:46172) 2024-05-08T10:55:56.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.514+0000 7f1f2affd640 1 -- 172.21.15.33:0/2570068423 learned_addr learned my addr 172.21.15.33:0/2570068423 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:56.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.514+0000 7f1f2b7fe640 1 --2- 172.21.15.33:0/2570068423 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1f2c0d1e10 0x7f1f2c0c7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:56.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.514+0000 7f1f2bfff640 1 --2- 172.21.15.33:0/2570068423 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f2c1613a0 0x7f1f2c0b1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:56.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.514+0000 7f1f2affd640 1 -- 172.21.15.33:0/2570068423 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1f2c0d1e10 msgr2=0x7f1f2c0c7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:56.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.514+0000 7f1f2affd640 1 --2- 172.21.15.33:0/2570068423 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1f2c0d1e10 0x7f1f2c0c7720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:56.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.514+0000 7f1f2affd640 1 -- 172.21.15.33:0/2570068423 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f2c1613a0 msgr2=0x7f1f2c0b1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:56.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.514+0000 7f1f2affd640 1 --2- 172.21.15.33:0/2570068423 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f2c1613a0 0x7f1f2c0b1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:56.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.514+0000 7f1f2affd640 1 -- 172.21.15.33:0/2570068423 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f2c0c87a0 con 0x7f1f2c0d4960 2024-05-08T10:55:56.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.514+0000 7f1f2affd640 1 --2- 172.21.15.33:0/2570068423 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f2c0d4960 0x7f1f2c0b1770 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f1f2000c7f0 tx=0x7f1f2000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:56.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.515+0000 7f1f13fff640 1 -- 172.21.15.33:0/2570068423 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f20015070 con 0x7f1f2c0d4960 2024-05-08T10:55:56.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.515+0000 7f1f13fff640 1 -- 172.21.15.33:0/2570068423 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f20004240 con 0x7f1f2c0d4960 2024-05-08T10:55:56.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.515+0000 7f1f31a9a640 1 -- 172.21.15.33:0/2570068423 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f2c0c81e0 con 0x7f1f2c0d4960 2024-05-08T10:55:56.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.515+0000 7f1f13fff640 1 -- 172.21.15.33:0/2570068423 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f20007620 con 0x7f1f2c0d4960 2024-05-08T10:55:56.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.515+0000 7f1f31a9a640 1 -- 172.21.15.33:0/2570068423 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f2c0c8ca0 con 0x7f1f2c0d4960 2024-05-08T10:55:56.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.516+0000 7f1f31a9a640 1 -- 172.21.15.33:0/2570068423 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f2c069d20 con 0x7f1f2c0d4960 2024-05-08T10:55:56.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.516+0000 7f1f13fff640 1 -- 172.21.15.33:0/2570068423 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1f200079d0 con 0x7f1f2c0d4960 2024-05-08T10:55:56.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.517+0000 7f1f13fff640 1 --2- 172.21.15.33:0/2570068423 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f1f1806b4d0 0x7f1f1806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:56.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.517+0000 7f1f13fff640 1 -- 172.21.15.33:0/2570068423 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f1f20089e20 con 0x7f1f2c0d4960 2024-05-08T10:55:56.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.517+0000 7f1f2b7fe640 1 --2- 172.21.15.33:0/2570068423 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f1f1806b4d0 0x7f1f1806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:56.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.517+0000 7f1f2b7fe640 1 --2- 172.21.15.33:0/2570068423 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f1f1806b4d0 0x7f1f1806d990 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1f1c007fd0 tx=0x7f1f1c007de0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:56.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.521+0000 7f1f13fff640 1 -- 172.21.15.33:0/2570068423 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1f200589e0 con 0x7f1f2c0d4960 2024-05-08T10:55:56.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:56.771+0000 7f1f31a9a640 1 -- 172.21.15.33:0/2570068423 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_flush.TestFlush.test_flush"]} v 0) v1 -- 0x7f1f2c06cf50 con 0x7f1f2c0d4960 2024-05-08T10:55:57.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:57.060+0000 7f1f13fff640 1 -- 172.21.15.33:0/2570068423 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_flush.TestFlush.test_flush"]}]=0 v87) v1 ==== 123+0+0 (secure 0 0 0) 0x7f1f2005ca80 con 0x7f1f2c0d4960 2024-05-08T10:55:57.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:57.062+0000 7f1f31a9a640 1 -- 172.21.15.33:0/2570068423 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f1f1806b4d0 msgr2=0x7f1f1806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:57.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:57.062+0000 7f1f31a9a640 1 --2- 172.21.15.33:0/2570068423 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f1f1806b4d0 0x7f1f1806d990 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1f1c007fd0 tx=0x7f1f1c007de0 comp rx=0 tx=0).stop 2024-05-08T10:55:57.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:57.062+0000 7f1f31a9a640 1 -- 172.21.15.33:0/2570068423 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f2c0d4960 msgr2=0x7f1f2c0b1770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:57.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:57.062+0000 7f1f31a9a640 1 --2- 172.21.15.33:0/2570068423 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f2c0d4960 0x7f1f2c0b1770 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f1f2000c7f0 tx=0x7f1f2000ccb0 comp rx=0 tx=0).stop 2024-05-08T10:55:57.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:57.062+0000 7f1f31a9a640 1 -- 172.21.15.33:0/2570068423 shutdown_connections 2024-05-08T10:55:57.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:57.062+0000 7f1f31a9a640 1 --2- 172.21.15.33:0/2570068423 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f1f1806b4d0 0x7f1f1806d990 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:57.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:57.062+0000 7f1f31a9a640 1 --2- 172.21.15.33:0/2570068423 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f2c1613a0 0x7f1f2c0b1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:57.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:57.062+0000 7f1f31a9a640 1 --2- 172.21.15.33:0/2570068423 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f2c0d4960 0x7f1f2c0b1770 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:57.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:57.062+0000 7f1f31a9a640 1 --2- 172.21.15.33:0/2570068423 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1f2c0d1e10 0x7f1f2c0c7720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:57.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:57.062+0000 7f1f31a9a640 1 -- 172.21.15.33:0/2570068423 >> 172.21.15.33:0/2570068423 conn(0x7f1f2c0d3c10 msgr2=0x7f1f2c0cfd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:57.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:57.063+0000 7f1f31a9a640 1 -- 172.21.15.33:0/2570068423 shutdown_connections 2024-05-08T10:55:57.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:57.063+0000 7f1f31a9a640 1 -- 172.21.15.33:0/2570068423 wait complete. 2024-05-08T10:55:57.071 INFO:tasks.cephfs_test_runner:test_flush (tasks.cephfs.test_flush.TestFlush) ... ok 2024-05-08T10:55:57.071 INFO:tasks.cephfs_test_runner: 2024-05-08T10:55:57.072 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-05-08T10:55:57.072 INFO:tasks.cephfs_test_runner:Ran 1 test in 42.668s 2024-05-08T10:55:57.072 INFO:tasks.cephfs_test_runner: 2024-05-08T10:55:57.072 INFO:tasks.cephfs_test_runner:OK 2024-05-08T10:55:57.072 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-05-08T10:55:57.082 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-05-08T10:55:57.113 INFO:tasks.kclient:Unmounting kernel clients... 2024-05-08T10:55:57.113 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-05-08T10:55:57.113 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T10:55:57.129 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057103,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2352 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249452k,nr_inodes=812363,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-08T10:55:57.130 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-05-08T10:55:57.130 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T10:55:57.186 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057103,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2352 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249452k,nr_inodes=812363,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-08T10:55:57.186 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-05-08T10:55:57.186 DEBUG:teuthology.orchestra.run.smithi174:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T10:55:57.206 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056323,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497656k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=881 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248824k,nr_inodes=812206,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497656k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-08T10:55:57.206 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-05-08T10:55:57.206 DEBUG:teuthology.orchestra.run.smithi174:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T10:55:57.265 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056323,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497656k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=881 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248824k,nr_inodes=812206,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497656k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-08T10:55:57.265 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:55:57.265 DEBUG:teuthology.orchestra.run.smithi033:> ip netns list 2024-05-08T10:55:57.282 INFO:teuthology.orchestra.run.smithi033.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-08T10:55:57.282 INFO:teuthology.orchestra.run.smithi033.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-08T10:55:57.282 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:55:57.282 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-08T10:55:57.349 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:55:57.349 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-08T10:55:57.417 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:55:57.417 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link delete ceph-brx 2024-05-08T10:55:57.515 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:55:57.515 DEBUG:teuthology.orchestra.run.smithi033:> ip netns list 2024-05-08T10:55:57.531 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:55:57.531 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link delete ceph-brx 2024-05-08T10:55:57.601 INFO:teuthology.orchestra.run.smithi033.stderr:Cannot find device "ceph-brx" 2024-05-08T10:55:57.602 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T10:55:57.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:55:57.603 DEBUG:teuthology.orchestra.run.smithi174:> ip netns list 2024-05-08T10:55:57.622 INFO:teuthology.orchestra.run.smithi174.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-05-08T10:55:57.622 INFO:teuthology.orchestra.run.smithi174.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-05-08T10:55:57.622 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:55:57.623 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-08T10:55:57.693 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:55:57.693 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-08T10:55:57.761 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:55:57.761 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip link delete ceph-brx 2024-05-08T10:55:57.846 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:55:57.846 DEBUG:teuthology.orchestra.run.smithi174:> ip netns list 2024-05-08T10:55:57.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T10:55:57.862 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip link delete ceph-brx 2024-05-08T10:55:57.930 INFO:teuthology.orchestra.run.smithi174.stderr:Cannot find device "ceph-brx" 2024-05-08T10:55:57.931 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T10:55:57.932 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-05-08T10:55:57.941 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-08T10:55:57.941 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T10:55:58.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.050+0000 7f69d78e1640 1 Processor -- start 2024-05-08T10:55:58.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.050+0000 7f69d78e1640 1 -- start start 2024-05-08T10:55:58.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.051+0000 7f69d78e1640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f69d00cdc70 0x7f69d00b43e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:58.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.051+0000 7f69d78e1640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f69d00b4920 0x7f69d00b2d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:58.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.051+0000 7f69d78e1640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69d00b4d00 con 0x7f69d01455b0 2024-05-08T10:55:58.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.051+0000 7f69d78e1640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69d0145990 con 0x7f69d00b4920 2024-05-08T10:55:58.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.051+0000 7f69d78e1640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69d00cfbd0 con 0x7f69d00cdc70 2024-05-08T10:55:58.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.051+0000 7f69d5e7e640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f69d00b4920 0x7f69d00b2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:58.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.051+0000 7f69d5e7e640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f69d00b4920 0x7f69d00b2d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46182/0 (socket says 172.21.15.33:46182) 2024-05-08T10:55:58.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.051+0000 7f69d5e7e640 1 -- 172.21.15.33:0/823536043 learned_addr learned my addr 172.21.15.33:0/823536043 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:58.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.052+0000 7f69d4e7c640 1 --2- 172.21.15.33:0/823536043 >> v2:172.21.15.174:3300/0 conn(0x7f69d00cdc70 0x7f69d00b43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:58.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.052+0000 7f69d5e7e640 1 -- 172.21.15.33:0/823536043 >> v2:172.21.15.174:3300/0 conn(0x7f69d00cdc70 msgr2=0x7f69d00b43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:58.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.052+0000 7f69d5e7e640 1 --2- 172.21.15.33:0/823536043 >> v2:172.21.15.174:3300/0 conn(0x7f69d00cdc70 0x7f69d00b43e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:58.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.052+0000 7f69d5e7e640 1 -- 172.21.15.33:0/823536043 >> v1:172.21.15.174:6789/0 conn(0x7f69d01455b0 legacy=0x7f69d015cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:58.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.052+0000 7f69d5e7e640 1 -- 172.21.15.33:0/823536043 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69d006cb10 con 0x7f69d00b4920 2024-05-08T10:55:58.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.052+0000 7f69d5e7e640 1 --2- 172.21.15.33:0/823536043 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f69d00b4920 0x7f69d00b2d10 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f69d0160730 tx=0x7f69c802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=163169253316edc2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:58.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.053+0000 7f69c7fff640 1 -- 172.21.15.33:0/823536043 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69c8036070 con 0x7f69d00b4920 2024-05-08T10:55:58.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.053+0000 7f69c7fff640 1 -- 172.21.15.33:0/823536043 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69c8031600 con 0x7f69d00b4920 2024-05-08T10:55:58.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.053+0000 7f69c7fff640 1 -- 172.21.15.33:0/823536043 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69c80319d0 con 0x7f69d00b4920 2024-05-08T10:55:58.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.053+0000 7f69d78e1640 1 -- 172.21.15.33:0/823536043 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f69d00b4920 msgr2=0x7f69d00b2d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:58.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.053+0000 7f69d78e1640 1 --2- 172.21.15.33:0/823536043 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f69d00b4920 0x7f69d00b2d10 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f69d0160730 tx=0x7f69c802a660 comp rx=0 tx=0).stop 2024-05-08T10:55:58.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.053+0000 7f69d78e1640 1 -- 172.21.15.33:0/823536043 shutdown_connections 2024-05-08T10:55:58.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.053+0000 7f69d78e1640 1 --2- 172.21.15.33:0/823536043 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f69d00b4920 0x7f69d00b2d10 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:58.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.053+0000 7f69d78e1640 1 --2- 172.21.15.33:0/823536043 >> v2:172.21.15.174:3300/0 conn(0x7f69d00cdc70 0x7f69d00b43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:58.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.053+0000 7f69d78e1640 1 -- 172.21.15.33:0/823536043 >> 172.21.15.33:0/823536043 conn(0x7f69d006aba0 msgr2=0x7f69d006afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:58.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.053+0000 7f69d78e1640 1 -- 172.21.15.33:0/823536043 shutdown_connections 2024-05-08T10:55:58.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.053+0000 7f69d78e1640 1 -- 172.21.15.33:0/823536043 wait complete. 2024-05-08T10:55:58.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.054+0000 7f69d78e1640 1 Processor -- start 2024-05-08T10:55:58.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.055+0000 7f69d78e1640 1 -- start start 2024-05-08T10:55:58.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.055+0000 7f69d78e1640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f69d00b4920 0x7f69d0155d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:58.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.055+0000 7f69d78e1640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f69d00cdc70 0x7f69d0153a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:58.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.055+0000 7f69d78e1640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f69d01455b0 0x7f69d01f3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:58.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.055+0000 7f69d78e1640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69d006d3b0 con 0x7f69d01455b0 2024-05-08T10:55:58.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.055+0000 7f69d78e1640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69d006d0d0 con 0x7f69d00cdc70 2024-05-08T10:55:58.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.055+0000 7f69d78e1640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69d006c6c0 con 0x7f69d00b4920 2024-05-08T10:55:58.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.055+0000 7f69d5e7e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f69d01455b0 0x7f69d01f3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:58.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.055+0000 7f69d5e7e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f69d01455b0 0x7f69d01f3570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46196/0 (socket says 172.21.15.33:46196) 2024-05-08T10:55:58.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.055+0000 7f69d5e7e640 1 -- 172.21.15.33:0/1015598546 learned_addr learned my addr 172.21.15.33:0/1015598546 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:58.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.056+0000 7f69d4e7c640 1 --2- 172.21.15.33:0/1015598546 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f69d00cdc70 0x7f69d0153a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:58.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.056+0000 7f69d567d640 1 --2- 172.21.15.33:0/1015598546 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f69d00b4920 0x7f69d0155d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:58.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.056+0000 7f69d5e7e640 1 -- 172.21.15.33:0/1015598546 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f69d00b4920 msgr2=0x7f69d0155d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:58.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.056+0000 7f69d5e7e640 1 --2- 172.21.15.33:0/1015598546 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f69d00b4920 0x7f69d0155d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:58.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.056+0000 7f69d5e7e640 1 -- 172.21.15.33:0/1015598546 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f69d00cdc70 msgr2=0x7f69d0153a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:58.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.056+0000 7f69d5e7e640 1 --2- 172.21.15.33:0/1015598546 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f69d00cdc70 0x7f69d0153a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:58.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.056+0000 7f69d5e7e640 1 -- 172.21.15.33:0/1015598546 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69d0153f80 con 0x7f69d01455b0 2024-05-08T10:55:58.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.056+0000 7f69d5e7e640 1 --2- 172.21.15.33:0/1015598546 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f69d01455b0 0x7f69d01f3570 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f69c802ac50 tx=0x7f69c8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:58.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.056+0000 7f69c5ffb640 1 -- 172.21.15.33:0/1015598546 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69c8041020 con 0x7f69d01455b0 2024-05-08T10:55:58.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.056+0000 7f69c5ffb640 1 -- 172.21.15.33:0/1015598546 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69c8007780 con 0x7f69d01455b0 2024-05-08T10:55:58.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.056+0000 7f69d78e1640 1 -- 172.21.15.33:0/1015598546 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69d0154200 con 0x7f69d01455b0 2024-05-08T10:55:58.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.056+0000 7f69c5ffb640 1 -- 172.21.15.33:0/1015598546 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69c8036040 con 0x7f69d01455b0 2024-05-08T10:55:58.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.056+0000 7f69d78e1640 1 -- 172.21.15.33:0/1015598546 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69d01547c0 con 0x7f69d01455b0 2024-05-08T10:55:58.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.057+0000 7f69d78e1640 1 -- 172.21.15.33:0/1015598546 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69d0069d20 con 0x7f69d01455b0 2024-05-08T10:55:58.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.058+0000 7f69c5ffb640 1 -- 172.21.15.33:0/1015598546 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f69c8044020 con 0x7f69d01455b0 2024-05-08T10:55:58.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.058+0000 7f69c5ffb640 1 --2- 172.21.15.33:0/1015598546 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f69b406b4d0 0x7f69b406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:58.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.059+0000 7f69c5ffb640 1 -- 172.21.15.33:0/1015598546 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f69c80aaaa0 con 0x7f69d01455b0 2024-05-08T10:55:58.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.059+0000 7f69d567d640 1 --2- 172.21.15.33:0/1015598546 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f69b406b4d0 0x7f69b406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:58.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.059+0000 7f69d567d640 1 --2- 172.21.15.33:0/1015598546 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f69b406b4d0 0x7f69b406d990 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f69cc006fd0 tx=0x7f69cc009060 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:58.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.063+0000 7f69c5ffb640 1 -- 172.21.15.33:0/1015598546 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f69c804b030 con 0x7f69d01455b0 2024-05-08T10:55:58.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.240+0000 7f69d78e1640 1 -- 172.21.15.33:0/1015598546 --> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f69d006dcb0 con 0x7f69b406b4d0 2024-05-08T10:55:58.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.242+0000 7f69c5ffb640 1 -- 172.21.15.33:0/1015598546 <== mgr.4103 v2:172.21.15.174:6832/261355069 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+13427 (secure 0 0 0) 0x7f69d006dcb0 con 0x7f69b406b4d0 2024-05-08T10:55:58.240 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:55:58.240 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-05-08T10:55:58.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.243+0000 7f69d78e1640 1 -- 172.21.15.33:0/1015598546 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f69b406b4d0 msgr2=0x7f69b406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:58.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.243+0000 7f69d78e1640 1 --2- 172.21.15.33:0/1015598546 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f69b406b4d0 0x7f69b406d990 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f69cc006fd0 tx=0x7f69cc009060 comp rx=0 tx=0).stop 2024-05-08T10:55:58.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.243+0000 7f69d78e1640 1 -- 172.21.15.33:0/1015598546 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f69d01455b0 msgr2=0x7f69d01f3570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:58.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.243+0000 7f69d78e1640 1 --2- 172.21.15.33:0/1015598546 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f69d01455b0 0x7f69d01f3570 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f69c802ac50 tx=0x7f69c8004a40 comp rx=0 tx=0).stop 2024-05-08T10:55:58.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.244+0000 7f69d78e1640 1 -- 172.21.15.33:0/1015598546 shutdown_connections 2024-05-08T10:55:58.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.244+0000 7f69d78e1640 1 --2- 172.21.15.33:0/1015598546 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f69b406b4d0 0x7f69b406d990 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:58.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.244+0000 7f69d78e1640 1 --2- 172.21.15.33:0/1015598546 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f69d01455b0 0x7f69d01f3570 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:58.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.244+0000 7f69d78e1640 1 --2- 172.21.15.33:0/1015598546 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f69d00cdc70 0x7f69d0153a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:58.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.244+0000 7f69d78e1640 1 --2- 172.21.15.33:0/1015598546 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f69d00b4920 0x7f69d0155d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:58.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.244+0000 7f69d78e1640 1 -- 172.21.15.33:0/1015598546 >> 172.21.15.33:0/1015598546 conn(0x7f69d006aba0 msgr2=0x7f69d00ce0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:58.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.244+0000 7f69d78e1640 1 -- 172.21.15.33:0/1015598546 shutdown_connections 2024-05-08T10:55:58.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.244+0000 7f69d78e1640 1 -- 172.21.15.33:0/1015598546 wait complete. 2024-05-08T10:55:58.252 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":66,"stamp":"2024-05-08T10:55:56.958995+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220240,"kb_used_data":4084,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754480,"statfs":{"total":773094113280,"available":772868587520,"internally_reserved":0,"allocated":4182016,"data_stored":2352183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-26597,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-16,"num_read_kb":-12,"num_write":-111,"num_write_kb":-66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001324"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":191,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T10:55:53.467705+0000","last_change":"2024-05-08T10:54:40.015226+0000","last_active":"2024-05-08T10:55:53.467705+0000","last_peered":"2024-05-08T10:55:53.467705+0000","last_clean":"2024-05-08T10:55:53.467705+0000","last_became_active":"2024-05-08T10:54:40.014219+0000","last_became_peered":"2024-05-08T10:54:40.014219+0000","last_unstale":"2024-05-08T10:55:53.467705+0000","last_undegraded":"2024-05-08T10:55:53.467705+0000","last_fullsized":"2024-05-08T10:55:53.467705+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:38.989328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:38.989328+0000","last_clean_scrub_stamp":"2024-05-08T10:54:38.989328+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:10:59.668786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27940,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343900,"statfs":{"total":96636764160,"available":96608153600,"internally_reserved":0,"allocated":946176,"data_stored":724584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":140823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":372736,"data_stored":141081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":372736,"data_stored":140513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":401408,"data_stored":167165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":364544,"data_stored":140277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":401408,"data_stored":167165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27952,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343888,"statfs":{"total":96636764160,"available":96608141312,"internally_reserved":0,"allocated":954368,"data_stored":730575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T10:55:58.252 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T10:55:58.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.359+0000 7ff6a789e640 1 Processor -- start 2024-05-08T10:55:58.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.359+0000 7ff6a789e640 1 -- start start 2024-05-08T10:55:58.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.360+0000 7ff6a789e640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff6a00d2520 0x7ff6a00d17e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:58.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.360+0000 7ff6a789e640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6a00ce720 con 0x7ff6a01613a0 2024-05-08T10:55:58.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.360+0000 7ff6a789e640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6a00d12d0 con 0x7ff6a00d4960 2024-05-08T10:55:58.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.360+0000 7ff6a789e640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6a00cf010 con 0x7ff6a00d2520 2024-05-08T10:55:58.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.360+0000 7ff6a5e3b640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff6a00d2520 0x7ff6a00d17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:58.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.360+0000 7ff6a5e3b640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff6a00d2520 0x7ff6a00d17e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46198/0 (socket says 172.21.15.33:46198) 2024-05-08T10:55:58.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.360+0000 7ff6a563a640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7ff6a01613a0 0x7ff6a00cf4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:44638/0 (socket says 172.21.15.33:44638) 2024-05-08T10:55:58.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.360+0000 7ff6a5e3b640 1 -- 172.21.15.33:0/2083521917 learned_addr learned my addr 172.21.15.33:0/2083521917 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:58.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.360+0000 7ff6a5e3b640 1 -- 172.21.15.33:0/2083521917 >> v1:172.21.15.174:6789/0 conn(0x7ff6a00d4960 legacy=0x7ff6a00d1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:58.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.360+0000 7ff6a5e3b640 1 -- 172.21.15.33:0/2083521917 >> v1:172.21.15.33:6789/0 conn(0x7ff6a01613a0 legacy=0x7ff6a00cf4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:58.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.360+0000 7ff6a5e3b640 1 -- 172.21.15.33:0/2083521917 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6a00ce9c0 con 0x7ff6a00d2520 2024-05-08T10:55:58.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.360+0000 7ff697fff640 1 -- 172.21.15.33:0/2083521917 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 437635351 0 0) 0x7ff6a00ce720 con 0x7ff6a01613a0 2024-05-08T10:55:58.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.361+0000 7ff6a5e3b640 1 --2- 172.21.15.33:0/2083521917 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff6a00d2520 0x7ff6a00d17e0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7ff698009870 tx=0x7ff69802a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=552902a19a34c522 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:58.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.361+0000 7ff697fff640 1 -- 172.21.15.33:0/2083521917 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff698037070 con 0x7ff6a00d2520 2024-05-08T10:55:58.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.361+0000 7ff697fff640 1 -- 172.21.15.33:0/2083521917 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff69802ae50 con 0x7ff6a00d2520 2024-05-08T10:55:58.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.361+0000 7ff697fff640 1 -- 172.21.15.33:0/2083521917 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff698032860 con 0x7ff6a00d2520 2024-05-08T10:55:58.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.361+0000 7ff6a789e640 1 -- 172.21.15.33:0/2083521917 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff6a00d2520 msgr2=0x7ff6a00d17e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:58.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.361+0000 7ff6a789e640 1 --2- 172.21.15.33:0/2083521917 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff6a00d2520 0x7ff6a00d17e0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7ff698009870 tx=0x7ff69802a300 comp rx=0 tx=0).stop 2024-05-08T10:55:58.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.362+0000 7ff6a789e640 1 -- 172.21.15.33:0/2083521917 shutdown_connections 2024-05-08T10:55:58.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.362+0000 7ff6a789e640 1 --2- 172.21.15.33:0/2083521917 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff6a00d2520 0x7ff6a00d17e0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:58.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.362+0000 7ff6a789e640 1 -- 172.21.15.33:0/2083521917 >> 172.21.15.33:0/2083521917 conn(0x7ff6a00d3c10 msgr2=0x7ff6a00d4020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:58.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.362+0000 7ff6a789e640 1 -- 172.21.15.33:0/2083521917 shutdown_connections 2024-05-08T10:55:58.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.362+0000 7ff6a789e640 1 -- 172.21.15.33:0/2083521917 wait complete. 2024-05-08T10:55:58.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.363+0000 7ff6a789e640 1 Processor -- start 2024-05-08T10:55:58.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.363+0000 7ff6a789e640 1 -- start start 2024-05-08T10:55:58.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.364+0000 7ff6a789e640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff6a00d2520 0x7ff6a01528b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:58.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.364+0000 7ff6a789e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff6a00d4960 0x7ff6a00cffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:58.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.364+0000 7ff6a789e640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff6a01613a0 0x7ff6a0151c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:58.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.364+0000 7ff6a789e640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a00d0f80 con 0x7ff6a00d4960 2024-05-08T10:55:58.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.364+0000 7ff6a789e640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a00cfbb0 con 0x7ff6a01613a0 2024-05-08T10:55:58.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.364+0000 7ff6a789e640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a0161780 con 0x7ff6a00d2520 2024-05-08T10:55:58.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.364+0000 7ff6a4e39640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff6a00d4960 0x7ff6a00cffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:58.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.364+0000 7ff6a4e39640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff6a00d4960 0x7ff6a00cffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46214/0 (socket says 172.21.15.33:46214) 2024-05-08T10:55:58.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.364+0000 7ff6a4e39640 1 -- 172.21.15.33:0/131250865 learned_addr learned my addr 172.21.15.33:0/131250865 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:58.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.364+0000 7ff6a5e3b640 1 --2- 172.21.15.33:0/131250865 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff6a01613a0 0x7ff6a0151c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:58.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.364+0000 7ff6a563a640 1 --2- 172.21.15.33:0/131250865 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff6a00d2520 0x7ff6a01528b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:58.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.364+0000 7ff6a4e39640 1 -- 172.21.15.33:0/131250865 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff6a00d2520 msgr2=0x7ff6a01528b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:58.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.364+0000 7ff6a4e39640 1 --2- 172.21.15.33:0/131250865 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff6a00d2520 0x7ff6a01528b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:58.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.364+0000 7ff6a4e39640 1 -- 172.21.15.33:0/131250865 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff6a01613a0 msgr2=0x7ff6a0151c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:58.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.364+0000 7ff6a4e39640 1 --2- 172.21.15.33:0/131250865 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff6a01613a0 0x7ff6a0151c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:58.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.364+0000 7ff6a4e39640 1 -- 172.21.15.33:0/131250865 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6a0152df0 con 0x7ff6a00d4960 2024-05-08T10:55:58.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.364+0000 7ff6a4e39640 1 --2- 172.21.15.33:0/131250865 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff6a00d4960 0x7ff6a00cffa0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7ff69000c450 tx=0x7ff69000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:58.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.364+0000 7ff695ffb640 1 -- 172.21.15.33:0/131250865 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6900052d0 con 0x7ff6a00d4960 2024-05-08T10:55:58.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.364+0000 7ff695ffb640 1 -- 172.21.15.33:0/131250865 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff690005470 con 0x7ff6a00d4960 2024-05-08T10:55:58.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.364+0000 7ff695ffb640 1 -- 172.21.15.33:0/131250865 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff690012870 con 0x7ff6a00d4960 2024-05-08T10:55:58.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.364+0000 7ff6a789e640 1 -- 172.21.15.33:0/131250865 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6a00b7b10 con 0x7ff6a00d4960 2024-05-08T10:55:58.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.365+0000 7ff6a789e640 1 -- 172.21.15.33:0/131250865 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6a00b80d0 con 0x7ff6a00d4960 2024-05-08T10:55:58.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.366+0000 7ff6a789e640 1 -- 172.21.15.33:0/131250865 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6a0069d20 con 0x7ff6a00d4960 2024-05-08T10:55:58.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.366+0000 7ff695ffb640 1 -- 172.21.15.33:0/131250865 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff690012a10 con 0x7ff6a00d4960 2024-05-08T10:55:58.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.366+0000 7ff695ffb640 1 --2- 172.21.15.33:0/131250865 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7ff68406b4d0 0x7ff68406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:58.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.367+0000 7ff695ffb640 1 -- 172.21.15.33:0/131250865 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ff690089920 con 0x7ff6a00d4960 2024-05-08T10:55:58.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.367+0000 7ff6a563a640 1 --2- 172.21.15.33:0/131250865 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7ff68406b4d0 0x7ff68406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:58.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.367+0000 7ff6a563a640 1 --2- 172.21.15.33:0/131250865 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7ff68406b4d0 0x7ff68406d990 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff69c007f50 tx=0x7ff69c007ea0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:58.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.371+0000 7ff695ffb640 1 -- 172.21.15.33:0/131250865 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff6900584e0 con 0x7ff6a00d4960 2024-05-08T10:55:58.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.546+0000 7ff6a789e640 1 -- 172.21.15.33:0/131250865 --> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff6a008d980 con 0x7ff68406b4d0 2024-05-08T10:55:58.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.547+0000 7ff695ffb640 1 -- 172.21.15.33:0/131250865 <== mgr.4103 v2:172.21.15.174:6832/261355069 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+13427 (secure 0 0 0) 0x7ff6a008d980 con 0x7ff68406b4d0 2024-05-08T10:55:58.544 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:55:58.545 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-05-08T10:55:58.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.549+0000 7ff6a789e640 1 -- 172.21.15.33:0/131250865 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7ff68406b4d0 msgr2=0x7ff68406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:58.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.549+0000 7ff6a789e640 1 --2- 172.21.15.33:0/131250865 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7ff68406b4d0 0x7ff68406d990 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff69c007f50 tx=0x7ff69c007ea0 comp rx=0 tx=0).stop 2024-05-08T10:55:58.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.549+0000 7ff6a789e640 1 -- 172.21.15.33:0/131250865 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff6a00d4960 msgr2=0x7ff6a00cffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:58.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.549+0000 7ff6a789e640 1 --2- 172.21.15.33:0/131250865 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff6a00d4960 0x7ff6a00cffa0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7ff69000c450 tx=0x7ff69000c910 comp rx=0 tx=0).stop 2024-05-08T10:55:58.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.549+0000 7ff6a789e640 1 -- 172.21.15.33:0/131250865 shutdown_connections 2024-05-08T10:55:58.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.549+0000 7ff6a789e640 1 --2- 172.21.15.33:0/131250865 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7ff68406b4d0 0x7ff68406d990 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:58.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.549+0000 7ff6a789e640 1 --2- 172.21.15.33:0/131250865 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff6a01613a0 0x7ff6a0151c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:58.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.549+0000 7ff6a789e640 1 --2- 172.21.15.33:0/131250865 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff6a00d4960 0x7ff6a00cffa0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:58.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.549+0000 7ff6a789e640 1 --2- 172.21.15.33:0/131250865 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff6a00d2520 0x7ff6a01528b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:58.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.549+0000 7ff6a789e640 1 -- 172.21.15.33:0/131250865 >> 172.21.15.33:0/131250865 conn(0x7ff6a00d3c10 msgr2=0x7ff6a00b2320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:58.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.549+0000 7ff6a789e640 1 -- 172.21.15.33:0/131250865 shutdown_connections 2024-05-08T10:55:58.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.549+0000 7ff6a789e640 1 -- 172.21.15.33:0/131250865 wait complete. 2024-05-08T10:55:58.557 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":66,"stamp":"2024-05-08T10:55:56.958995+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220240,"kb_used_data":4084,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754480,"statfs":{"total":773094113280,"available":772868587520,"internally_reserved":0,"allocated":4182016,"data_stored":2352183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-26597,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-16,"num_read_kb":-12,"num_write":-111,"num_write_kb":-66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001324"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":191,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T10:55:53.467705+0000","last_change":"2024-05-08T10:54:40.015226+0000","last_active":"2024-05-08T10:55:53.467705+0000","last_peered":"2024-05-08T10:55:53.467705+0000","last_clean":"2024-05-08T10:55:53.467705+0000","last_became_active":"2024-05-08T10:54:40.014219+0000","last_became_peered":"2024-05-08T10:54:40.014219+0000","last_unstale":"2024-05-08T10:55:53.467705+0000","last_undegraded":"2024-05-08T10:55:53.467705+0000","last_fullsized":"2024-05-08T10:55:53.467705+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:38.989328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:38.989328+0000","last_clean_scrub_stamp":"2024-05-08T10:54:38.989328+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:10:59.668786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27940,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343900,"statfs":{"total":96636764160,"available":96608153600,"internally_reserved":0,"allocated":946176,"data_stored":724584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":140823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":372736,"data_stored":141081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":372736,"data_stored":140513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":401408,"data_stored":167165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":364544,"data_stored":140277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":401408,"data_stored":167165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27952,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343888,"statfs":{"total":96636764160,"available":96608141312,"internally_reserved":0,"allocated":954368,"data_stored":730575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T10:55:58.558 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-08T10:55:58.558 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T10:55:58.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.664+0000 7f5c5155a640 1 Processor -- start 2024-05-08T10:55:58.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.664+0000 7f5c5155a640 1 -- start start 2024-05-08T10:55:58.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.665+0000 7f5c5155a640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f5c4c15dfb0 0x7f5c4c0d13a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:58.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.665+0000 7f5c5155a640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c4c06b2b0 0x7f5c4c06dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:58.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.665+0000 7f5c5155a640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c4c071730 con 0x7f5c4c071f80 2024-05-08T10:55:58.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.665+0000 7f5c5155a640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c4c071a10 con 0x7f5c4c15dfb0 2024-05-08T10:55:58.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.665+0000 7f5c5155a640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4c071cf0 con 0x7f5c4c06b2b0 2024-05-08T10:55:58.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.665+0000 7f5c4b7fe640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c4c06b2b0 0x7f5c4c06dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:58.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.665+0000 7f5c4affd640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f5c4c15dfb0 0x7f5c4c0d13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:58.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.665+0000 7f5c4b7fe640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c4c06b2b0 0x7f5c4c06dce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.33:36814/0 (socket says 172.21.15.33:36814) 2024-05-08T10:55:58.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.665+0000 7f5c4b7fe640 1 -- 172.21.15.33:0/2901215574 learned_addr learned my addr 172.21.15.33:0/2901215574 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:58.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.665+0000 7f5c4a7fc640 1 --1- 172.21.15.33:0/2901215574 >> v1:172.21.15.174:6789/0 conn(0x7f5c4c071f80 0x7f5c4c06aba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.33:44004/0 (socket says 172.21.15.33:44004) 2024-05-08T10:55:58.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.666+0000 7f5c4affd640 1 -- 172.21.15.33:0/2901215574 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c4c06b2b0 msgr2=0x7f5c4c06dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:58.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.666+0000 7f5c4affd640 1 --2- 172.21.15.33:0/2901215574 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c4c06b2b0 0x7f5c4c06dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:58.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.666+0000 7f5c4affd640 1 -- 172.21.15.33:0/2901215574 >> v1:172.21.15.174:6789/0 conn(0x7f5c4c071f80 legacy=0x7f5c4c06aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:58.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.666+0000 7f5c4affd640 1 -- 172.21.15.33:0/2901215574 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c4c0ce850 con 0x7f5c4c15dfb0 2024-05-08T10:55:58.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.666+0000 7f5c49ffb640 1 -- 172.21.15.33:0/2901215574 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1348700676 0 0) 0x7f5c4c071730 con 0x7f5c4c071f80 2024-05-08T10:55:58.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.666+0000 7f5c4b7fe640 1 --2- 172.21.15.33:0/2901215574 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c4c06b2b0 0x7f5c4c06dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T10:55:58.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.666+0000 7f5c4affd640 1 --2- 172.21.15.33:0/2901215574 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5c4c15dfb0 0x7f5c4c0d13a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c009d90 tx=0x7f5c3c02a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e363ca8f4b8375b7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:58.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.667+0000 7f5c49ffb640 1 -- 172.21.15.33:0/2901215574 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c3c007740 con 0x7f5c4c15dfb0 2024-05-08T10:55:58.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.667+0000 7f5c49ffb640 1 -- 172.21.15.33:0/2901215574 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c3c0078e0 con 0x7f5c4c15dfb0 2024-05-08T10:55:58.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.667+0000 7f5c49ffb640 1 -- 172.21.15.33:0/2901215574 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c3c007cb0 con 0x7f5c4c15dfb0 2024-05-08T10:55:58.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.667+0000 7f5c5155a640 1 -- 172.21.15.33:0/2901215574 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5c4c15dfb0 msgr2=0x7f5c4c0d13a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:58.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.667+0000 7f5c5155a640 1 --2- 172.21.15.33:0/2901215574 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5c4c15dfb0 0x7f5c4c0d13a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c009d90 tx=0x7f5c3c02a660 comp rx=0 tx=0).stop 2024-05-08T10:55:58.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.667+0000 7f5c5155a640 1 -- 172.21.15.33:0/2901215574 shutdown_connections 2024-05-08T10:55:58.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.667+0000 7f5c5155a640 1 --2- 172.21.15.33:0/2901215574 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c4c06b2b0 0x7f5c4c06dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:58.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.667+0000 7f5c5155a640 1 --2- 172.21.15.33:0/2901215574 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5c4c15dfb0 0x7f5c4c0d13a0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:58.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.667+0000 7f5c5155a640 1 -- 172.21.15.33:0/2901215574 >> 172.21.15.33:0/2901215574 conn(0x7f5c4c0d08b0 msgr2=0x7f5c4c0d0c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:58.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.667+0000 7f5c5155a640 1 -- 172.21.15.33:0/2901215574 shutdown_connections 2024-05-08T10:55:58.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.667+0000 7f5c5155a640 1 -- 172.21.15.33:0/2901215574 wait complete. 2024-05-08T10:55:58.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.668+0000 7f5c5155a640 1 Processor -- start 2024-05-08T10:55:58.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.669+0000 7f5c5155a640 1 -- start start 2024-05-08T10:55:58.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.669+0000 7f5c5155a640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c4c06b2b0 0x7f5c4c15fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:58.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.669+0000 7f5c5155a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5c4c071f80 0x7f5c4c0aec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:58.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.669+0000 7f5c5155a640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5c4c15dfb0 0x7f5c4c14a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:58.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.669+0000 7f5c5155a640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4c0cf050 con 0x7f5c4c071f80 2024-05-08T10:55:58.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.669+0000 7f5c5155a640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4c072700 con 0x7f5c4c15dfb0 2024-05-08T10:55:58.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.669+0000 7f5c5155a640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4c0cf1d0 con 0x7f5c4c06b2b0 2024-05-08T10:55:58.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.669+0000 7f5c4a7fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5c4c071f80 0x7f5c4c0aec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:58.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.669+0000 7f5c4a7fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5c4c071f80 0x7f5c4c0aec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46226/0 (socket says 172.21.15.33:46226) 2024-05-08T10:55:58.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.669+0000 7f5c4a7fc640 1 -- 172.21.15.33:0/2658283513 learned_addr learned my addr 172.21.15.33:0/2658283513 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:58.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.670+0000 7f5c4affd640 1 --2- 172.21.15.33:0/2658283513 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c4c06b2b0 0x7f5c4c15fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:58.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.670+0000 7f5c4b7fe640 1 --2- 172.21.15.33:0/2658283513 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5c4c15dfb0 0x7f5c4c14a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:58.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.670+0000 7f5c4a7fc640 1 -- 172.21.15.33:0/2658283513 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c4c06b2b0 msgr2=0x7f5c4c15fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:58.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.670+0000 7f5c4a7fc640 1 --2- 172.21.15.33:0/2658283513 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c4c06b2b0 0x7f5c4c15fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:58.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.670+0000 7f5c4a7fc640 1 -- 172.21.15.33:0/2658283513 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5c4c15dfb0 msgr2=0x7f5c4c14a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:58.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.670+0000 7f5c4a7fc640 1 --2- 172.21.15.33:0/2658283513 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5c4c15dfb0 0x7f5c4c14a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:58.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.670+0000 7f5c4a7fc640 1 -- 172.21.15.33:0/2658283513 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c4c1603c0 con 0x7f5c4c071f80 2024-05-08T10:55:58.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.670+0000 7f5c4affd640 1 --2- 172.21.15.33:0/2658283513 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c4c06b2b0 0x7f5c4c15fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:55:58.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.670+0000 7f5c4b7fe640 1 --2- 172.21.15.33:0/2658283513 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5c4c15dfb0 0x7f5c4c14a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:55:58.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.670+0000 7f5c4a7fc640 1 --2- 172.21.15.33:0/2658283513 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5c4c071f80 0x7f5c4c0aec20 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f5c3400c4d0 tx=0x7f5c3400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:58.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.670+0000 7f5c437fe640 1 -- 172.21.15.33:0/2658283513 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c34018070 con 0x7f5c4c071f80 2024-05-08T10:55:58.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.670+0000 7f5c437fe640 1 -- 172.21.15.33:0/2658283513 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c34007500 con 0x7f5c4c071f80 2024-05-08T10:55:58.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.670+0000 7f5c5155a640 1 -- 172.21.15.33:0/2658283513 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c4c1606a0 con 0x7f5c4c071f80 2024-05-08T10:55:58.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.670+0000 7f5c437fe640 1 -- 172.21.15.33:0/2658283513 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c34004a20 con 0x7f5c4c071f80 2024-05-08T10:55:58.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.670+0000 7f5c5155a640 1 -- 172.21.15.33:0/2658283513 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c4c160c60 con 0x7f5c4c071f80 2024-05-08T10:55:58.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.671+0000 7f5c5155a640 1 -- 172.21.15.33:0/2658283513 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c4c069d20 con 0x7f5c4c071f80 2024-05-08T10:55:58.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.672+0000 7f5c437fe640 1 -- 172.21.15.33:0/2658283513 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5c3401b070 con 0x7f5c4c071f80 2024-05-08T10:55:58.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.672+0000 7f5c437fe640 1 --2- 172.21.15.33:0/2658283513 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f5c2c06b4d0 0x7f5c2c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:58.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.672+0000 7f5c437fe640 1 -- 172.21.15.33:0/2658283513 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f5c34089260 con 0x7f5c4c071f80 2024-05-08T10:55:58.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.672+0000 7f5c4affd640 1 --2- 172.21.15.33:0/2658283513 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f5c2c06b4d0 0x7f5c2c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:58.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.673+0000 7f5c4affd640 1 --2- 172.21.15.33:0/2658283513 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f5c2c06b4d0 0x7f5c2c06d990 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c034000 tx=0x7f5c3c033040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:58.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.676+0000 7f5c437fe640 1 -- 172.21.15.33:0/2658283513 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5c340583e0 con 0x7f5c4c071f80 2024-05-08T10:55:58.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.856+0000 7f5c5155a640 1 -- 172.21.15.33:0/2658283513 --> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5c4c0ce300 con 0x7f5c2c06b4d0 2024-05-08T10:55:58.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.857+0000 7f5c437fe640 1 -- 172.21.15.33:0/2658283513 <== mgr.4103 v2:172.21.15.174:6832/261355069 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+13427 (secure 0 0 0) 0x7f5c4c0ce300 con 0x7f5c2c06b4d0 2024-05-08T10:55:58.854 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:55:58.854 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-05-08T10:55:58.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.859+0000 7f5c5155a640 1 -- 172.21.15.33:0/2658283513 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f5c2c06b4d0 msgr2=0x7f5c2c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:58.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.859+0000 7f5c5155a640 1 --2- 172.21.15.33:0/2658283513 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f5c2c06b4d0 0x7f5c2c06d990 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c034000 tx=0x7f5c3c033040 comp rx=0 tx=0).stop 2024-05-08T10:55:58.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.859+0000 7f5c5155a640 1 -- 172.21.15.33:0/2658283513 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5c4c071f80 msgr2=0x7f5c4c0aec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:58.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.859+0000 7f5c5155a640 1 --2- 172.21.15.33:0/2658283513 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5c4c071f80 0x7f5c4c0aec20 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f5c3400c4d0 tx=0x7f5c3400c990 comp rx=0 tx=0).stop 2024-05-08T10:55:58.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.859+0000 7f5c5155a640 1 -- 172.21.15.33:0/2658283513 shutdown_connections 2024-05-08T10:55:58.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.859+0000 7f5c5155a640 1 --2- 172.21.15.33:0/2658283513 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f5c2c06b4d0 0x7f5c2c06d990 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:58.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.859+0000 7f5c5155a640 1 --2- 172.21.15.33:0/2658283513 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5c4c15dfb0 0x7f5c4c14a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:58.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.859+0000 7f5c5155a640 1 --2- 172.21.15.33:0/2658283513 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5c4c071f80 0x7f5c4c0aec20 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:58.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.859+0000 7f5c5155a640 1 --2- 172.21.15.33:0/2658283513 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c4c06b2b0 0x7f5c4c15fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:58.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.859+0000 7f5c5155a640 1 -- 172.21.15.33:0/2658283513 >> 172.21.15.33:0/2658283513 conn(0x7f5c4c0d08b0 msgr2=0x7f5c4c0cca50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:58.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.859+0000 7f5c5155a640 1 -- 172.21.15.33:0/2658283513 shutdown_connections 2024-05-08T10:55:58.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.859+0000 7f5c5155a640 1 -- 172.21.15.33:0/2658283513 wait complete. 2024-05-08T10:55:58.867 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":66,"stamp":"2024-05-08T10:55:56.958995+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220240,"kb_used_data":4084,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754480,"statfs":{"total":773094113280,"available":772868587520,"internally_reserved":0,"allocated":4182016,"data_stored":2352183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-26597,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-16,"num_read_kb":-12,"num_write":-111,"num_write_kb":-66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001324"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":191,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T10:55:53.467705+0000","last_change":"2024-05-08T10:54:40.015226+0000","last_active":"2024-05-08T10:55:53.467705+0000","last_peered":"2024-05-08T10:55:53.467705+0000","last_clean":"2024-05-08T10:55:53.467705+0000","last_became_active":"2024-05-08T10:54:40.014219+0000","last_became_peered":"2024-05-08T10:54:40.014219+0000","last_unstale":"2024-05-08T10:55:53.467705+0000","last_undegraded":"2024-05-08T10:55:53.467705+0000","last_fullsized":"2024-05-08T10:55:53.467705+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:38.989328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:38.989328+0000","last_clean_scrub_stamp":"2024-05-08T10:54:38.989328+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:10:59.668786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27940,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343900,"statfs":{"total":96636764160,"available":96608153600,"internally_reserved":0,"allocated":946176,"data_stored":724584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":140823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":372736,"data_stored":141081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":372736,"data_stored":140513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":401408,"data_stored":167165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":364544,"data_stored":140277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":401408,"data_stored":167165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27952,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343888,"statfs":{"total":96636764160,"available":96608141312,"internally_reserved":0,"allocated":954368,"data_stored":730575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T10:55:58.868 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T10:55:58.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.975+0000 7f598137e640 1 Processor -- start 2024-05-08T10:55:58.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.975+0000 7f598137e640 1 -- start start 2024-05-08T10:55:58.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.976+0000 7f598137e640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f597c0d0610 0x7f597c1620e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:58.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.976+0000 7f598137e640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f597c06c830 0x7f597c06ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:58.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.976+0000 7f598137e640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f597c0d0b80 con 0x7f597c15df80 2024-05-08T10:55:58.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.976+0000 7f598137e640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f597c06c3a0 con 0x7f597c0d0610 2024-05-08T10:55:58.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.976+0000 7f598137e640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f597c06bd50 con 0x7f597c06c830 2024-05-08T10:55:58.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.976+0000 7f597a7fc640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f597c0d0610 0x7f597c1620e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:58.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.976+0000 7f597affd640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f597c15df80 0x7f597c1619d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:44642/0 (socket says 172.21.15.33:44642) 2024-05-08T10:55:58.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.976+0000 7f597a7fc640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f597c0d0610 0x7f597c1620e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46230/0 (socket says 172.21.15.33:46230) 2024-05-08T10:55:58.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.976+0000 7f597affd640 1 -- 172.21.15.33:0/1152202483 learned_addr learned my addr 172.21.15.33:0/1152202483 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-05-08T10:55:58.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.976+0000 7f597b7fe640 1 --2- 172.21.15.33:0/1152202483 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f597c06c830 0x7f597c06ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:58.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.976+0000 7f597a7fc640 1 -- 172.21.15.33:0/1152202483 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f597c06c830 msgr2=0x7f597c06ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:55:58.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.976+0000 7f597a7fc640 1 --2- 172.21.15.33:0/1152202483 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f597c06c830 0x7f597c06ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:58.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.976+0000 7f597a7fc640 1 -- 172.21.15.33:0/1152202483 >> v1:172.21.15.33:6789/0 conn(0x7f597c15df80 legacy=0x7f597c1619d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:58.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.976+0000 7f597a7fc640 1 -- 172.21.15.33:0/1152202483 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f597c06c030 con 0x7f597c0d0610 2024-05-08T10:55:58.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.976+0000 7f597b7fe640 1 --2- 172.21.15.33:0/1152202483 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f597c06c830 0x7f597c06ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:55:58.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.977+0000 7f597a7fc640 1 --2- 172.21.15.33:0/1152202483 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f597c0d0610 0x7f597c1620e0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f59640097a0 tx=0x7f596402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=813f5886469e78da server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:58.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.977+0000 7f5979ffb640 1 -- 172.21.15.33:0/1152202483 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5964037070 con 0x7f597c0d0610 2024-05-08T10:55:58.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.977+0000 7f5979ffb640 1 -- 172.21.15.33:0/1152202483 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5964032440 con 0x7f597c0d0610 2024-05-08T10:55:58.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.977+0000 7f5979ffb640 1 -- 172.21.15.33:0/1152202483 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5964032810 con 0x7f597c0d0610 2024-05-08T10:55:58.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.978+0000 7f598137e640 1 -- 172.21.15.33:0/1152202483 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f597c0d0610 msgr2=0x7f597c1620e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:58.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.978+0000 7f598137e640 1 --2- 172.21.15.33:0/1152202483 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f597c0d0610 0x7f597c1620e0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f59640097a0 tx=0x7f596402a180 comp rx=0 tx=0).stop 2024-05-08T10:55:58.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.978+0000 7f598137e640 1 -- 172.21.15.33:0/1152202483 shutdown_connections 2024-05-08T10:55:58.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.978+0000 7f598137e640 1 --2- 172.21.15.33:0/1152202483 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f597c06c830 0x7f597c06ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:58.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.978+0000 7f598137e640 1 --2- 172.21.15.33:0/1152202483 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f597c0d0610 0x7f597c1620e0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:58.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.978+0000 7f598137e640 1 -- 172.21.15.33:0/1152202483 >> 172.21.15.33:0/1152202483 conn(0x7f597c0d19b0 msgr2=0x7f597c0d1dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:58.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.978+0000 7f598137e640 1 -- 172.21.15.33:0/1152202483 shutdown_connections 2024-05-08T10:55:58.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.978+0000 7f598137e640 1 -- 172.21.15.33:0/1152202483 wait complete. 2024-05-08T10:55:58.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.979+0000 7f598137e640 1 Processor -- start 2024-05-08T10:55:58.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.979+0000 7f598137e640 1 -- start start 2024-05-08T10:55:58.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.980+0000 7f598137e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f597c06c830 0x7f597c155f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:58.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.980+0000 7f598137e640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f597c0d0610 0x7f597c0c5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:58.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.980+0000 7f598137e640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f597c15df80 0x7f597c0b69a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:58.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.980+0000 7f598137e640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f597c06fa90 con 0x7f597c06c830 2024-05-08T10:55:58.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.980+0000 7f598137e640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f597c06f910 con 0x7f597c15df80 2024-05-08T10:55:58.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.980+0000 7f598137e640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f597c162620 con 0x7f597c0d0610 2024-05-08T10:55:58.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.980+0000 7f597affd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f597c06c830 0x7f597c155f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:58.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.980+0000 7f597affd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f597c06c830 0x7f597c155f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46234/0 (socket says 172.21.15.33:46234) 2024-05-08T10:55:58.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.980+0000 7f597affd640 1 -- 172.21.15.33:0/1241810579 learned_addr learned my addr 172.21.15.33:0/1241810579 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:55:58.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.980+0000 7f597b7fe640 1 --2- 172.21.15.33:0/1241810579 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f597c15df80 0x7f597c0b69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:58.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.981+0000 7f597a7fc640 1 --2- 172.21.15.33:0/1241810579 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f597c0d0610 0x7f597c0c5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:58.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.981+0000 7f597affd640 1 -- 172.21.15.33:0/1241810579 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f597c0d0610 msgr2=0x7f597c0c5ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:58.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.981+0000 7f597affd640 1 --2- 172.21.15.33:0/1241810579 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f597c0d0610 0x7f597c0c5ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:58.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.981+0000 7f597affd640 1 -- 172.21.15.33:0/1241810579 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f597c15df80 msgr2=0x7f597c0b69a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:58.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.981+0000 7f597affd640 1 --2- 172.21.15.33:0/1241810579 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f597c15df80 0x7f597c0b69a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:58.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.981+0000 7f597affd640 1 -- 172.21.15.33:0/1241810579 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f597c1609d0 con 0x7f597c06c830 2024-05-08T10:55:58.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.981+0000 7f597affd640 1 --2- 172.21.15.33:0/1241810579 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f597c06c830 0x7f597c155f90 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f596c00cb10 tx=0x7f596c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:58.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.981+0000 7f59737fe640 1 -- 172.21.15.33:0/1241810579 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f596c017070 con 0x7f597c06c830 2024-05-08T10:55:58.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.981+0000 7f59737fe640 1 -- 172.21.15.33:0/1241810579 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f596c00ac70 con 0x7f597c06c830 2024-05-08T10:55:58.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.981+0000 7f59737fe640 1 -- 172.21.15.33:0/1241810579 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f596c012620 con 0x7f597c06c830 2024-05-08T10:55:58.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.981+0000 7f598137e640 1 -- 172.21.15.33:0/1241810579 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f597c1564d0 con 0x7f597c06c830 2024-05-08T10:55:58.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.981+0000 7f598137e640 1 -- 172.21.15.33:0/1241810579 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f597c0b5880 con 0x7f597c06c830 2024-05-08T10:55:58.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.982+0000 7f598137e640 1 -- 172.21.15.33:0/1241810579 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f597c069d20 con 0x7f597c06c830 2024-05-08T10:55:58.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.983+0000 7f59737fe640 1 -- 172.21.15.33:0/1241810579 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f596c01a070 con 0x7f597c06c830 2024-05-08T10:55:58.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.983+0000 7f59737fe640 1 --2- 172.21.15.33:0/1241810579 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f595c06b4d0 0x7f595c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:55:58.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.983+0000 7f59737fe640 1 -- 172.21.15.33:0/1241810579 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f596c089d60 con 0x7f597c06c830 2024-05-08T10:55:58.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.983+0000 7f597a7fc640 1 --2- 172.21.15.33:0/1241810579 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f595c06b4d0 0x7f595c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:55:58.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.984+0000 7f597a7fc640 1 --2- 172.21.15.33:0/1241810579 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f595c06b4d0 0x7f595c06d990 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5964034000 tx=0x7f596402e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:55:58.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:58.987+0000 7f59737fe640 1 -- 172.21.15.33:0/1241810579 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f597c1564d0 con 0x7f597c06c830 2024-05-08T10:55:59.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:59.170+0000 7f598137e640 1 -- 172.21.15.33:0/1241810579 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f597c0ccc90 con 0x7f597c06c830 2024-05-08T10:55:59.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:59.171+0000 7f59737fe640 1 -- 172.21.15.33:0/1241810579 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+13030 (secure 0 0 0) 0x7f596c058e50 con 0x7f597c06c830 2024-05-08T10:55:59.168 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:55:59.169 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":34,"fsid":"963217b2-c375-4f5a-95cf-88e199dd38ff","created":"2024-05-08T10:54:26.711528+0000","modified":"2024-05-08T10:55:56.052094+0000","last_up_change":"2024-05-08T10:54:37.987478+0000","last_in_change":"2024-05-08T10:54:28.834106+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T10:54:38.989228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c5da4fb5-d4f2-4982-a804-2aa92fe77731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3990629207},{"type":"v1","addr":"172.21.15.33:6817","nonce":3990629207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3990629207},{"type":"v1","addr":"172.21.15.33:6819","nonce":3990629207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3990629207},{"type":"v1","addr":"172.21.15.33:6823","nonce":3990629207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3990629207},{"type":"v1","addr":"172.21.15.33:6821","nonce":3990629207}]},"public_addr":"172.21.15.33:6817/3990629207","cluster_addr":"172.21.15.33:6819/3990629207","heartbeat_back_addr":"172.21.15.33:6823/3990629207","heartbeat_front_addr":"172.21.15.33:6821/3990629207","state":["exists","up"]},{"osd":1,"uuid":"f8fdd8db-c2a3-4d28-81f3-b30f44bea7c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":1758076090},{"type":"v1","addr":"172.21.15.33:6825","nonce":1758076090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":1758076090},{"type":"v1","addr":"172.21.15.33:6827","nonce":1758076090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":1758076090},{"type":"v1","addr":"172.21.15.33:6831","nonce":1758076090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":1758076090},{"type":"v1","addr":"172.21.15.33:6829","nonce":1758076090}]},"public_addr":"172.21.15.33:6825/1758076090","cluster_addr":"172.21.15.33:6827/1758076090","heartbeat_back_addr":"172.21.15.33:6831/1758076090","heartbeat_front_addr":"172.21.15.33:6829/1758076090","state":["exists","up"]},{"osd":2,"uuid":"87d465f3-b40f-48dd-bae2-4c67904d4828","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":2940853479},{"type":"v1","addr":"172.21.15.33:6801","nonce":2940853479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6803","nonce":2940853479},{"type":"v1","addr":"172.21.15.33:6805","nonce":2940853479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6811","nonce":2940853479},{"type":"v1","addr":"172.21.15.33:6813","nonce":2940853479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6807","nonce":2940853479},{"type":"v1","addr":"172.21.15.33:6809","nonce":2940853479}]},"public_addr":"172.21.15.33:6801/2940853479","cluster_addr":"172.21.15.33:6805/2940853479","heartbeat_back_addr":"172.21.15.33:6813/2940853479","heartbeat_front_addr":"172.21.15.33:6809/2940853479","state":["exists","up"]},{"osd":3,"uuid":"79450edf-9637-4181-9372-e1cd5e91e73e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":4029047077},{"type":"v1","addr":"172.21.15.33:6804","nonce":4029047077}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":4029047077},{"type":"v1","addr":"172.21.15.33:6808","nonce":4029047077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":4029047077},{"type":"v1","addr":"172.21.15.33:6815","nonce":4029047077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":4029047077},{"type":"v1","addr":"172.21.15.33:6812","nonce":4029047077}]},"public_addr":"172.21.15.33:6804/4029047077","cluster_addr":"172.21.15.33:6808/4029047077","heartbeat_back_addr":"172.21.15.33:6815/4029047077","heartbeat_front_addr":"172.21.15.33:6812/4029047077","state":["exists","up"]},{"osd":4,"uuid":"bd0debfa-e559-4b1e-920d-6b2639c7085e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":1697399220},{"type":"v1","addr":"172.21.15.174:6801","nonce":1697399220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":1697399220},{"type":"v1","addr":"172.21.15.174:6803","nonce":1697399220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":1697399220},{"type":"v1","addr":"172.21.15.174:6807","nonce":1697399220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":1697399220},{"type":"v1","addr":"172.21.15.174:6805","nonce":1697399220}]},"public_addr":"172.21.15.174:6801/1697399220","cluster_addr":"172.21.15.174:6803/1697399220","heartbeat_back_addr":"172.21.15.174:6807/1697399220","heartbeat_front_addr":"172.21.15.174:6805/1697399220","state":["exists","up"]},{"osd":5,"uuid":"ff0f51c0-672b-448f-9de1-b9305ce8c00d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":1511860729},{"type":"v1","addr":"172.21.15.174:6825","nonce":1511860729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":1511860729},{"type":"v1","addr":"172.21.15.174:6827","nonce":1511860729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":1511860729},{"type":"v1","addr":"172.21.15.174:6831","nonce":1511860729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":1511860729},{"type":"v1","addr":"172.21.15.174:6829","nonce":1511860729}]},"public_addr":"172.21.15.174:6825/1511860729","cluster_addr":"172.21.15.174:6827/1511860729","heartbeat_back_addr":"172.21.15.174:6831/1511860729","heartbeat_front_addr":"172.21.15.174:6829/1511860729","state":["exists","up"]},{"osd":6,"uuid":"93061f6c-c0ce-47e9-88a0-1151c5ccb4e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":2326407945},{"type":"v1","addr":"172.21.15.174:6817","nonce":2326407945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":2326407945},{"type":"v1","addr":"172.21.15.174:6819","nonce":2326407945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":2326407945},{"type":"v1","addr":"172.21.15.174:6823","nonce":2326407945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":2326407945},{"type":"v1","addr":"172.21.15.174:6821","nonce":2326407945}]},"public_addr":"172.21.15.174:6817/2326407945","cluster_addr":"172.21.15.174:6819/2326407945","heartbeat_back_addr":"172.21.15.174:6823/2326407945","heartbeat_front_addr":"172.21.15.174:6821/2326407945","state":["exists","up"]},{"osd":7,"uuid":"7be1dcf3-1957-4ec3-bacf-f5f9fff580a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":1637570253},{"type":"v1","addr":"172.21.15.174:6809","nonce":1637570253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":1637570253},{"type":"v1","addr":"172.21.15.174:6811","nonce":1637570253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":1637570253},{"type":"v1","addr":"172.21.15.174:6815","nonce":1637570253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":1637570253},{"type":"v1","addr":"172.21.15.174:6813","nonce":1637570253}]},"public_addr":"172.21.15.174:6809/1637570253","cluster_addr":"172.21.15.174:6811/1637570253","heartbeat_back_addr":"172.21.15.174:6815/1637570253","heartbeat_front_addr":"172.21.15.174:6813/1637570253","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:33.997709+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:34.016568+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:33.990484+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:33.980666+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:33.920609+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:34.005069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:34.018345+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T10:54:34.061646+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.33:6834/415400390":"2024-05-09T10:55:52.776617+0000","172.21.15.33:6832/415400390":"2024-05-09T10:55:52.776617+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T10:55:59.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:59.173+0000 7f598137e640 1 -- 172.21.15.33:0/1241810579 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f595c06b4d0 msgr2=0x7f595c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:59.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:59.173+0000 7f598137e640 1 --2- 172.21.15.33:0/1241810579 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f595c06b4d0 0x7f595c06d990 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5964034000 tx=0x7f596402e000 comp rx=0 tx=0).stop 2024-05-08T10:55:59.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:59.173+0000 7f598137e640 1 -- 172.21.15.33:0/1241810579 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f597c06c830 msgr2=0x7f597c155f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:55:59.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:59.173+0000 7f598137e640 1 --2- 172.21.15.33:0/1241810579 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f597c06c830 0x7f597c155f90 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f596c00cb10 tx=0x7f596c00a060 comp rx=0 tx=0).stop 2024-05-08T10:55:59.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:59.173+0000 7f598137e640 1 -- 172.21.15.33:0/1241810579 shutdown_connections 2024-05-08T10:55:59.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:59.173+0000 7f598137e640 1 --2- 172.21.15.33:0/1241810579 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f595c06b4d0 0x7f595c06d990 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:59.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:59.173+0000 7f598137e640 1 --2- 172.21.15.33:0/1241810579 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f597c15df80 0x7f597c0b69a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:59.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:59.173+0000 7f598137e640 1 --2- 172.21.15.33:0/1241810579 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f597c0d0610 0x7f597c0c5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:59.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:59.173+0000 7f598137e640 1 --2- 172.21.15.33:0/1241810579 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f597c06c830 0x7f597c155f90 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:55:59.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:59.173+0000 7f598137e640 1 -- 172.21.15.33:0/1241810579 >> 172.21.15.33:0/1241810579 conn(0x7f597c0d19b0 msgr2=0x7f597c15c0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:55:59.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:59.173+0000 7f598137e640 1 -- 172.21.15.33:0/1241810579 shutdown_connections 2024-05-08T10:55:59.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:55:59.173+0000 7f598137e640 1 -- 172.21.15.33:0/1241810579 wait complete. 2024-05-08T10:56:00.182 INFO:tasks.ceph:Scrubbing osd.0 2024-05-08T10:56:00.182 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-05-08T10:56:00.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.306+0000 7fdcd48fc640 1 Processor -- start 2024-05-08T10:56:00.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.306+0000 7fdcd48fc640 1 -- start start 2024-05-08T10:56:00.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.307+0000 7fdcd48fc640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fdcd00ce1e0 0x7fdcd015ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:00.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.307+0000 7fdcd48fc640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcd00ce980 con 0x7fdcd00cf930 2024-05-08T10:56:00.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.307+0000 7fdcd48fc640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcd00cec60 con 0x7fdcd00d15f0 2024-05-08T10:56:00.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.307+0000 7fdcd48fc640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcd00cef40 con 0x7fdcd00ce1e0 2024-05-08T10:56:00.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.307+0000 7fdccdd9b640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fdcd00ce1e0 0x7fdcd015ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:00.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.307+0000 7fdcced9d640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fdcd00cf930 0x7fdcd006ed10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:44650/0 (socket says 172.21.15.33:44650) 2024-05-08T10:56:00.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.307+0000 7fdcced9d640 1 -- 172.21.15.33:0/1970223572 learned_addr learned my addr 172.21.15.33:0/1970223572 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-05-08T10:56:00.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.307+0000 7fdccdd9b640 1 -- 172.21.15.33:0/1970223572 >> v1:172.21.15.174:6789/0 conn(0x7fdcd00d15f0 legacy=0x7fdcd00d19d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:00.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.307+0000 7fdccdd9b640 1 -- 172.21.15.33:0/1970223572 >> v1:172.21.15.33:6789/0 conn(0x7fdcd00cf930 legacy=0x7fdcd006ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:00.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.307+0000 7fdccdd9b640 1 -- 172.21.15.33:0/1970223572 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcd00cf220 con 0x7fdcd00ce1e0 2024-05-08T10:56:00.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.307+0000 7fdccd59a640 1 -- 172.21.15.33:0/1970223572 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1821825139 0 0) 0x7fdcd00ce980 con 0x7fdcd00cf930 2024-05-08T10:56:00.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.308+0000 7fdccdd9b640 1 --2- 172.21.15.33:0/1970223572 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdcd00ce1e0 0x7fdcd015ecf0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fdcc40097a0 tx=0x7fdcc402a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f651d68d148a3cd server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:56:00.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.308+0000 7fdccd59a640 1 -- 172.21.15.33:0/1970223572 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc4037070 con 0x7fdcd00ce1e0 2024-05-08T10:56:00.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.308+0000 7fdccd59a640 1 -- 172.21.15.33:0/1970223572 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcc4032640 con 0x7fdcd00ce1e0 2024-05-08T10:56:00.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.308+0000 7fdccd59a640 1 -- 172.21.15.33:0/1970223572 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc4032a10 con 0x7fdcd00ce1e0 2024-05-08T10:56:00.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.309+0000 7fdcd48fc640 1 -- 172.21.15.33:0/1970223572 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdcd00ce1e0 msgr2=0x7fdcd015ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:00.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.309+0000 7fdcd48fc640 1 --2- 172.21.15.33:0/1970223572 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdcd00ce1e0 0x7fdcd015ecf0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fdcc40097a0 tx=0x7fdcc402a2c0 comp rx=0 tx=0).stop 2024-05-08T10:56:00.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.309+0000 7fdcd48fc640 1 -- 172.21.15.33:0/1970223572 shutdown_connections 2024-05-08T10:56:00.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.309+0000 7fdcd48fc640 1 --2- 172.21.15.33:0/1970223572 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdcd00ce1e0 0x7fdcd015ecf0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:00.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.309+0000 7fdcd48fc640 1 -- 172.21.15.33:0/1970223572 >> 172.21.15.33:0/1970223572 conn(0x7fdcd009a9d0 msgr2=0x7fdcd009ade0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:56:00.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.309+0000 7fdcd48fc640 1 -- 172.21.15.33:0/1970223572 shutdown_connections 2024-05-08T10:56:00.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.309+0000 7fdcd48fc640 1 -- 172.21.15.33:0/1970223572 wait complete. 2024-05-08T10:56:00.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.310+0000 7fdcd48fc640 1 Processor -- start 2024-05-08T10:56:00.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.310+0000 7fdcd48fc640 1 -- start start 2024-05-08T10:56:00.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.311+0000 7fdcd48fc640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdcd00ce1e0 0x7fdcd00b6f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:00.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.311+0000 7fdcd48fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdcd00cf930 0x7fdcd01f7050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:00.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.311+0000 7fdcd48fc640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdcd00d15f0 0x7fdcd006d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:00.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.311+0000 7fdcd48fc640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd015f230 con 0x7fdcd00cf930 2024-05-08T10:56:00.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.311+0000 7fdcd48fc640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd00ce670 con 0x7fdcd00ce1e0 2024-05-08T10:56:00.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.311+0000 7fdcd48fc640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd00cfd60 con 0x7fdcd00d15f0 2024-05-08T10:56:00.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.311+0000 7fdccdd9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdcd00cf930 0x7fdcd01f7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:00.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.311+0000 7fdccdd9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdcd00cf930 0x7fdcd01f7050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46260/0 (socket says 172.21.15.33:46260) 2024-05-08T10:56:00.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.311+0000 7fdccdd9b640 1 -- 172.21.15.33:0/2971424403 learned_addr learned my addr 172.21.15.33:0/2971424403 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:56:00.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.311+0000 7fdcce59c640 1 --2- 172.21.15.33:0/2971424403 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdcd00ce1e0 0x7fdcd00b6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:00.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.311+0000 7fdcced9d640 1 --2- 172.21.15.33:0/2971424403 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdcd00d15f0 0x7fdcd006d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:00.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.311+0000 7fdccdd9b640 1 -- 172.21.15.33:0/2971424403 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdcd00d15f0 msgr2=0x7fdcd006d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:00.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.311+0000 7fdccdd9b640 1 --2- 172.21.15.33:0/2971424403 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdcd00d15f0 0x7fdcd006d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:00.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.311+0000 7fdccdd9b640 1 -- 172.21.15.33:0/2971424403 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdcd00ce1e0 msgr2=0x7fdcd00b6f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:00.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.311+0000 7fdccdd9b640 1 --2- 172.21.15.33:0/2971424403 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdcd00ce1e0 0x7fdcd00b6f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:00.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.311+0000 7fdccdd9b640 1 -- 172.21.15.33:0/2971424403 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcd00ca5b0 con 0x7fdcd00cf930 2024-05-08T10:56:00.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.311+0000 7fdcced9d640 1 --2- 172.21.15.33:0/2971424403 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdcd00d15f0 0x7fdcd006d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:56:00.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.312+0000 7fdccdd9b640 1 --2- 172.21.15.33:0/2971424403 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdcd00cf930 0x7fdcd01f7050 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fdcc40097a0 tx=0x7fdcc40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:56:00.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.312+0000 7fdcbeffd640 1 -- 172.21.15.33:0/2971424403 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc4037050 con 0x7fdcd00cf930 2024-05-08T10:56:00.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.312+0000 7fdcbeffd640 1 -- 172.21.15.33:0/2971424403 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcc4038040 con 0x7fdcd00cf930 2024-05-08T10:56:00.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.312+0000 7fdcd48fc640 1 -- 172.21.15.33:0/2971424403 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcd01f4740 con 0x7fdcd00cf930 2024-05-08T10:56:00.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.312+0000 7fdcbeffd640 1 -- 172.21.15.33:0/2971424403 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc4004490 con 0x7fdcd00cf930 2024-05-08T10:56:00.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.312+0000 7fdcd48fc640 1 -- 172.21.15.33:0/2971424403 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcd01f4d00 con 0x7fdcd00cf930 2024-05-08T10:56:00.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.313+0000 7fdcd48fc640 1 -- 172.21.15.33:0/2971424403 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdcd0069d20 con 0x7fdcd00cf930 2024-05-08T10:56:00.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.313+0000 7fdcbeffd640 1 -- 172.21.15.33:0/2971424403 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fdcc4030900 con 0x7fdcd00cf930 2024-05-08T10:56:00.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.314+0000 7fdcbeffd640 1 --2- 172.21.15.33:0/2971424403 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fdcb006b4d0 0x7fdcb006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:00.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.314+0000 7fdcbeffd640 1 -- 172.21.15.33:0/2971424403 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fdcc40aaa10 con 0x7fdcd00cf930 2024-05-08T10:56:00.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.314+0000 7fdcbeffd640 1 --2- 172.21.15.33:0/2971424403 >> [v2:172.21.15.33:6816/3990629207,v1:172.21.15.33:6817/3990629207] conn(0x7fdcb0071390 0x7fdcb00737b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:00.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.314+0000 7fdcce59c640 1 --2- 172.21.15.33:0/2971424403 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fdcb006b4d0 0x7fdcb006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:00.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.314+0000 7fdcbeffd640 1 -- 172.21.15.33:0/2971424403 --> [v2:172.21.15.33:6816/3990629207,v1:172.21.15.33:6817/3990629207] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdcc40067f0 con 0x7fdcb0071390 2024-05-08T10:56:00.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.314+0000 7fdcbeffd640 1 -- 172.21.15.33:0/2971424403 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdcc40af2c0 con 0x7fdcd00cf930 2024-05-08T10:56:00.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.314+0000 7fdcced9d640 1 --2- 172.21.15.33:0/2971424403 >> [v2:172.21.15.33:6816/3990629207,v1:172.21.15.33:6817/3990629207] conn(0x7fdcb0071390 0x7fdcb00737b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:00.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.315+0000 7fdcced9d640 1 --2- 172.21.15.33:0/2971424403 >> [v2:172.21.15.33:6816/3990629207,v1:172.21.15.33:6817/3990629207] conn(0x7fdcb0071390 0x7fdcb00737b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:56:00.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.315+0000 7fdcce59c640 1 --2- 172.21.15.33:0/2971424403 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fdcb006b4d0 0x7fdcb006d990 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fdcc00012e0 tx=0x7fdcc0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:56:00.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.315+0000 7fdcbeffd640 1 -- 172.21.15.33:0/2971424403 <== osd.0 v2:172.21.15.33:6816/3990629207 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fdcc40067f0 con 0x7fdcb0071390 2024-05-08T10:56:00.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.329+0000 7fdcd48fc640 1 -- 172.21.15.33:0/2971424403 --> [v2:172.21.15.33:6816/3990629207,v1:172.21.15.33:6817/3990629207] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fdcd00c5360 con 0x7fdcb0071390 2024-05-08T10:56:00.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.329+0000 7fdcbeffd640 1 -- 172.21.15.33:0/2971424403 <== osd.0 v2:172.21.15.33:6816/3990629207 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fdcd00c5360 con 0x7fdcb0071390 2024-05-08T10:56:00.326 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-05-08T10:56:00.326 INFO:teuthology.orchestra.run.smithi033.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-08T10:56:00.326 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-05-08T10:56:00.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.329+0000 7fdcd48fc640 1 -- 172.21.15.33:0/2971424403 >> [v2:172.21.15.33:6816/3990629207,v1:172.21.15.33:6817/3990629207] conn(0x7fdcb0071390 msgr2=0x7fdcb00737b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:00.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.329+0000 7fdcd48fc640 1 --2- 172.21.15.33:0/2971424403 >> [v2:172.21.15.33:6816/3990629207,v1:172.21.15.33:6817/3990629207] conn(0x7fdcb0071390 0x7fdcb00737b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:00.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.329+0000 7fdcd48fc640 1 -- 172.21.15.33:0/2971424403 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fdcb006b4d0 msgr2=0x7fdcb006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:00.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.329+0000 7fdcd48fc640 1 --2- 172.21.15.33:0/2971424403 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fdcb006b4d0 0x7fdcb006d990 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fdcc00012e0 tx=0x7fdcc0009040 comp rx=0 tx=0).stop 2024-05-08T10:56:00.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.329+0000 7fdcd48fc640 1 -- 172.21.15.33:0/2971424403 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdcd00cf930 msgr2=0x7fdcd01f7050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:00.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.329+0000 7fdcd48fc640 1 --2- 172.21.15.33:0/2971424403 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdcd00cf930 0x7fdcd01f7050 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fdcc40097a0 tx=0x7fdcc40046c0 comp rx=0 tx=0).stop 2024-05-08T10:56:00.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.329+0000 7fdcced9d640 1 -- 172.21.15.33:0/2971424403 reap_dead start 2024-05-08T10:56:00.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.329+0000 7fdcd48fc640 1 -- 172.21.15.33:0/2971424403 shutdown_connections 2024-05-08T10:56:00.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.329+0000 7fdcd48fc640 1 -- 172.21.15.33:0/2971424403 >> 172.21.15.33:0/2971424403 conn(0x7fdcd009a9d0 msgr2=0x7fdcd00d19d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:56:00.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.329+0000 7fdcd48fc640 1 -- 172.21.15.33:0/2971424403 shutdown_connections 2024-05-08T10:56:00.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.329+0000 7fdcd48fc640 1 -- 172.21.15.33:0/2971424403 wait complete. 2024-05-08T10:56:00.338 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-05-08T10:56:00.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.445+0000 7f2574ff4640 1 Processor -- start 2024-05-08T10:56:00.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.445+0000 7f2574ff4640 1 -- start start 2024-05-08T10:56:00.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.446+0000 7f2574ff4640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f2570161f90 0x7f25700d0960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:00.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.446+0000 7f2574ff4640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f257015db80 0x7f257015dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:00.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.446+0000 7f2574ff4640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f257006cdd0 con 0x7f257006c8d0 2024-05-08T10:56:00.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.446+0000 7f2574ff4640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25700cfe80 con 0x7f2570161f90 2024-05-08T10:56:00.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.446+0000 7f2574ff4640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25700d0160 con 0x7f257015db80 2024-05-08T10:56:00.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.446+0000 7f256dd9b640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f257006c8d0 0x7f2570162370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:44664/0 (socket says 172.21.15.33:44664) 2024-05-08T10:56:00.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.446+0000 7f256dd9b640 1 -- 172.21.15.33:0/321533355 learned_addr learned my addr 172.21.15.33:0/321533355 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-05-08T10:56:00.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.446+0000 7f256e59c640 1 --2- 172.21.15.33:0/321533355 >> v2:172.21.15.174:3300/0 conn(0x7f2570161f90 0x7f25700d0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:00.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.446+0000 7f256ed9d640 1 --2- 172.21.15.33:0/321533355 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f257015db80 0x7f257015dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:00.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.447+0000 7f256d59a640 1 -- 172.21.15.33:0/321533355 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1792808561 0 0) 0x7f257006cdd0 con 0x7f257006c8d0 2024-05-08T10:56:00.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.447+0000 7f256d59a640 1 -- 172.21.15.33:0/321533355 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2558003520 con 0x7f257006c8d0 2024-05-08T10:56:00.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.447+0000 7f256e59c640 1 -- 172.21.15.33:0/321533355 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f257015db80 msgr2=0x7f257015dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:56:00.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.447+0000 7f256e59c640 1 --2- 172.21.15.33:0/321533355 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f257015db80 0x7f257015dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:00.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.447+0000 7f256e59c640 1 -- 172.21.15.33:0/321533355 >> v1:172.21.15.33:6789/0 conn(0x7f257006c8d0 legacy=0x7f2570162370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:00.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.447+0000 7f256e59c640 1 -- 172.21.15.33:0/321533355 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25700d0440 con 0x7f2570161f90 2024-05-08T10:56:00.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.447+0000 7f256ed9d640 1 --2- 172.21.15.33:0/321533355 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f257015db80 0x7f257015dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T10:56:00.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.448+0000 7f256e59c640 1 --2- 172.21.15.33:0/321533355 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2570161f90 0x7f25700d0960 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f25600097a0 tx=0x7f256002a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eed53ba9272e80f8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:56:00.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.448+0000 7f256d59a640 1 -- 172.21.15.33:0/321533355 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2560037070 con 0x7f2570161f90 2024-05-08T10:56:00.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.448+0000 7f256d59a640 1 -- 172.21.15.33:0/321533355 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2560032440 con 0x7f2570161f90 2024-05-08T10:56:00.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.448+0000 7f256d59a640 1 -- 172.21.15.33:0/321533355 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2560032810 con 0x7f2570161f90 2024-05-08T10:56:00.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.448+0000 7f2574ff4640 1 -- 172.21.15.33:0/321533355 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2570161f90 msgr2=0x7f25700d0960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:00.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.448+0000 7f2574ff4640 1 --2- 172.21.15.33:0/321533355 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2570161f90 0x7f25700d0960 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f25600097a0 tx=0x7f256002a180 comp rx=0 tx=0).stop 2024-05-08T10:56:00.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.448+0000 7f2574ff4640 1 -- 172.21.15.33:0/321533355 shutdown_connections 2024-05-08T10:56:00.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.448+0000 7f2574ff4640 1 --2- 172.21.15.33:0/321533355 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f257015db80 0x7f257015dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:00.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.448+0000 7f2574ff4640 1 --2- 172.21.15.33:0/321533355 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2570161f90 0x7f25700d0960 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:00.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.448+0000 7f2574ff4640 1 -- 172.21.15.33:0/321533355 >> 172.21.15.33:0/321533355 conn(0x7f25700b34f0 msgr2=0x7f25700b38d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:56:00.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.448+0000 7f2574ff4640 1 -- 172.21.15.33:0/321533355 shutdown_connections 2024-05-08T10:56:00.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.448+0000 7f2574ff4640 1 -- 172.21.15.33:0/321533355 wait complete. 2024-05-08T10:56:00.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.450+0000 7f2574ff4640 1 Processor -- start 2024-05-08T10:56:00.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.450+0000 7f2574ff4640 1 -- start start 2024-05-08T10:56:00.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.450+0000 7f2574ff4640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f257006c8d0 0x7f2570155120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:00.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.450+0000 7f2574ff4640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f257015db80 0x7f25700c54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:00.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.450+0000 7f2574ff4640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2570161f90 0x7f257015c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:00.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.450+0000 7f2574ff4640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25700b2ee0 con 0x7f2570161f90 2024-05-08T10:56:00.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.450+0000 7f2574ff4640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25700d0ea0 con 0x7f257015db80 2024-05-08T10:56:00.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.450+0000 7f2574ff4640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f257015e530 con 0x7f257006c8d0 2024-05-08T10:56:00.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.451+0000 7f256ed9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2570161f90 0x7f257015c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:00.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.451+0000 7f256ed9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2570161f90 0x7f257015c370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46272/0 (socket says 172.21.15.33:46272) 2024-05-08T10:56:00.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.451+0000 7f256ed9d640 1 -- 172.21.15.33:0/2906065499 learned_addr learned my addr 172.21.15.33:0/2906065499 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:56:00.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.451+0000 7f256e59c640 1 --2- 172.21.15.33:0/2906065499 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f257006c8d0 0x7f2570155120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:00.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.451+0000 7f256dd9b640 1 --2- 172.21.15.33:0/2906065499 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f257015db80 0x7f25700c54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:00.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.451+0000 7f256ed9d640 1 -- 172.21.15.33:0/2906065499 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f257006c8d0 msgr2=0x7f2570155120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:00.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.451+0000 7f256ed9d640 1 --2- 172.21.15.33:0/2906065499 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f257006c8d0 0x7f2570155120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:00.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.451+0000 7f256ed9d640 1 -- 172.21.15.33:0/2906065499 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f257015db80 msgr2=0x7f25700c54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:00.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.451+0000 7f256ed9d640 1 --2- 172.21.15.33:0/2906065499 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f257015db80 0x7f25700c54f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:00.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.451+0000 7f256ed9d640 1 -- 172.21.15.33:0/2906065499 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25700c5e60 con 0x7f2570161f90 2024-05-08T10:56:00.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.451+0000 7f256ed9d640 1 --2- 172.21.15.33:0/2906065499 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2570161f90 0x7f257015c370 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f256800efc0 tx=0x7f256800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:56:00.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.451+0000 7f255effd640 1 -- 172.21.15.33:0/2906065499 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2568018030 con 0x7f2570161f90 2024-05-08T10:56:00.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.451+0000 7f255effd640 1 -- 172.21.15.33:0/2906065499 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f256800cdf0 con 0x7f2570161f90 2024-05-08T10:56:00.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.451+0000 7f2574ff4640 1 -- 172.21.15.33:0/2906065499 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25700c6140 con 0x7f2570161f90 2024-05-08T10:56:00.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.451+0000 7f255effd640 1 -- 172.21.15.33:0/2906065499 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2568003bb0 con 0x7f2570161f90 2024-05-08T10:56:00.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.451+0000 7f2574ff4640 1 -- 172.21.15.33:0/2906065499 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25700c6700 con 0x7f2570161f90 2024-05-08T10:56:00.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.452+0000 7f2574ff4640 1 -- 172.21.15.33:0/2906065499 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2570069d20 con 0x7f2570161f90 2024-05-08T10:56:00.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.453+0000 7f255effd640 1 -- 172.21.15.33:0/2906065499 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f256801b070 con 0x7f2570161f90 2024-05-08T10:56:00.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.453+0000 7f255effd640 1 --2- 172.21.15.33:0/2906065499 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f255006b4d0 0x7f255006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:00.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.453+0000 7f255effd640 1 -- 172.21.15.33:0/2906065499 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f256808a740 con 0x7f2570161f90 2024-05-08T10:56:00.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.453+0000 7f256e59c640 1 --2- 172.21.15.33:0/2906065499 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f255006b4d0 0x7f255006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:00.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.454+0000 7f256e59c640 1 --2- 172.21.15.33:0/2906065499 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f255006b4d0 0x7f255006d990 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f2560034000 tx=0x7f256002e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:56:00.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.457+0000 7f255effd640 1 -- 172.21.15.33:0/2906065499 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2568010040 con 0x7f2570161f90 2024-05-08T10:56:00.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.637+0000 7f2574ff4640 1 -- 172.21.15.33:0/2906065499 --> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f25700d0a90 con 0x7f255006b4d0 2024-05-08T10:56:00.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.637+0000 7f255effd640 1 -- 172.21.15.33:0/2906065499 <== mgr.4103 v2:172.21.15.174:6832/261355069 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f25700d0a90 con 0x7f255006b4d0 2024-05-08T10:56:00.635 INFO:teuthology.orchestra.run.smithi033.stderr:instructed osd(s) 0 to deep-scrub 2024-05-08T10:56:00.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.640+0000 7f2574ff4640 1 -- 172.21.15.33:0/2906065499 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f255006b4d0 msgr2=0x7f255006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:00.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.640+0000 7f2574ff4640 1 --2- 172.21.15.33:0/2906065499 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f255006b4d0 0x7f255006d990 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f2560034000 tx=0x7f256002e000 comp rx=0 tx=0).stop 2024-05-08T10:56:00.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.640+0000 7f2574ff4640 1 -- 172.21.15.33:0/2906065499 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2570161f90 msgr2=0x7f257015c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:00.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.640+0000 7f2574ff4640 1 --2- 172.21.15.33:0/2906065499 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2570161f90 0x7f257015c370 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f256800efc0 tx=0x7f256800c490 comp rx=0 tx=0).stop 2024-05-08T10:56:00.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.640+0000 7f2574ff4640 1 -- 172.21.15.33:0/2906065499 shutdown_connections 2024-05-08T10:56:00.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.640+0000 7f2574ff4640 1 --2- 172.21.15.33:0/2906065499 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f255006b4d0 0x7f255006d990 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:00.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.640+0000 7f2574ff4640 1 --2- 172.21.15.33:0/2906065499 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2570161f90 0x7f257015c370 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:00.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.640+0000 7f2574ff4640 1 --2- 172.21.15.33:0/2906065499 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f257015db80 0x7f25700c54f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:00.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.640+0000 7f2574ff4640 1 --2- 172.21.15.33:0/2906065499 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f257006c8d0 0x7f2570155120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:00.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.640+0000 7f2574ff4640 1 -- 172.21.15.33:0/2906065499 >> 172.21.15.33:0/2906065499 conn(0x7f25700b34f0 msgr2=0x7f257015e820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:56:00.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.640+0000 7f2574ff4640 1 -- 172.21.15.33:0/2906065499 shutdown_connections 2024-05-08T10:56:00.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.640+0000 7f2574ff4640 1 -- 172.21.15.33:0/2906065499 wait complete. 2024-05-08T10:56:00.648 INFO:tasks.ceph:Scrubbing osd.1 2024-05-08T10:56:00.648 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-05-08T10:56:00.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.759+0000 7f83f1e3f640 1 Processor -- start 2024-05-08T10:56:00.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.759+0000 7f83f1e3f640 1 -- start start 2024-05-08T10:56:00.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.760+0000 7f83f1e3f640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f83ec0b7a90 0x7f83ec0ce6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:00.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.760+0000 7f83f1e3f640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83ec0d1be0 con 0x7f83ec15de60 2024-05-08T10:56:00.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.760+0000 7f83f1e3f640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83ec0ced40 con 0x7f83ec0d2840 2024-05-08T10:56:00.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.760+0000 7f83f1e3f640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83ec0cf020 con 0x7f83ec0b7a90 2024-05-08T10:56:00.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.760+0000 7f83eb7fe640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f83ec15de60 0x7f83ec0d2130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:44680/0 (socket says 172.21.15.33:44680) 2024-05-08T10:56:00.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.760+0000 7f83eb7fe640 1 -- 172.21.15.33:0/1339062938 learned_addr learned my addr 172.21.15.33:0/1339062938 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-05-08T10:56:00.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.760+0000 7f83ebfff640 1 --2- 172.21.15.33:0/1339062938 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f83ec0b7a90 0x7f83ec0ce6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:00.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.760+0000 7f83ea7fc640 1 -- 172.21.15.33:0/1339062938 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3967290382 0 0) 0x7f83ec0d1be0 con 0x7f83ec15de60 2024-05-08T10:56:00.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.760+0000 7f83ea7fc640 1 -- 172.21.15.33:0/1339062938 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83d4003520 con 0x7f83ec15de60 2024-05-08T10:56:00.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.760+0000 7f83ea7fc640 1 -- 172.21.15.33:0/1339062938 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 247135558 0 0) 0x7f83ec0ced40 con 0x7f83ec0d2840 2024-05-08T10:56:00.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.760+0000 7f83ea7fc640 1 -- 172.21.15.33:0/1339062938 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83ec0d1be0 con 0x7f83ec0d2840 2024-05-08T10:56:00.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.760+0000 7f83ebfff640 1 -- 172.21.15.33:0/1339062938 >> v1:172.21.15.174:6789/0 conn(0x7f83ec0d2840 legacy=0x7f83ec0d0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:00.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.760+0000 7f83ebfff640 1 -- 172.21.15.33:0/1339062938 >> v1:172.21.15.33:6789/0 conn(0x7f83ec15de60 legacy=0x7f83ec0d2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:00.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.760+0000 7f83ebfff640 1 -- 172.21.15.33:0/1339062938 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83ec0cf300 con 0x7f83ec0b7a90 2024-05-08T10:56:00.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.761+0000 7f83ebfff640 1 --2- 172.21.15.33:0/1339062938 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f83ec0b7a90 0x7f83ec0ce6f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f83e4009dc0 tx=0x7f83e402a760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ca5379ad336c2d7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:56:00.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.761+0000 7f83ea7fc640 1 -- 172.21.15.33:0/1339062938 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83e4007740 con 0x7f83ec0b7a90 2024-05-08T10:56:00.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.761+0000 7f83ea7fc640 1 -- 172.21.15.33:0/1339062938 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83e40078e0 con 0x7f83ec0b7a90 2024-05-08T10:56:00.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.761+0000 7f83ea7fc640 1 -- 172.21.15.33:0/1339062938 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83e4007cb0 con 0x7f83ec0b7a90 2024-05-08T10:56:00.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.762+0000 7f83f1e3f640 1 -- 172.21.15.33:0/1339062938 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f83ec0b7a90 msgr2=0x7f83ec0ce6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:00.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.762+0000 7f83f1e3f640 1 --2- 172.21.15.33:0/1339062938 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f83ec0b7a90 0x7f83ec0ce6f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f83e4009dc0 tx=0x7f83e402a760 comp rx=0 tx=0).stop 2024-05-08T10:56:00.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.762+0000 7f83f1e3f640 1 -- 172.21.15.33:0/1339062938 shutdown_connections 2024-05-08T10:56:00.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.762+0000 7f83f1e3f640 1 --2- 172.21.15.33:0/1339062938 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f83ec0b7a90 0x7f83ec0ce6f0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:00.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.762+0000 7f83f1e3f640 1 -- 172.21.15.33:0/1339062938 >> 172.21.15.33:0/1339062938 conn(0x7f83ec09cea0 msgr2=0x7f83ec0d3b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:56:00.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.762+0000 7f83f1e3f640 1 -- 172.21.15.33:0/1339062938 shutdown_connections 2024-05-08T10:56:00.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.762+0000 7f83f1e3f640 1 -- 172.21.15.33:0/1339062938 wait complete. 2024-05-08T10:56:00.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.763+0000 7f83f1e3f640 1 Processor -- start 2024-05-08T10:56:00.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.763+0000 7f83f1e3f640 1 -- start start 2024-05-08T10:56:00.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.764+0000 7f83f1e3f640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f83ec0b7a90 0x7f83ec0c98f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:00.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.764+0000 7f83f1e3f640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f83ec0d2840 0x7f83ec0cba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:00.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.764+0000 7f83f1e3f640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f83ec15de60 0x7f83ec160860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:00.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.764+0000 7f83f1e3f640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83ec15e240 con 0x7f83ec0d2840 2024-05-08T10:56:00.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.764+0000 7f83f1e3f640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83ec0cf8c0 con 0x7f83ec0b7a90 2024-05-08T10:56:00.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.764+0000 7f83f1e3f640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83ec15e3c0 con 0x7f83ec15de60 2024-05-08T10:56:00.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.764+0000 7f83eaffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f83ec0d2840 0x7f83ec0cba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:00.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.764+0000 7f83eaffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f83ec0d2840 0x7f83ec0cba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46280/0 (socket says 172.21.15.33:46280) 2024-05-08T10:56:00.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.764+0000 7f83eaffd640 1 -- 172.21.15.33:0/2423313522 learned_addr learned my addr 172.21.15.33:0/2423313522 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:56:00.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.764+0000 7f83ebfff640 1 --2- 172.21.15.33:0/2423313522 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f83ec15de60 0x7f83ec160860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:00.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.764+0000 7f83eb7fe640 1 --2- 172.21.15.33:0/2423313522 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f83ec0b7a90 0x7f83ec0c98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:00.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.764+0000 7f83eaffd640 1 -- 172.21.15.33:0/2423313522 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f83ec15de60 msgr2=0x7f83ec160860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:00.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.764+0000 7f83eaffd640 1 --2- 172.21.15.33:0/2423313522 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f83ec15de60 0x7f83ec160860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:00.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.764+0000 7f83eaffd640 1 -- 172.21.15.33:0/2423313522 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f83ec0b7a90 msgr2=0x7f83ec0c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:00.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.764+0000 7f83eaffd640 1 --2- 172.21.15.33:0/2423313522 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f83ec0b7a90 0x7f83ec0c98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:00.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.764+0000 7f83eaffd640 1 -- 172.21.15.33:0/2423313522 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83ec1f86e0 con 0x7f83ec0d2840 2024-05-08T10:56:00.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.765+0000 7f83eaffd640 1 --2- 172.21.15.33:0/2423313522 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f83ec0d2840 0x7f83ec0cba80 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f83e000c500 tx=0x7f83e000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:56:00.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.765+0000 7f83d3fff640 1 -- 172.21.15.33:0/2423313522 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83e00052d0 con 0x7f83ec0d2840 2024-05-08T10:56:00.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.765+0000 7f83d3fff640 1 -- 172.21.15.33:0/2423313522 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83e0005490 con 0x7f83ec0d2840 2024-05-08T10:56:00.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.765+0000 7f83f1e3f640 1 -- 172.21.15.33:0/2423313522 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83ec0cacc0 con 0x7f83ec0d2840 2024-05-08T10:56:00.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.765+0000 7f83d3fff640 1 -- 172.21.15.33:0/2423313522 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83e0012870 con 0x7f83ec0d2840 2024-05-08T10:56:00.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.765+0000 7f83f1e3f640 1 -- 172.21.15.33:0/2423313522 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83ec0cb280 con 0x7f83ec0d2840 2024-05-08T10:56:00.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.766+0000 7f83f1e3f640 1 -- 172.21.15.33:0/2423313522 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f83ec069d20 con 0x7f83ec0d2840 2024-05-08T10:56:00.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.766+0000 7f83d3fff640 1 -- 172.21.15.33:0/2423313522 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f83e0012a10 con 0x7f83ec0d2840 2024-05-08T10:56:00.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.767+0000 7f83d3fff640 1 --2- 172.21.15.33:0/2423313522 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f83d806b4d0 0x7f83d806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:00.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.767+0000 7f83d3fff640 1 -- 172.21.15.33:0/2423313522 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f83e008a700 con 0x7f83ec0d2840 2024-05-08T10:56:00.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.767+0000 7f83d3fff640 1 --2- 172.21.15.33:0/2423313522 >> [v2:172.21.15.33:6824/1758076090,v1:172.21.15.33:6825/1758076090] conn(0x7f83d8071390 0x7f83d80737b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:00.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.767+0000 7f83d3fff640 1 -- 172.21.15.33:0/2423313522 --> [v2:172.21.15.33:6824/1758076090,v1:172.21.15.33:6825/1758076090] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f83e0007630 con 0x7f83d8071390 2024-05-08T10:56:00.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.767+0000 7f83d3fff640 1 -- 172.21.15.33:0/2423313522 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f83e008ab90 con 0x7f83ec0d2840 2024-05-08T10:56:00.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.767+0000 7f83eb7fe640 1 --2- 172.21.15.33:0/2423313522 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f83d806b4d0 0x7f83d806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:00.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.767+0000 7f83ebfff640 1 --2- 172.21.15.33:0/2423313522 >> [v2:172.21.15.33:6824/1758076090,v1:172.21.15.33:6825/1758076090] conn(0x7f83d8071390 0x7f83d80737b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:00.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.767+0000 7f83ebfff640 1 --2- 172.21.15.33:0/2423313522 >> [v2:172.21.15.33:6824/1758076090,v1:172.21.15.33:6825/1758076090] conn(0x7f83d8071390 0x7f83d80737b0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:56:00.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.767+0000 7f83eb7fe640 1 --2- 172.21.15.33:0/2423313522 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f83d806b4d0 0x7f83d806d990 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f83dc005880 tx=0x7f83dc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:56:00.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.768+0000 7f83d3fff640 1 -- 172.21.15.33:0/2423313522 <== osd.1 v2:172.21.15.33:6824/1758076090 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f83e0007630 con 0x7f83d8071390 2024-05-08T10:56:00.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.781+0000 7f83f1e3f640 1 -- 172.21.15.33:0/2423313522 --> [v2:172.21.15.33:6824/1758076090,v1:172.21.15.33:6825/1758076090] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f83ec0b5420 con 0x7f83d8071390 2024-05-08T10:56:00.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.782+0000 7f83d3fff640 1 -- 172.21.15.33:0/2423313522 <== osd.1 v2:172.21.15.33:6824/1758076090 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f83ec0b5420 con 0x7f83d8071390 2024-05-08T10:56:00.779 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-05-08T10:56:00.779 INFO:teuthology.orchestra.run.smithi033.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-08T10:56:00.779 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-05-08T10:56:00.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.782+0000 7f83f1e3f640 1 -- 172.21.15.33:0/2423313522 >> [v2:172.21.15.33:6824/1758076090,v1:172.21.15.33:6825/1758076090] conn(0x7f83d8071390 msgr2=0x7f83d80737b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:00.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.782+0000 7f83f1e3f640 1 --2- 172.21.15.33:0/2423313522 >> [v2:172.21.15.33:6824/1758076090,v1:172.21.15.33:6825/1758076090] conn(0x7f83d8071390 0x7f83d80737b0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:00.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.782+0000 7f83f1e3f640 1 -- 172.21.15.33:0/2423313522 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f83d806b4d0 msgr2=0x7f83d806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:00.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.782+0000 7f83f1e3f640 1 --2- 172.21.15.33:0/2423313522 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f83d806b4d0 0x7f83d806d990 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f83dc005880 tx=0x7f83dc009040 comp rx=0 tx=0).stop 2024-05-08T10:56:00.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.782+0000 7f83f1e3f640 1 -- 172.21.15.33:0/2423313522 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f83ec0d2840 msgr2=0x7f83ec0cba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:00.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.782+0000 7f83f1e3f640 1 --2- 172.21.15.33:0/2423313522 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f83ec0d2840 0x7f83ec0cba80 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f83e000c500 tx=0x7f83e000c9c0 comp rx=0 tx=0).stop 2024-05-08T10:56:00.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.782+0000 7f83ebfff640 1 -- 172.21.15.33:0/2423313522 reap_dead start 2024-05-08T10:56:00.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.782+0000 7f83f1e3f640 1 -- 172.21.15.33:0/2423313522 shutdown_connections 2024-05-08T10:56:00.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.782+0000 7f83f1e3f640 1 -- 172.21.15.33:0/2423313522 >> 172.21.15.33:0/2423313522 conn(0x7f83ec09cea0 msgr2=0x7f83ec0b5640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:56:00.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.782+0000 7f83f1e3f640 1 -- 172.21.15.33:0/2423313522 shutdown_connections 2024-05-08T10:56:00.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.782+0000 7f83f1e3f640 1 -- 172.21.15.33:0/2423313522 wait complete. 2024-05-08T10:56:00.790 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-05-08T10:56:00.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.897+0000 7fb2ed52b640 1 Processor -- start 2024-05-08T10:56:00.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.898+0000 7fb2ed52b640 1 -- start start 2024-05-08T10:56:00.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.898+0000 7fb2ed52b640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb2e81617c0 0x7fb2e80d4690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:00.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.898+0000 7fb2ed52b640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb2e80b2ad0 0x7fb2e80d0040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:00.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.898+0000 7fb2ed52b640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2e80d0dc0 con 0x7fb2e80d0580 2024-05-08T10:56:00.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.898+0000 7fb2ed52b640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2e80b32d0 con 0x7fb2e80b2ad0 2024-05-08T10:56:00.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.898+0000 7fb2ed52b640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e80cf250 con 0x7fb2e81617c0 2024-05-08T10:56:00.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.899+0000 7fb2e6ffd640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb2e81617c0 0x7fb2e80d4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:00.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.899+0000 7fb2e67fc640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb2e80b2ad0 0x7fb2e80d0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:00.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.899+0000 7fb2e6ffd640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb2e81617c0 0x7fb2e80d4690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.33:36898/0 (socket says 172.21.15.33:36898) 2024-05-08T10:56:00.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.899+0000 7fb2e6ffd640 1 -- 172.21.15.33:0/3762776962 learned_addr learned my addr 172.21.15.33:0/3762776962 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:56:00.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.899+0000 7fb2e77fe640 1 --1- 172.21.15.33:0/3762776962 >> v1:172.21.15.174:6789/0 conn(0x7fb2e80d0580 0x7fb2e80d1a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.33:44038/0 (socket says 172.21.15.33:44038) 2024-05-08T10:56:00.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.899+0000 7fb2e6ffd640 1 -- 172.21.15.33:0/3762776962 >> v2:172.21.15.174:3300/0 conn(0x7fb2e80b2ad0 msgr2=0x7fb2e80d0040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:56:00.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.899+0000 7fb2e6ffd640 1 --2- 172.21.15.33:0/3762776962 >> v2:172.21.15.174:3300/0 conn(0x7fb2e80b2ad0 0x7fb2e80d0040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:00.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.899+0000 7fb2e6ffd640 1 -- 172.21.15.33:0/3762776962 >> v1:172.21.15.174:6789/0 conn(0x7fb2e80d0580 legacy=0x7fb2e80d1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:00.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.899+0000 7fb2e6ffd640 1 -- 172.21.15.33:0/3762776962 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2e80cf4a0 con 0x7fb2e81617c0 2024-05-08T10:56:00.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.900+0000 7fb2e6ffd640 1 --2- 172.21.15.33:0/3762776962 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb2e81617c0 0x7fb2e80d4690 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb2d8009e50 tx=0x7fb2d802a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b113c813cf1cd49c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:56:00.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.900+0000 7fb2e5ffb640 1 -- 172.21.15.33:0/3762776962 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d8036070 con 0x7fb2e81617c0 2024-05-08T10:56:00.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.900+0000 7fb2e5ffb640 1 -- 172.21.15.33:0/3762776962 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2d8031600 con 0x7fb2e81617c0 2024-05-08T10:56:00.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.900+0000 7fb2e5ffb640 1 -- 172.21.15.33:0/3762776962 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d80319d0 con 0x7fb2e81617c0 2024-05-08T10:56:00.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.900+0000 7fb2ed52b640 1 -- 172.21.15.33:0/3762776962 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb2e81617c0 msgr2=0x7fb2e80d4690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:00.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.900+0000 7fb2ed52b640 1 --2- 172.21.15.33:0/3762776962 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb2e81617c0 0x7fb2e80d4690 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb2d8009e50 tx=0x7fb2d802a710 comp rx=0 tx=0).stop 2024-05-08T10:56:00.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.900+0000 7fb2ed52b640 1 -- 172.21.15.33:0/3762776962 shutdown_connections 2024-05-08T10:56:00.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.900+0000 7fb2ed52b640 1 --2- 172.21.15.33:0/3762776962 >> v2:172.21.15.174:3300/0 conn(0x7fb2e80b2ad0 0x7fb2e80d0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:00.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.900+0000 7fb2ed52b640 1 --2- 172.21.15.33:0/3762776962 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb2e81617c0 0x7fb2e80d4690 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:00.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.900+0000 7fb2ed52b640 1 -- 172.21.15.33:0/3762776962 >> 172.21.15.33:0/3762776962 conn(0x7fb2e80d3b70 msgr2=0x7fb2e80d3f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:56:00.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.900+0000 7fb2ed52b640 1 -- 172.21.15.33:0/3762776962 shutdown_connections 2024-05-08T10:56:00.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.901+0000 7fb2ed52b640 1 -- 172.21.15.33:0/3762776962 wait complete. 2024-05-08T10:56:00.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.902+0000 7fb2ed52b640 1 Processor -- start 2024-05-08T10:56:00.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.902+0000 7fb2ed52b640 1 -- start start 2024-05-08T10:56:00.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.903+0000 7fb2ed52b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2e80b2ad0 0x7fb2e815b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:00.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.903+0000 7fb2ed52b640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb2e80d0580 0x7fb2e80b6790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:00.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.903+0000 7fb2ed52b640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb2e81617c0 0x7fb2e81f3d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:00.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.903+0000 7fb2ed52b640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e80d0a10 con 0x7fb2e80b2ad0 2024-05-08T10:56:00.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.903+0000 7fb2ed52b640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e80cfa60 con 0x7fb2e81617c0 2024-05-08T10:56:00.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.903+0000 7fb2ed52b640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e80cc0e0 con 0x7fb2e80d0580 2024-05-08T10:56:00.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.903+0000 7fb2e6ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2e80b2ad0 0x7fb2e815b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:00.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.903+0000 7fb2e6ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2e80b2ad0 0x7fb2e815b340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46290/0 (socket says 172.21.15.33:46290) 2024-05-08T10:56:00.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.903+0000 7fb2e6ffd640 1 -- 172.21.15.33:0/1450014724 learned_addr learned my addr 172.21.15.33:0/1450014724 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:56:00.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.903+0000 7fb2e67fc640 1 --2- 172.21.15.33:0/1450014724 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb2e80d0580 0x7fb2e80b6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:00.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.903+0000 7fb2e77fe640 1 --2- 172.21.15.33:0/1450014724 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb2e81617c0 0x7fb2e81f3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:00.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.903+0000 7fb2e6ffd640 1 -- 172.21.15.33:0/1450014724 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb2e80d0580 msgr2=0x7fb2e80b6790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:00.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.903+0000 7fb2e6ffd640 1 --2- 172.21.15.33:0/1450014724 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb2e80d0580 0x7fb2e80b6790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:00.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.903+0000 7fb2e6ffd640 1 -- 172.21.15.33:0/1450014724 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb2e81617c0 msgr2=0x7fb2e81f3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:00.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.903+0000 7fb2e6ffd640 1 --2- 172.21.15.33:0/1450014724 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb2e81617c0 0x7fb2e81f3d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:00.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.903+0000 7fb2e6ffd640 1 -- 172.21.15.33:0/1450014724 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2e80b6cd0 con 0x7fb2e80b2ad0 2024-05-08T10:56:00.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.903+0000 7fb2e6ffd640 1 --2- 172.21.15.33:0/1450014724 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2e80b2ad0 0x7fb2e815b340 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fb2d8000f80 tx=0x7fb2d8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:56:00.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.904+0000 7fb2df7fe640 1 -- 172.21.15.33:0/1450014724 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d8036050 con 0x7fb2e80b2ad0 2024-05-08T10:56:00.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.904+0000 7fb2df7fe640 1 -- 172.21.15.33:0/1450014724 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2d8042070 con 0x7fb2e80b2ad0 2024-05-08T10:56:00.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.904+0000 7fb2df7fe640 1 -- 172.21.15.33:0/1450014724 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d8009510 con 0x7fb2e80b2ad0 2024-05-08T10:56:00.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.904+0000 7fb2ed52b640 1 -- 172.21.15.33:0/1450014724 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2e80b95b0 con 0x7fb2e80b2ad0 2024-05-08T10:56:00.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.904+0000 7fb2ed52b640 1 -- 172.21.15.33:0/1450014724 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2e80cc330 con 0x7fb2e80b2ad0 2024-05-08T10:56:00.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.905+0000 7fb2ed52b640 1 -- 172.21.15.33:0/1450014724 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2e8069d20 con 0x7fb2e80b2ad0 2024-05-08T10:56:00.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.905+0000 7fb2df7fe640 1 -- 172.21.15.33:0/1450014724 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb2d8007c70 con 0x7fb2e80b2ad0 2024-05-08T10:56:00.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.906+0000 7fb2df7fe640 1 --2- 172.21.15.33:0/1450014724 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fb2c806b4d0 0x7fb2c806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:00.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.906+0000 7fb2df7fe640 1 -- 172.21.15.33:0/1450014724 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fb2d80aac10 con 0x7fb2e80b2ad0 2024-05-08T10:56:00.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.906+0000 7fb2e67fc640 1 --2- 172.21.15.33:0/1450014724 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fb2c806b4d0 0x7fb2c806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:00.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.907+0000 7fb2e67fc640 1 --2- 172.21.15.33:0/1450014724 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fb2c806b4d0 0x7fb2c806d990 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb2e80b5540 tx=0x7fb2d0009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:56:00.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:00.910+0000 7fb2df7fe640 1 -- 172.21.15.33:0/1450014724 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb2e80b6cd0 con 0x7fb2e80b2ad0 2024-05-08T10:56:01.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.092+0000 7fb2ed52b640 1 -- 172.21.15.33:0/1450014724 --> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7fb2e80b1720 con 0x7fb2c806b4d0 2024-05-08T10:56:01.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.092+0000 7fb2df7fe640 1 -- 172.21.15.33:0/1450014724 <== mgr.4103 v2:172.21.15.174:6832/261355069 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb2e80b1720 con 0x7fb2c806b4d0 2024-05-08T10:56:01.090 INFO:teuthology.orchestra.run.smithi033.stderr:instructed osd(s) 1 to deep-scrub 2024-05-08T10:56:01.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.094+0000 7fb2ed52b640 1 -- 172.21.15.33:0/1450014724 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fb2c806b4d0 msgr2=0x7fb2c806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:01.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.094+0000 7fb2ed52b640 1 --2- 172.21.15.33:0/1450014724 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fb2c806b4d0 0x7fb2c806d990 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb2e80b5540 tx=0x7fb2d0009190 comp rx=0 tx=0).stop 2024-05-08T10:56:01.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.094+0000 7fb2ed52b640 1 -- 172.21.15.33:0/1450014724 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2e80b2ad0 msgr2=0x7fb2e815b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:01.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.094+0000 7fb2ed52b640 1 --2- 172.21.15.33:0/1450014724 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2e80b2ad0 0x7fb2e815b340 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fb2d8000f80 tx=0x7fb2d8004a40 comp rx=0 tx=0).stop 2024-05-08T10:56:01.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.094+0000 7fb2ed52b640 1 -- 172.21.15.33:0/1450014724 shutdown_connections 2024-05-08T10:56:01.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.094+0000 7fb2ed52b640 1 --2- 172.21.15.33:0/1450014724 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fb2c806b4d0 0x7fb2c806d990 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:01.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.094+0000 7fb2ed52b640 1 --2- 172.21.15.33:0/1450014724 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb2e81617c0 0x7fb2e81f3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:01.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.094+0000 7fb2ed52b640 1 --2- 172.21.15.33:0/1450014724 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb2e80d0580 0x7fb2e80b6790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:01.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.094+0000 7fb2ed52b640 1 --2- 172.21.15.33:0/1450014724 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2e80b2ad0 0x7fb2e815b340 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:01.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.094+0000 7fb2ed52b640 1 -- 172.21.15.33:0/1450014724 >> 172.21.15.33:0/1450014724 conn(0x7fb2e80d3b70 msgr2=0x7fb2e80b0820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:56:01.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.094+0000 7fb2ed52b640 1 -- 172.21.15.33:0/1450014724 shutdown_connections 2024-05-08T10:56:01.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.094+0000 7fb2ed52b640 1 -- 172.21.15.33:0/1450014724 wait complete. 2024-05-08T10:56:01.103 INFO:tasks.ceph:Scrubbing osd.2 2024-05-08T10:56:01.103 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-05-08T10:56:01.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.213+0000 7f54caa5d640 1 Processor -- start 2024-05-08T10:56:01.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.213+0000 7f54caa5d640 1 -- start start 2024-05-08T10:56:01.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.214+0000 7f54caa5d640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f54c406aba0 0x7f54c406afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:01.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.214+0000 7f54caa5d640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54c406b4e0 con 0x7f54c415e2f0 2024-05-08T10:56:01.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.214+0000 7f54caa5d640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54c40b0250 con 0x7f54c415df10 2024-05-08T10:56:01.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.214+0000 7f54caa5d640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54c40b0860 con 0x7f54c406aba0 2024-05-08T10:56:01.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.214+0000 7f54bbfff640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f54c415e2f0 0x7f54c40b0cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:44690/0 (socket says 172.21.15.33:44690) 2024-05-08T10:56:01.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.214+0000 7f54bbfff640 1 -- 172.21.15.33:0/2602881524 learned_addr learned my addr 172.21.15.33:0/2602881524 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-05-08T10:56:01.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.214+0000 7f54c8ffa640 1 --2- 172.21.15.33:0/2602881524 >> v2:172.21.15.33:3300/0 conn(0x7f54c406aba0 0x7f54c406afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:01.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.214+0000 7f54c8ffa640 1 -- 172.21.15.33:0/2602881524 >> v1:172.21.15.174:6789/0 conn(0x7f54c415df10 legacy=0x7f54c40cd560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:01.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.214+0000 7f54c8ffa640 1 -- 172.21.15.33:0/2602881524 >> v1:172.21.15.33:6789/0 conn(0x7f54c415e2f0 legacy=0x7f54c40b0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:01.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.215+0000 7f54c37fe640 1 -- 172.21.15.33:0/2602881524 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 485456194 0 0) 0x7f54c406b4e0 con 0x7f54c415e2f0 2024-05-08T10:56:01.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.215+0000 7f54c8ffa640 1 -- 172.21.15.33:0/2602881524 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54c4066cc0 con 0x7f54c406aba0 2024-05-08T10:56:01.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.215+0000 7f54c8ffa640 1 --2- 172.21.15.33:0/2602881524 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f54c406aba0 0x7f54c406afa0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f54c40b09e0 tx=0x7f54bc02a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da6a791b9ec3c6a0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:56:01.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.215+0000 7f54c37fe640 1 -- 172.21.15.33:0/2602881524 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54bc007740 con 0x7f54c406aba0 2024-05-08T10:56:01.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.215+0000 7f54c37fe640 1 -- 172.21.15.33:0/2602881524 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54bc0078e0 con 0x7f54c406aba0 2024-05-08T10:56:01.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.215+0000 7f54c37fe640 1 -- 172.21.15.33:0/2602881524 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54bc007cb0 con 0x7f54c406aba0 2024-05-08T10:56:01.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.216+0000 7f54caa5d640 1 -- 172.21.15.33:0/2602881524 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f54c406aba0 msgr2=0x7f54c406afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:01.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.216+0000 7f54caa5d640 1 --2- 172.21.15.33:0/2602881524 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f54c406aba0 0x7f54c406afa0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f54c40b09e0 tx=0x7f54bc02a6f0 comp rx=0 tx=0).stop 2024-05-08T10:56:01.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.216+0000 7f54caa5d640 1 -- 172.21.15.33:0/2602881524 shutdown_connections 2024-05-08T10:56:01.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.216+0000 7f54caa5d640 1 --2- 172.21.15.33:0/2602881524 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f54c406aba0 0x7f54c406afa0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:01.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.216+0000 7f54caa5d640 1 -- 172.21.15.33:0/2602881524 >> 172.21.15.33:0/2602881524 conn(0x7f54c40b3260 msgr2=0x7f54c40b3670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:56:01.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.216+0000 7f54caa5d640 1 -- 172.21.15.33:0/2602881524 shutdown_connections 2024-05-08T10:56:01.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.216+0000 7f54caa5d640 1 -- 172.21.15.33:0/2602881524 wait complete. 2024-05-08T10:56:01.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.217+0000 7f54caa5d640 1 Processor -- start 2024-05-08T10:56:01.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.217+0000 7f54caa5d640 1 -- start start 2024-05-08T10:56:01.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.218+0000 7f54caa5d640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f54c406aba0 0x7f54c41f41a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:01.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.218+0000 7f54caa5d640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f54c415df10 0x7f54c4160900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:01.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.218+0000 7f54caa5d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f54c41f6d10 0x7f54c41f71c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:01.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.218+0000 7f54caa5d640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54c40b1400 con 0x7f54c41f6d10 2024-05-08T10:56:01.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.218+0000 7f54caa5d640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54c4066fa0 con 0x7f54c415df10 2024-05-08T10:56:01.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.218+0000 7f54caa5d640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54c4066990 con 0x7f54c406aba0 2024-05-08T10:56:01.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.218+0000 7f54c8ffa640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f54c41f6d10 0x7f54c41f71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:01.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.218+0000 7f54c8ffa640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f54c41f6d10 0x7f54c41f71c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46296/0 (socket says 172.21.15.33:46296) 2024-05-08T10:56:01.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.218+0000 7f54c8ffa640 1 -- 172.21.15.33:0/2145431958 learned_addr learned my addr 172.21.15.33:0/2145431958 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:56:01.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.218+0000 7f54bbfff640 1 --2- 172.21.15.33:0/2145431958 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f54c415df10 0x7f54c4160900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:01.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.218+0000 7f54c3fff640 1 --2- 172.21.15.33:0/2145431958 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f54c406aba0 0x7f54c41f41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:01.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.219+0000 7f54c8ffa640 1 -- 172.21.15.33:0/2145431958 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f54c406aba0 msgr2=0x7f54c41f41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:01.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.219+0000 7f54c8ffa640 1 --2- 172.21.15.33:0/2145431958 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f54c406aba0 0x7f54c41f41a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:01.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.219+0000 7f54c8ffa640 1 -- 172.21.15.33:0/2145431958 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f54c415df10 msgr2=0x7f54c4160900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:01.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.219+0000 7f54c8ffa640 1 --2- 172.21.15.33:0/2145431958 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f54c415df10 0x7f54c4160900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:01.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.219+0000 7f54c8ffa640 1 -- 172.21.15.33:0/2145431958 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54c41f3720 con 0x7f54c41f6d10 2024-05-08T10:56:01.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.219+0000 7f54c8ffa640 1 --2- 172.21.15.33:0/2145431958 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f54c41f6d10 0x7f54c41f71c0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f54bc009e50 tx=0x7f54bc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:56:01.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.219+0000 7f54c17fa640 1 -- 172.21.15.33:0/2145431958 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54bc040070 con 0x7f54c41f6d10 2024-05-08T10:56:01.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.219+0000 7f54c17fa640 1 -- 172.21.15.33:0/2145431958 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54bc031bf0 con 0x7f54c41f6d10 2024-05-08T10:56:01.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.219+0000 7f54c17fa640 1 -- 172.21.15.33:0/2145431958 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54bc045460 con 0x7f54c41f6d10 2024-05-08T10:56:01.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.219+0000 7f54caa5d640 1 -- 172.21.15.33:0/2145431958 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54c41f77b0 con 0x7f54c41f6d10 2024-05-08T10:56:01.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.219+0000 7f54caa5d640 1 -- 172.21.15.33:0/2145431958 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54c41f39a0 con 0x7f54c41f6d10 2024-05-08T10:56:01.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.220+0000 7f54caa5d640 1 -- 172.21.15.33:0/2145431958 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f54c4160e40 con 0x7f54c41f6d10 2024-05-08T10:56:01.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.220+0000 7f54c17fa640 1 -- 172.21.15.33:0/2145431958 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f54bc039040 con 0x7f54c41f6d10 2024-05-08T10:56:01.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.221+0000 7f54c17fa640 1 --2- 172.21.15.33:0/2145431958 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f54a406b4d0 0x7f54a406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:01.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.221+0000 7f54c17fa640 1 -- 172.21.15.33:0/2145431958 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f54bc0ab7f0 con 0x7f54c41f6d10 2024-05-08T10:56:01.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.221+0000 7f54c17fa640 1 --2- 172.21.15.33:0/2145431958 >> [v2:172.21.15.33:6800/2940853479,v1:172.21.15.33:6801/2940853479] conn(0x7f54a4071390 0x7f54a40737b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:01.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.221+0000 7f54c17fa640 1 -- 172.21.15.33:0/2145431958 --> [v2:172.21.15.33:6800/2940853479,v1:172.21.15.33:6801/2940853479] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f54bc043e50 con 0x7f54a4071390 2024-05-08T10:56:01.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.221+0000 7f54c17fa640 1 -- 172.21.15.33:0/2145431958 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f54bc0b02c0 con 0x7f54c41f6d10 2024-05-08T10:56:01.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.221+0000 7f54c3fff640 1 --2- 172.21.15.33:0/2145431958 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f54a406b4d0 0x7f54a406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:01.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.221+0000 7f54bbfff640 1 --2- 172.21.15.33:0/2145431958 >> [v2:172.21.15.33:6800/2940853479,v1:172.21.15.33:6801/2940853479] conn(0x7f54a4071390 0x7f54a40737b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:01.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.222+0000 7f54c3fff640 1 --2- 172.21.15.33:0/2145431958 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f54a406b4d0 0x7f54a406d990 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f54b4000f60 tx=0x7f54b4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:56:01.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.222+0000 7f54bbfff640 1 --2- 172.21.15.33:0/2145431958 >> [v2:172.21.15.33:6800/2940853479,v1:172.21.15.33:6801/2940853479] conn(0x7f54a4071390 0x7f54a40737b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:56:01.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.222+0000 7f54c17fa640 1 -- 172.21.15.33:0/2145431958 <== osd.2 v2:172.21.15.33:6800/2940853479 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f54bc043e50 con 0x7f54a4071390 2024-05-08T10:56:01.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.235+0000 7f54caa5d640 1 -- 172.21.15.33:0/2145431958 --> [v2:172.21.15.33:6800/2940853479,v1:172.21.15.33:6801/2940853479] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f54c4069d20 con 0x7f54a4071390 2024-05-08T10:56:01.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.236+0000 7f54c17fa640 1 -- 172.21.15.33:0/2145431958 <== osd.2 v2:172.21.15.33:6800/2940853479 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f54c4069d20 con 0x7f54a4071390 2024-05-08T10:56:01.233 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-05-08T10:56:01.233 INFO:teuthology.orchestra.run.smithi033.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-08T10:56:01.233 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-05-08T10:56:01.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.236+0000 7f54caa5d640 1 -- 172.21.15.33:0/2145431958 >> [v2:172.21.15.33:6800/2940853479,v1:172.21.15.33:6801/2940853479] conn(0x7f54a4071390 msgr2=0x7f54a40737b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:01.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.236+0000 7f54caa5d640 1 --2- 172.21.15.33:0/2145431958 >> [v2:172.21.15.33:6800/2940853479,v1:172.21.15.33:6801/2940853479] conn(0x7f54a4071390 0x7f54a40737b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:01.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.236+0000 7f54caa5d640 1 -- 172.21.15.33:0/2145431958 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f54a406b4d0 msgr2=0x7f54a406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:01.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.236+0000 7f54caa5d640 1 --2- 172.21.15.33:0/2145431958 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f54a406b4d0 0x7f54a406d990 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f54b4000f60 tx=0x7f54b4009040 comp rx=0 tx=0).stop 2024-05-08T10:56:01.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.236+0000 7f54caa5d640 1 -- 172.21.15.33:0/2145431958 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f54c41f6d10 msgr2=0x7f54c41f71c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:01.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.236+0000 7f54caa5d640 1 --2- 172.21.15.33:0/2145431958 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f54c41f6d10 0x7f54c41f71c0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f54bc009e50 tx=0x7f54bc004a40 comp rx=0 tx=0).stop 2024-05-08T10:56:01.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.236+0000 7f54c8ffa640 1 -- 172.21.15.33:0/2145431958 reap_dead start 2024-05-08T10:56:01.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.236+0000 7f54caa5d640 1 -- 172.21.15.33:0/2145431958 shutdown_connections 2024-05-08T10:56:01.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.236+0000 7f54caa5d640 1 -- 172.21.15.33:0/2145431958 >> 172.21.15.33:0/2145431958 conn(0x7f54c40b3260 msgr2=0x7f54c40ad7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:56:01.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.236+0000 7f54caa5d640 1 -- 172.21.15.33:0/2145431958 shutdown_connections 2024-05-08T10:56:01.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.236+0000 7f54caa5d640 1 -- 172.21.15.33:0/2145431958 wait complete. 2024-05-08T10:56:01.244 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-05-08T10:56:01.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.351+0000 7fd612b6a640 1 Processor -- start 2024-05-08T10:56:01.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.351+0000 7fd612b6a640 1 -- start start 2024-05-08T10:56:01.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.352+0000 7fd612b6a640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd60c0cfdc0 0x7fd60c0d0220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:01.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.352+0000 7fd612b6a640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fd60c15cd80 0x7fd60c15d210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:01.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.352+0000 7fd612b6a640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd60c0b4140 con 0x7fd60c144630 2024-05-08T10:56:01.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.352+0000 7fd612b6a640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd60c0d0760 con 0x7fd60c15cd80 2024-05-08T10:56:01.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.352+0000 7fd612b6a640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd60c15c330 con 0x7fd60c0cfdc0 2024-05-08T10:56:01.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.352+0000 7fd611107640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fd60c15cd80 0x7fd60c15d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:01.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.352+0000 7fd610906640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fd60c144630 0x7fd60c0b35d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:44694/0 (socket says 172.21.15.33:44694) 2024-05-08T10:56:01.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.352+0000 7fd610906640 1 -- 172.21.15.33:0/3313573273 learned_addr learned my addr 172.21.15.33:0/3313573273 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-05-08T10:56:01.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.352+0000 7fd611107640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fd60c15cd80 0x7fd60c15d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46300/0 (socket says 172.21.15.33:46300) 2024-05-08T10:56:01.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.352+0000 7fd603fff640 1 --2- 172.21.15.33:0/3313573273 >> v2:172.21.15.174:3300/0 conn(0x7fd60c0cfdc0 0x7fd60c0d0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:01.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.352+0000 7fd611107640 1 -- 172.21.15.33:0/3313573273 >> v2:172.21.15.174:3300/0 conn(0x7fd60c0cfdc0 msgr2=0x7fd60c0d0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:56:01.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.352+0000 7fd611107640 1 --2- 172.21.15.33:0/3313573273 >> v2:172.21.15.174:3300/0 conn(0x7fd60c0cfdc0 0x7fd60c0d0220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:01.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.352+0000 7fd611107640 1 -- 172.21.15.33:0/3313573273 >> v1:172.21.15.33:6789/0 conn(0x7fd60c144630 legacy=0x7fd60c0b35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:01.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.352+0000 7fd611107640 1 -- 172.21.15.33:0/3313573273 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd60c0b4420 con 0x7fd60c15cd80 2024-05-08T10:56:01.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.352+0000 7fd6037fe640 1 -- 172.21.15.33:0/3313573273 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2003876943 0 0) 0x7fd60c0b4140 con 0x7fd60c144630 2024-05-08T10:56:01.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.353+0000 7fd611107640 1 --2- 172.21.15.33:0/3313573273 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd60c15cd80 0x7fd60c15d210 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fd60c152260 tx=0x7fd60402c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25948d526142798c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:56:01.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.353+0000 7fd6037fe640 1 -- 172.21.15.33:0/3313573273 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd604039070 con 0x7fd60c15cd80 2024-05-08T10:56:01.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.353+0000 7fd6037fe640 1 -- 172.21.15.33:0/3313573273 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd604009540 con 0x7fd60c15cd80 2024-05-08T10:56:01.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.353+0000 7fd6037fe640 1 -- 172.21.15.33:0/3313573273 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd604009910 con 0x7fd60c15cd80 2024-05-08T10:56:01.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.354+0000 7fd612b6a640 1 -- 172.21.15.33:0/3313573273 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd60c15cd80 msgr2=0x7fd60c15d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:01.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.354+0000 7fd612b6a640 1 --2- 172.21.15.33:0/3313573273 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd60c15cd80 0x7fd60c15d210 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fd60c152260 tx=0x7fd60402c890 comp rx=0 tx=0).stop 2024-05-08T10:56:01.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.354+0000 7fd612b6a640 1 -- 172.21.15.33:0/3313573273 shutdown_connections 2024-05-08T10:56:01.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.354+0000 7fd612b6a640 1 --2- 172.21.15.33:0/3313573273 >> v2:172.21.15.174:3300/0 conn(0x7fd60c0cfdc0 0x7fd60c0d0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:01.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.354+0000 7fd612b6a640 1 --2- 172.21.15.33:0/3313573273 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd60c15cd80 0x7fd60c15d210 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:01.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.354+0000 7fd612b6a640 1 -- 172.21.15.33:0/3313573273 >> 172.21.15.33:0/3313573273 conn(0x7fd60c06afc0 msgr2=0x7fd60c06b3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:56:01.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.354+0000 7fd612b6a640 1 -- 172.21.15.33:0/3313573273 shutdown_connections 2024-05-08T10:56:01.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.354+0000 7fd612b6a640 1 -- 172.21.15.33:0/3313573273 wait complete. 2024-05-08T10:56:01.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.355+0000 7fd612b6a640 1 Processor -- start 2024-05-08T10:56:01.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.355+0000 7fd612b6a640 1 -- start start 2024-05-08T10:56:01.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.356+0000 7fd612b6a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd60c0cfdc0 0x7fd60c13e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:01.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.356+0000 7fd612b6a640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd60c144630 0x7fd60c13f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:01.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.356+0000 7fd612b6a640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd60c15cd80 0x7fd60c15b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:01.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.356+0000 7fd612b6a640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd60c0b2be0 con 0x7fd60c0cfdc0 2024-05-08T10:56:01.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.356+0000 7fd612b6a640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd60c15c860 con 0x7fd60c144630 2024-05-08T10:56:01.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.356+0000 7fd612b6a640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd60c0b3ce0 con 0x7fd60c15cd80 2024-05-08T10:56:01.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.356+0000 7fd610906640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd60c0cfdc0 0x7fd60c13e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:01.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.356+0000 7fd610906640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd60c0cfdc0 0x7fd60c13e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46306/0 (socket says 172.21.15.33:46306) 2024-05-08T10:56:01.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.356+0000 7fd610906640 1 -- 172.21.15.33:0/1062471691 learned_addr learned my addr 172.21.15.33:0/1062471691 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:56:01.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.356+0000 7fd603fff640 1 --2- 172.21.15.33:0/1062471691 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd60c144630 0x7fd60c13f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:01.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.356+0000 7fd611107640 1 --2- 172.21.15.33:0/1062471691 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd60c15cd80 0x7fd60c15b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:01.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.356+0000 7fd610906640 1 -- 172.21.15.33:0/1062471691 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd60c15cd80 msgr2=0x7fd60c15b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:01.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.356+0000 7fd610906640 1 --2- 172.21.15.33:0/1062471691 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd60c15cd80 0x7fd60c15b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:01.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.356+0000 7fd610906640 1 -- 172.21.15.33:0/1062471691 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd60c144630 msgr2=0x7fd60c13f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:01.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.356+0000 7fd610906640 1 --2- 172.21.15.33:0/1062471691 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd60c144630 0x7fd60c13f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:01.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.356+0000 7fd610906640 1 -- 172.21.15.33:0/1062471691 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd60c0ce820 con 0x7fd60c0cfdc0 2024-05-08T10:56:01.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.357+0000 7fd610906640 1 --2- 172.21.15.33:0/1062471691 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd60c0cfdc0 0x7fd60c13e5d0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fd60800c500 tx=0x7fd60800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:56:01.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.357+0000 7fd6017fa640 1 -- 172.21.15.33:0/1062471691 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd608018070 con 0x7fd60c0cfdc0 2024-05-08T10:56:01.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.357+0000 7fd6017fa640 1 -- 172.21.15.33:0/1062471691 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd608007580 con 0x7fd60c0cfdc0 2024-05-08T10:56:01.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.357+0000 7fd612b6a640 1 -- 172.21.15.33:0/1062471691 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd60c0ceb00 con 0x7fd60c0cfdc0 2024-05-08T10:56:01.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.357+0000 7fd6017fa640 1 -- 172.21.15.33:0/1062471691 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd608004a20 con 0x7fd60c0cfdc0 2024-05-08T10:56:01.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.357+0000 7fd612b6a640 1 -- 172.21.15.33:0/1062471691 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd60c15bbe0 con 0x7fd60c0cfdc0 2024-05-08T10:56:01.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.358+0000 7fd612b6a640 1 -- 172.21.15.33:0/1062471691 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd60c069d20 con 0x7fd60c0cfdc0 2024-05-08T10:56:01.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.358+0000 7fd6017fa640 1 -- 172.21.15.33:0/1062471691 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd60801b070 con 0x7fd60c0cfdc0 2024-05-08T10:56:01.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.359+0000 7fd6017fa640 1 --2- 172.21.15.33:0/1062471691 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fd5f806b4d0 0x7fd5f806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:01.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.359+0000 7fd6017fa640 1 -- 172.21.15.33:0/1062471691 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fd608089180 con 0x7fd60c0cfdc0 2024-05-08T10:56:01.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.359+0000 7fd603fff640 1 --2- 172.21.15.33:0/1062471691 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fd5f806b4d0 0x7fd5f806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:01.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.359+0000 7fd603fff640 1 --2- 172.21.15.33:0/1062471691 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fd5f806b4d0 0x7fd5f806d990 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd60c13eb10 tx=0x7fd5fc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:56:01.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.363+0000 7fd6017fa640 1 -- 172.21.15.33:0/1062471691 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd608058390 con 0x7fd60c0cfdc0 2024-05-08T10:56:01.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.544+0000 7fd612b6a640 1 -- 172.21.15.33:0/1062471691 --> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7fd60c0cecd0 con 0x7fd5f806b4d0 2024-05-08T10:56:01.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.545+0000 7fd6017fa640 1 -- 172.21.15.33:0/1062471691 <== mgr.4103 v2:172.21.15.174:6832/261355069 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd60c0cecd0 con 0x7fd5f806b4d0 2024-05-08T10:56:01.542 INFO:teuthology.orchestra.run.smithi033.stderr:instructed osd(s) 2 to deep-scrub 2024-05-08T10:56:01.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.547+0000 7fd612b6a640 1 -- 172.21.15.33:0/1062471691 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fd5f806b4d0 msgr2=0x7fd5f806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:01.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.547+0000 7fd612b6a640 1 --2- 172.21.15.33:0/1062471691 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fd5f806b4d0 0x7fd5f806d990 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd60c13eb10 tx=0x7fd5fc008040 comp rx=0 tx=0).stop 2024-05-08T10:56:01.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.547+0000 7fd612b6a640 1 -- 172.21.15.33:0/1062471691 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd60c0cfdc0 msgr2=0x7fd60c13e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:01.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.547+0000 7fd612b6a640 1 --2- 172.21.15.33:0/1062471691 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd60c0cfdc0 0x7fd60c13e5d0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fd60800c500 tx=0x7fd60800c9c0 comp rx=0 tx=0).stop 2024-05-08T10:56:01.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.547+0000 7fd612b6a640 1 -- 172.21.15.33:0/1062471691 shutdown_connections 2024-05-08T10:56:01.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.547+0000 7fd612b6a640 1 --2- 172.21.15.33:0/1062471691 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fd5f806b4d0 0x7fd5f806d990 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:01.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.547+0000 7fd612b6a640 1 --2- 172.21.15.33:0/1062471691 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd60c15cd80 0x7fd60c15b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:01.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.547+0000 7fd612b6a640 1 --2- 172.21.15.33:0/1062471691 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd60c144630 0x7fd60c13f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:01.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.547+0000 7fd612b6a640 1 --2- 172.21.15.33:0/1062471691 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd60c0cfdc0 0x7fd60c13e5d0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:01.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.547+0000 7fd612b6a640 1 -- 172.21.15.33:0/1062471691 >> 172.21.15.33:0/1062471691 conn(0x7fd60c06afc0 msgr2=0x7fd60c0b0b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:56:01.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.547+0000 7fd612b6a640 1 -- 172.21.15.33:0/1062471691 shutdown_connections 2024-05-08T10:56:01.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.547+0000 7fd612b6a640 1 -- 172.21.15.33:0/1062471691 wait complete. 2024-05-08T10:56:01.556 INFO:tasks.ceph:Scrubbing osd.3 2024-05-08T10:56:01.556 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-05-08T10:56:01.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.666+0000 7f5724360640 1 Processor -- start 2024-05-08T10:56:01.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.666+0000 7f5724360640 1 -- start start 2024-05-08T10:56:01.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.667+0000 7f5724360640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f571c15e150 0x7f571c0b3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:01.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.667+0000 7f5724360640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f571c0b2e80 0x7f571c0b5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:01.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.667+0000 7f5724360640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f571c15e530 0x7f571c0d0370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:01.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.667+0000 7f5724360640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f571c0ce960 con 0x7f571c0b2e80 2024-05-08T10:56:01.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.667+0000 7f5724360640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f571c0d4a60 con 0x7f571c15e530 2024-05-08T10:56:01.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.667+0000 7f5724360640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f571c0d2530 con 0x7f571c15e150 2024-05-08T10:56:01.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.667+0000 7f57218fb640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f571c0b2e80 0x7f571c0b5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:01.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.667+0000 7f57218fb640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f571c0b2e80 0x7f571c0b5090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46322/0 (socket says 172.21.15.33:46322) 2024-05-08T10:56:01.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.667+0000 7f57218fb640 1 -- 172.21.15.33:0/244965432 learned_addr learned my addr 172.21.15.33:0/244965432 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:56:01.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.668+0000 7f57220fc640 1 --2- 172.21.15.33:0/244965432 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f571c15e150 0x7f571c0b3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:01.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.668+0000 7f57228fd640 1 --2- 172.21.15.33:0/244965432 >> v2:172.21.15.174:3300/0 conn(0x7f571c15e530 0x7f571c0d0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:01.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.668+0000 7f57218fb640 1 -- 172.21.15.33:0/244965432 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f571c15e150 msgr2=0x7f571c0b3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:56:01.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.668+0000 7f57218fb640 1 --2- 172.21.15.33:0/244965432 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f571c15e150 0x7f571c0b3280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:01.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.668+0000 7f57218fb640 1 -- 172.21.15.33:0/244965432 >> v2:172.21.15.174:3300/0 conn(0x7f571c15e530 msgr2=0x7f571c0d0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:56:01.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.668+0000 7f57218fb640 1 --2- 172.21.15.33:0/244965432 >> v2:172.21.15.174:3300/0 conn(0x7f571c15e530 0x7f571c0d0370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:01.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.668+0000 7f57218fb640 1 -- 172.21.15.33:0/244965432 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f571c0d2810 con 0x7f571c0b2e80 2024-05-08T10:56:01.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.668+0000 7f57220fc640 1 --2- 172.21.15.33:0/244965432 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f571c15e150 0x7f571c0b3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:56:01.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.668+0000 7f57228fd640 1 --2- 172.21.15.33:0/244965432 >> v2:172.21.15.174:3300/0 conn(0x7f571c15e530 0x7f571c0d0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:56:01.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.668+0000 7f57218fb640 1 --2- 172.21.15.33:0/244965432 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f571c0b2e80 0x7f571c0b5090 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f571c0d3b10 tx=0x7f571002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b7caaf97d88df88 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:56:01.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.669+0000 7f57210fa640 1 -- 172.21.15.33:0/244965432 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5710037070 con 0x7f571c0b2e80 2024-05-08T10:56:01.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.669+0000 7f57210fa640 1 -- 172.21.15.33:0/244965432 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5710032440 con 0x7f571c0b2e80 2024-05-08T10:56:01.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.669+0000 7f57210fa640 1 -- 172.21.15.33:0/244965432 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5710032810 con 0x7f571c0b2e80 2024-05-08T10:56:01.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.669+0000 7f5724360640 1 -- 172.21.15.33:0/244965432 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f571c0b2e80 msgr2=0x7f571c0b5090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:01.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.669+0000 7f5724360640 1 --2- 172.21.15.33:0/244965432 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f571c0b2e80 0x7f571c0b5090 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f571c0d3b10 tx=0x7f571002a270 comp rx=0 tx=0).stop 2024-05-08T10:56:01.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.669+0000 7f5724360640 1 -- 172.21.15.33:0/244965432 shutdown_connections 2024-05-08T10:56:01.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.669+0000 7f5724360640 1 --2- 172.21.15.33:0/244965432 >> v2:172.21.15.174:3300/0 conn(0x7f571c15e530 0x7f571c0d0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:01.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.669+0000 7f5724360640 1 --2- 172.21.15.33:0/244965432 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f571c0b2e80 0x7f571c0b5090 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:01.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.669+0000 7f5724360640 1 --2- 172.21.15.33:0/244965432 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f571c15e150 0x7f571c0b3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:01.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.669+0000 7f5724360640 1 -- 172.21.15.33:0/244965432 >> 172.21.15.33:0/244965432 conn(0x7f571c0d3b80 msgr2=0x7f571c0d3f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:56:01.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.669+0000 7f5724360640 1 -- 172.21.15.33:0/244965432 shutdown_connections 2024-05-08T10:56:01.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.669+0000 7f5724360640 1 -- 172.21.15.33:0/244965432 wait complete. 2024-05-08T10:56:01.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.670+0000 7f5724360640 1 Processor -- start 2024-05-08T10:56:01.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.671+0000 7f5724360640 1 -- start start 2024-05-08T10:56:01.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.671+0000 7f5724360640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f571c0b2e80 0x7f571c0cb5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:01.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.671+0000 7f5724360640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f571c15e150 0x7f571c1f6f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:01.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.671+0000 7f5724360640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f571c15e530 0x7f571c0b1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:01.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.671+0000 7f5724360640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f571c0d4820 con 0x7f571c15e530 2024-05-08T10:56:01.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.671+0000 7f5724360640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f571c0d46a0 con 0x7f571c0b2e80 2024-05-08T10:56:01.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.671+0000 7f5724360640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f571c0d08b0 con 0x7f571c15e150 2024-05-08T10:56:01.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.671+0000 7f57228fd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f571c15e530 0x7f571c0b1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:01.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.671+0000 7f57228fd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f571c15e530 0x7f571c0b1fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46324/0 (socket says 172.21.15.33:46324) 2024-05-08T10:56:01.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.671+0000 7f57228fd640 1 -- 172.21.15.33:0/3472378583 learned_addr learned my addr 172.21.15.33:0/3472378583 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:56:01.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.672+0000 7f57228fd640 1 -- 172.21.15.33:0/3472378583 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f571c15e150 msgr2=0x7f571c1f6f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:01.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.672+0000 7f57228fd640 1 --2- 172.21.15.33:0/3472378583 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f571c15e150 0x7f571c1f6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:01.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.672+0000 7f57228fd640 1 -- 172.21.15.33:0/3472378583 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f571c0b2e80 msgr2=0x7f571c0cb5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:01.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.672+0000 7f57220fc640 1 --2- 172.21.15.33:0/3472378583 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f571c0b2e80 0x7f571c0cb5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:01.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.672+0000 7f57228fd640 1 --2- 172.21.15.33:0/3472378583 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f571c0b2e80 0x7f571c0cb5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:01.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.672+0000 7f57228fd640 1 -- 172.21.15.33:0/3472378583 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f571c1f4730 con 0x7f571c15e530 2024-05-08T10:56:01.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.672+0000 7f57228fd640 1 --2- 172.21.15.33:0/3472378583 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f571c15e530 0x7f571c0b1fc0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f571400d7d0 tx=0x7f571400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:56:01.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.672+0000 7f571affd640 1 -- 172.21.15.33:0/3472378583 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5714004030 con 0x7f571c15e530 2024-05-08T10:56:01.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.672+0000 7f571affd640 1 -- 172.21.15.33:0/3472378583 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57140041d0 con 0x7f571c15e530 2024-05-08T10:56:01.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.672+0000 7f5724360640 1 -- 172.21.15.33:0/3472378583 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f571c1f4a10 con 0x7f571c15e530 2024-05-08T10:56:01.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.672+0000 7f571affd640 1 -- 172.21.15.33:0/3472378583 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57140096a0 con 0x7f571c15e530 2024-05-08T10:56:01.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.672+0000 7f5724360640 1 -- 172.21.15.33:0/3472378583 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f571c1f4fd0 con 0x7f571c15e530 2024-05-08T10:56:01.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.673+0000 7f5724360640 1 -- 172.21.15.33:0/3472378583 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f571c069d20 con 0x7f571c15e530 2024-05-08T10:56:01.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.674+0000 7f571affd640 1 -- 172.21.15.33:0/3472378583 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5714009840 con 0x7f571c15e530 2024-05-08T10:56:01.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.674+0000 7f571affd640 1 --2- 172.21.15.33:0/3472378583 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f570806b500 0x7f570806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:01.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.674+0000 7f571affd640 1 -- 172.21.15.33:0/3472378583 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f571408a230 con 0x7f571c15e530 2024-05-08T10:56:01.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.674+0000 7f571affd640 1 --2- 172.21.15.33:0/3472378583 >> [v2:172.21.15.33:6802/4029047077,v1:172.21.15.33:6804/4029047077] conn(0x7f57080713c0 0x7f57080737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:01.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.674+0000 7f571affd640 1 -- 172.21.15.33:0/3472378583 --> [v2:172.21.15.33:6802/4029047077,v1:172.21.15.33:6804/4029047077] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f571401ee50 con 0x7f57080713c0 2024-05-08T10:56:01.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.674+0000 7f571affd640 1 -- 172.21.15.33:0/3472378583 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5714091050 con 0x7f571c15e530 2024-05-08T10:56:01.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.674+0000 7f57220fc640 1 --2- 172.21.15.33:0/3472378583 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f570806b500 0x7f570806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:01.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.674+0000 7f57218fb640 1 --2- 172.21.15.33:0/3472378583 >> [v2:172.21.15.33:6802/4029047077,v1:172.21.15.33:6804/4029047077] conn(0x7f57080713c0 0x7f57080737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:01.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.675+0000 7f57218fb640 1 --2- 172.21.15.33:0/3472378583 >> [v2:172.21.15.33:6802/4029047077,v1:172.21.15.33:6804/4029047077] conn(0x7f57080713c0 0x7f57080737e0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:56:01.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.675+0000 7f57220fc640 1 --2- 172.21.15.33:0/3472378583 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f570806b500 0x7f570806d9c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f570c009ef0 tx=0x7f570c00b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:56:01.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.675+0000 7f571affd640 1 -- 172.21.15.33:0/3472378583 <== osd.3 v2:172.21.15.33:6802/4029047077 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f571401ee50 con 0x7f57080713c0 2024-05-08T10:56:01.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.688+0000 7f5724360640 1 -- 172.21.15.33:0/3472378583 --> [v2:172.21.15.33:6802/4029047077,v1:172.21.15.33:6804/4029047077] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f571c1f53f0 con 0x7f57080713c0 2024-05-08T10:56:01.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.689+0000 7f571affd640 1 -- 172.21.15.33:0/3472378583 <== osd.3 v2:172.21.15.33:6802/4029047077 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f571c1f53f0 con 0x7f57080713c0 2024-05-08T10:56:01.687 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-05-08T10:56:01.687 INFO:teuthology.orchestra.run.smithi033.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-08T10:56:01.687 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-05-08T10:56:01.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.689+0000 7f5724360640 1 -- 172.21.15.33:0/3472378583 >> [v2:172.21.15.33:6802/4029047077,v1:172.21.15.33:6804/4029047077] conn(0x7f57080713c0 msgr2=0x7f57080737e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:01.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.689+0000 7f5724360640 1 --2- 172.21.15.33:0/3472378583 >> [v2:172.21.15.33:6802/4029047077,v1:172.21.15.33:6804/4029047077] conn(0x7f57080713c0 0x7f57080737e0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:01.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.689+0000 7f5724360640 1 -- 172.21.15.33:0/3472378583 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f570806b500 msgr2=0x7f570806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:01.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.689+0000 7f5724360640 1 --2- 172.21.15.33:0/3472378583 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f570806b500 0x7f570806d9c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f570c009ef0 tx=0x7f570c00b040 comp rx=0 tx=0).stop 2024-05-08T10:56:01.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.689+0000 7f5724360640 1 -- 172.21.15.33:0/3472378583 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f571c15e530 msgr2=0x7f571c0b1fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:01.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.689+0000 7f5724360640 1 --2- 172.21.15.33:0/3472378583 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f571c15e530 0x7f571c0b1fc0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f571400d7d0 tx=0x7f571400dc90 comp rx=0 tx=0).stop 2024-05-08T10:56:01.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.689+0000 7f57228fd640 1 -- 172.21.15.33:0/3472378583 reap_dead start 2024-05-08T10:56:01.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.689+0000 7f5724360640 1 -- 172.21.15.33:0/3472378583 shutdown_connections 2024-05-08T10:56:01.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.689+0000 7f5724360640 1 -- 172.21.15.33:0/3472378583 >> 172.21.15.33:0/3472378583 conn(0x7f571c0d3b80 msgr2=0x7f571c06bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:56:01.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.689+0000 7f5724360640 1 -- 172.21.15.33:0/3472378583 shutdown_connections 2024-05-08T10:56:01.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.689+0000 7f5724360640 1 -- 172.21.15.33:0/3472378583 wait complete. 2024-05-08T10:56:01.697 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-05-08T10:56:01.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.805+0000 7f06f15a9640 1 Processor -- start 2024-05-08T10:56:01.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.805+0000 7f06f15a9640 1 -- start start 2024-05-08T10:56:01.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.806+0000 7f06f15a9640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f06ec0d1ae0 0x7f06ec0d4770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:01.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.806+0000 7f06f15a9640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f06ec0b0dd0 0x7f06ec0b1240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:01.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.806+0000 7f06f15a9640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06ec0cf330 con 0x7f06ec0d1ec0 2024-05-08T10:56:01.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.806+0000 7f06f15a9640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06ec0cf610 con 0x7f06ec0d1ae0 2024-05-08T10:56:01.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.806+0000 7f06f15a9640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06ec0cf8f0 con 0x7f06ec0b0dd0 2024-05-08T10:56:01.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.806+0000 7f06eaffd640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f06ec0d1ae0 0x7f06ec0d4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:01.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.806+0000 7f06ea7fc640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f06ec0d1ec0 0x7f06ec0d2350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:44696/0 (socket says 172.21.15.33:44696) 2024-05-08T10:56:01.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.806+0000 7f06ea7fc640 1 -- 172.21.15.33:0/1728771589 learned_addr learned my addr 172.21.15.33:0/1728771589 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-05-08T10:56:01.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.806+0000 7f06eb7fe640 1 --2- 172.21.15.33:0/1728771589 >> v2:172.21.15.174:3300/0 conn(0x7f06ec0b0dd0 0x7f06ec0b1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:01.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.806+0000 7f06eaffd640 1 -- 172.21.15.33:0/1728771589 >> v2:172.21.15.174:3300/0 conn(0x7f06ec0b0dd0 msgr2=0x7f06ec0b1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:56:01.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.806+0000 7f06eaffd640 1 --2- 172.21.15.33:0/1728771589 >> v2:172.21.15.174:3300/0 conn(0x7f06ec0b0dd0 0x7f06ec0b1240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:01.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.806+0000 7f06eaffd640 1 -- 172.21.15.33:0/1728771589 >> v1:172.21.15.33:6789/0 conn(0x7f06ec0d1ec0 legacy=0x7f06ec0d2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:01.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.806+0000 7f06e9ffb640 1 -- 172.21.15.33:0/1728771589 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3011093573 0 0) 0x7f06ec0cf330 con 0x7f06ec0d1ec0 2024-05-08T10:56:01.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.806+0000 7f06eaffd640 1 -- 172.21.15.33:0/1728771589 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06ec0cfbd0 con 0x7f06ec0d1ae0 2024-05-08T10:56:01.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.807+0000 7f06eaffd640 1 --2- 172.21.15.33:0/1728771589 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06ec0d1ae0 0x7f06ec0d4770 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f06dc0097a0 tx=0x7f06dc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82bc8a53c54b0848 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:56:01.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.807+0000 7f06e9ffb640 1 -- 172.21.15.33:0/1728771589 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06dc037070 con 0x7f06ec0d1ae0 2024-05-08T10:56:01.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.807+0000 7f06e9ffb640 1 -- 172.21.15.33:0/1728771589 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06dc032440 con 0x7f06ec0d1ae0 2024-05-08T10:56:01.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.807+0000 7f06e9ffb640 1 -- 172.21.15.33:0/1728771589 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06dc032810 con 0x7f06ec0d1ae0 2024-05-08T10:56:01.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.808+0000 7f06f15a9640 1 -- 172.21.15.33:0/1728771589 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06ec0d1ae0 msgr2=0x7f06ec0d4770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:01.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.808+0000 7f06f15a9640 1 --2- 172.21.15.33:0/1728771589 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06ec0d1ae0 0x7f06ec0d4770 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f06dc0097a0 tx=0x7f06dc02a1e0 comp rx=0 tx=0).stop 2024-05-08T10:56:01.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.808+0000 7f06f15a9640 1 -- 172.21.15.33:0/1728771589 shutdown_connections 2024-05-08T10:56:01.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.808+0000 7f06f15a9640 1 --2- 172.21.15.33:0/1728771589 >> v2:172.21.15.174:3300/0 conn(0x7f06ec0b0dd0 0x7f06ec0b1240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:01.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.808+0000 7f06f15a9640 1 --2- 172.21.15.33:0/1728771589 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06ec0d1ae0 0x7f06ec0d4770 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:01.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.808+0000 7f06f15a9640 1 -- 172.21.15.33:0/1728771589 >> 172.21.15.33:0/1728771589 conn(0x7f06ec0d3be0 msgr2=0x7f06ec0d3ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:56:01.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.808+0000 7f06f15a9640 1 -- 172.21.15.33:0/1728771589 shutdown_connections 2024-05-08T10:56:01.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.808+0000 7f06f15a9640 1 -- 172.21.15.33:0/1728771589 wait complete. 2024-05-08T10:56:01.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.809+0000 7f06f15a9640 1 Processor -- start 2024-05-08T10:56:01.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.809+0000 7f06f15a9640 1 -- start start 2024-05-08T10:56:01.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.810+0000 7f06f15a9640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f06ec0b0dd0 0x7f06ec0ccf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:01.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.810+0000 7f06f15a9640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06ec0d1ae0 0x7f06ec14a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:01.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.810+0000 7f06f15a9640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f06ec0d1ec0 0x7f06ec15c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:01.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.810+0000 7f06f15a9640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06ec0d2be0 con 0x7f06ec0d1ae0 2024-05-08T10:56:01.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.810+0000 7f06f15a9640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06ec0d2a60 con 0x7f06ec0d1ec0 2024-05-08T10:56:01.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.810+0000 7f06f15a9640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06ec0b1780 con 0x7f06ec0b0dd0 2024-05-08T10:56:01.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.810+0000 7f06ea7fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06ec0d1ae0 0x7f06ec14a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:01.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.810+0000 7f06ea7fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06ec0d1ae0 0x7f06ec14a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46340/0 (socket says 172.21.15.33:46340) 2024-05-08T10:56:01.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.810+0000 7f06ea7fc640 1 -- 172.21.15.33:0/517862666 learned_addr learned my addr 172.21.15.33:0/517862666 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:56:01.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.810+0000 7f06eaffd640 1 --2- 172.21.15.33:0/517862666 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f06ec0b0dd0 0x7f06ec0ccf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:01.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.810+0000 7f06eb7fe640 1 --2- 172.21.15.33:0/517862666 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f06ec0d1ec0 0x7f06ec15c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:01.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.810+0000 7f06ea7fc640 1 -- 172.21.15.33:0/517862666 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f06ec0b0dd0 msgr2=0x7f06ec0ccf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:01.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.810+0000 7f06ea7fc640 1 --2- 172.21.15.33:0/517862666 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f06ec0b0dd0 0x7f06ec0ccf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:01.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.810+0000 7f06ea7fc640 1 -- 172.21.15.33:0/517862666 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f06ec0d1ec0 msgr2=0x7f06ec15c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:01.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.810+0000 7f06ea7fc640 1 --2- 172.21.15.33:0/517862666 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f06ec0d1ec0 0x7f06ec15c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:01.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.810+0000 7f06ea7fc640 1 -- 172.21.15.33:0/517862666 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06ec0b4ee0 con 0x7f06ec0d1ae0 2024-05-08T10:56:01.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.810+0000 7f06eb7fe640 1 --2- 172.21.15.33:0/517862666 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f06ec0d1ec0 0x7f06ec15c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:56:01.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.811+0000 7f06ea7fc640 1 --2- 172.21.15.33:0/517862666 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06ec0d1ae0 0x7f06ec14a970 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f06e000c420 tx=0x7f06e000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:56:01.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.811+0000 7f06d37fe640 1 -- 172.21.15.33:0/517862666 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e00074e0 con 0x7f06ec0d1ae0 2024-05-08T10:56:01.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.811+0000 7f06d37fe640 1 -- 172.21.15.33:0/517862666 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06e00047e0 con 0x7f06ec0d1ae0 2024-05-08T10:56:01.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.811+0000 7f06d37fe640 1 -- 172.21.15.33:0/517862666 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e0004c10 con 0x7f06ec0d1ae0 2024-05-08T10:56:01.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.811+0000 7f06f15a9640 1 -- 172.21.15.33:0/517862666 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06ec0b51c0 con 0x7f06ec0d1ae0 2024-05-08T10:56:01.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.811+0000 7f06f15a9640 1 -- 172.21.15.33:0/517862666 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06ec0b5780 con 0x7f06ec0d1ae0 2024-05-08T10:56:01.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.812+0000 7f06f15a9640 1 -- 172.21.15.33:0/517862666 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06ec0b2940 con 0x7f06ec0d1ae0 2024-05-08T10:56:01.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.812+0000 7f06d37fe640 1 -- 172.21.15.33:0/517862666 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f06e0011070 con 0x7f06ec0d1ae0 2024-05-08T10:56:01.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.813+0000 7f06d37fe640 1 --2- 172.21.15.33:0/517862666 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f06d806b500 0x7f06d806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:01.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.813+0000 7f06d37fe640 1 -- 172.21.15.33:0/517862666 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f06e0089b40 con 0x7f06ec0d1ae0 2024-05-08T10:56:01.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.813+0000 7f06eaffd640 1 --2- 172.21.15.33:0/517862666 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f06d806b500 0x7f06d806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:01.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.814+0000 7f06eaffd640 1 --2- 172.21.15.33:0/517862666 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f06d806b500 0x7f06d806d9c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f06dc034000 tx=0x7f06dc02e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:56:01.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.817+0000 7f06d37fe640 1 -- 172.21.15.33:0/517862666 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f06ec0b2940 con 0x7f06ec0d1ae0 2024-05-08T10:56:01.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.998+0000 7f06f15a9640 1 -- 172.21.15.33:0/517862666 --> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f06ec069d20 con 0x7f06d806b500 2024-05-08T10:56:01.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:01.999+0000 7f06d37fe640 1 -- 172.21.15.33:0/517862666 <== mgr.4103 v2:172.21.15.174:6832/261355069 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f06ec069d20 con 0x7f06d806b500 2024-05-08T10:56:01.996 INFO:teuthology.orchestra.run.smithi033.stderr:instructed osd(s) 3 to deep-scrub 2024-05-08T10:56:01.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.001+0000 7f06f15a9640 1 -- 172.21.15.33:0/517862666 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f06d806b500 msgr2=0x7f06d806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:01.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.001+0000 7f06f15a9640 1 --2- 172.21.15.33:0/517862666 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f06d806b500 0x7f06d806d9c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f06dc034000 tx=0x7f06dc02e000 comp rx=0 tx=0).stop 2024-05-08T10:56:01.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.001+0000 7f06f15a9640 1 -- 172.21.15.33:0/517862666 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06ec0d1ae0 msgr2=0x7f06ec14a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:01.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.001+0000 7f06f15a9640 1 --2- 172.21.15.33:0/517862666 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06ec0d1ae0 0x7f06ec14a970 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f06e000c420 tx=0x7f06e000c8e0 comp rx=0 tx=0).stop 2024-05-08T10:56:01.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.001+0000 7f06f15a9640 1 -- 172.21.15.33:0/517862666 shutdown_connections 2024-05-08T10:56:01.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.001+0000 7f06f15a9640 1 --2- 172.21.15.33:0/517862666 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f06d806b500 0x7f06d806d9c0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:01.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.001+0000 7f06f15a9640 1 --2- 172.21.15.33:0/517862666 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f06ec0d1ec0 0x7f06ec15c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:01.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.001+0000 7f06f15a9640 1 --2- 172.21.15.33:0/517862666 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06ec0d1ae0 0x7f06ec14a970 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:01.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.001+0000 7f06f15a9640 1 --2- 172.21.15.33:0/517862666 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f06ec0b0dd0 0x7f06ec0ccf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:01.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.001+0000 7f06f15a9640 1 -- 172.21.15.33:0/517862666 >> 172.21.15.33:0/517862666 conn(0x7f06ec0d3be0 msgr2=0x7f06ec15d7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:56:01.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.001+0000 7f06f15a9640 1 -- 172.21.15.33:0/517862666 shutdown_connections 2024-05-08T10:56:01.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.001+0000 7f06f15a9640 1 -- 172.21.15.33:0/517862666 wait complete. 2024-05-08T10:56:02.009 INFO:tasks.ceph:Scrubbing osd.4 2024-05-08T10:56:02.009 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-05-08T10:56:02.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.120+0000 7f7c14258640 1 Processor -- start 2024-05-08T10:56:02.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.120+0000 7f7c14258640 1 -- start start 2024-05-08T10:56:02.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.121+0000 7f7c14258640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7c0c161660 0x7f7c0c0b2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:02.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.121+0000 7f7c14258640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f7c0c0d47e0 0x7f7c0c0b0960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:02.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.121+0000 7f7c14258640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c0c161a40 con 0x7f7c0c0b0ea0 2024-05-08T10:56:02.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.121+0000 7f7c14258640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c0c0b5510 con 0x7f7c0c0d47e0 2024-05-08T10:56:02.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.121+0000 7f7c14258640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c0c0b1a10 con 0x7f7c0c161660 2024-05-08T10:56:02.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.121+0000 7f7c127f5640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f7c0c0b0ea0 0x7f7c0c166ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:44706/0 (socket says 172.21.15.33:44706) 2024-05-08T10:56:02.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.121+0000 7f7c127f5640 1 -- 172.21.15.33:0/1750940275 learned_addr learned my addr 172.21.15.33:0/1750940275 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-05-08T10:56:02.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.122+0000 7f7c117f3640 1 --2- 172.21.15.33:0/1750940275 >> v2:172.21.15.174:3300/0 conn(0x7f7c0c0d47e0 0x7f7c0c0b0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:02.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.122+0000 7f7c11ff4640 1 --2- 172.21.15.33:0/1750940275 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7c0c161660 0x7f7c0c0b2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:02.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.122+0000 7f7c10ff2640 1 -- 172.21.15.33:0/1750940275 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1181671093 0 0) 0x7f7c0c161a40 con 0x7f7c0c0b0ea0 2024-05-08T10:56:02.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.122+0000 7f7c10ff2640 1 -- 172.21.15.33:0/1750940275 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7bf8003520 con 0x7f7c0c0b0ea0 2024-05-08T10:56:02.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.122+0000 7f7c10ff2640 1 -- 172.21.15.33:0/1750940275 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3270610403 0 0) 0x7f7bf8003520 con 0x7f7c0c0b0ea0 2024-05-08T10:56:02.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.122+0000 7f7c10ff2640 1 -- 172.21.15.33:0/1750940275 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7c0c161660 msgr2=0x7f7c0c0b2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:56:02.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.122+0000 7f7c10ff2640 1 --2- 172.21.15.33:0/1750940275 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7c0c161660 0x7f7c0c0b2aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:02.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.122+0000 7f7c10ff2640 1 -- 172.21.15.33:0/1750940275 >> v2:172.21.15.174:3300/0 conn(0x7f7c0c0d47e0 msgr2=0x7f7c0c0b0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:56:02.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.122+0000 7f7c10ff2640 1 --2- 172.21.15.33:0/1750940275 >> v2:172.21.15.174:3300/0 conn(0x7f7c0c0d47e0 0x7f7c0c0b0960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:02.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.122+0000 7f7c10ff2640 1 -- 172.21.15.33:0/1750940275 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c0c0b1cf0 con 0x7f7c0c0b0ea0 2024-05-08T10:56:02.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.122+0000 7f7c10ff2640 1 -- 172.21.15.33:0/1750940275 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2948294915 0 0) 0x7f7c040019f0 con 0x7f7c0c0b0ea0 2024-05-08T10:56:02.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.122+0000 7f7c10ff2640 1 -- 172.21.15.33:0/1750940275 >> v1:172.21.15.33:6789/0 conn(0x7f7c0c0b0ea0 legacy=0x7f7c0c166ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:02.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.122+0000 7f7c10ff2640 1 --2- 172.21.15.33:0/1750940275 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7bf80039b0 0x7f7bf8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:02.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.122+0000 7f7c10ff2640 1 --2- 172.21.15.33:0/1750940275 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7c0c161660 0x7f7bf8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:02.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.122+0000 7f7c10ff2640 1 --2- 172.21.15.33:0/1750940275 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7bf8004d40 0x7f7bf80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:02.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.122+0000 7f7c10ff2640 1 -- 172.21.15.33:0/1750940275 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c0c0b5510 con 0x7f7bf8004d40 2024-05-08T10:56:02.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.122+0000 7f7c10ff2640 1 -- 172.21.15.33:0/1750940275 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c0c0b1a10 con 0x7f7bf80039b0 2024-05-08T10:56:02.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.122+0000 7f7c10ff2640 1 -- 172.21.15.33:0/1750940275 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf800b9c0 con 0x7f7c0c161660 2024-05-08T10:56:02.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.122+0000 7f7c127f5640 1 --2- 172.21.15.33:0/1750940275 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7bf8004d40 0x7f7bf80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:02.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.122+0000 7f7c11ff4640 1 --2- 172.21.15.33:0/1750940275 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7bf80039b0 0x7f7bf8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:02.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.122+0000 7f7c117f3640 1 --2- 172.21.15.33:0/1750940275 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7c0c161660 0x7f7bf8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:02.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.123+0000 7f7c127f5640 1 -- 172.21.15.33:0/1750940275 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7c0c161660 msgr2=0x7f7bf8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:56:02.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.123+0000 7f7c127f5640 1 --2- 172.21.15.33:0/1750940275 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7c0c161660 0x7f7bf8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:02.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.123+0000 7f7c127f5640 1 -- 172.21.15.33:0/1750940275 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7bf80039b0 msgr2=0x7f7bf8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:56:02.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.123+0000 7f7c127f5640 1 --2- 172.21.15.33:0/1750940275 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7bf80039b0 0x7f7bf8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:02.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.123+0000 7f7c127f5640 1 -- 172.21.15.33:0/1750940275 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bf8003520 con 0x7f7bf8004d40 2024-05-08T10:56:02.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.123+0000 7f7c127f5640 1 --2- 172.21.15.33:0/1750940275 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7bf8004d40 0x7f7bf80051c0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f7c0400a8b0 tx=0x7f7bf8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e67638999d26a767 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:56:02.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.123+0000 7f7c10ff2640 1 -- 172.21.15.33:0/1750940275 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c0400a4d0 con 0x7f7bf8004d40 2024-05-08T10:56:02.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.124+0000 7f7c10ff2640 1 -- 172.21.15.33:0/1750940275 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c0402f070 con 0x7f7bf8004d40 2024-05-08T10:56:02.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.124+0000 7f7c10ff2640 1 -- 172.21.15.33:0/1750940275 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c0402bd10 con 0x7f7bf8004d40 2024-05-08T10:56:02.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.124+0000 7f7c14258640 1 -- 172.21.15.33:0/1750940275 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7bf8004d40 msgr2=0x7f7bf80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:02.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.124+0000 7f7c14258640 1 --2- 172.21.15.33:0/1750940275 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7bf8004d40 0x7f7bf80051c0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f7c0400a8b0 tx=0x7f7bf8005830 comp rx=0 tx=0).stop 2024-05-08T10:56:02.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.124+0000 7f7c127f5640 1 -- 172.21.15.33:0/1750940275 reap_dead start 2024-05-08T10:56:02.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.124+0000 7f7c14258640 1 -- 172.21.15.33:0/1750940275 shutdown_connections 2024-05-08T10:56:02.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.124+0000 7f7c14258640 1 -- 172.21.15.33:0/1750940275 >> 172.21.15.33:0/1750940275 conn(0x7f7c0c09cf20 msgr2=0x7f7c0c0d3c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:56:02.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.124+0000 7f7c14258640 1 -- 172.21.15.33:0/1750940275 shutdown_connections 2024-05-08T10:56:02.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.124+0000 7f7c14258640 1 -- 172.21.15.33:0/1750940275 wait complete. 2024-05-08T10:56:02.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.125+0000 7f7c14258640 1 Processor -- start 2024-05-08T10:56:02.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.125+0000 7f7c14258640 1 -- start start 2024-05-08T10:56:02.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.126+0000 7f7c14258640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7c0c150fa0 0x7f7c0c0b86c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:02.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.126+0000 7f7c14258640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7c0c151380 0x7f7c0c0b9180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:02.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.126+0000 7f7c14258640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7c0c15d400 0x7f7c0c0b3420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:02.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.126+0000 7f7c14258640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c0c0b27d0 con 0x7f7c0c150fa0 2024-05-08T10:56:02.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.126+0000 7f7c14258640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c0c0b22b0 con 0x7f7c0c151380 2024-05-08T10:56:02.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.126+0000 7f7c14258640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c0c0b2aa0 con 0x7f7c0c15d400 2024-05-08T10:56:02.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.126+0000 7f7c11ff4640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7c0c150fa0 0x7f7c0c0b86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:02.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.126+0000 7f7c11ff4640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7c0c150fa0 0x7f7c0c0b86c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46368/0 (socket says 172.21.15.33:46368) 2024-05-08T10:56:02.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.126+0000 7f7c11ff4640 1 -- 172.21.15.33:0/2270235042 learned_addr learned my addr 172.21.15.33:0/2270235042 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:56:02.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.126+0000 7f7c117f3640 1 --2- 172.21.15.33:0/2270235042 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7c0c151380 0x7f7c0c0b9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:02.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.127+0000 7f7c127f5640 1 --2- 172.21.15.33:0/2270235042 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7c0c15d400 0x7f7c0c0b3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:02.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.127+0000 7f7c11ff4640 1 -- 172.21.15.33:0/2270235042 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7c0c15d400 msgr2=0x7f7c0c0b3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:02.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.127+0000 7f7c11ff4640 1 --2- 172.21.15.33:0/2270235042 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7c0c15d400 0x7f7c0c0b3420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:02.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.127+0000 7f7c11ff4640 1 -- 172.21.15.33:0/2270235042 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7c0c151380 msgr2=0x7f7c0c0b9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:02.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.127+0000 7f7c11ff4640 1 --2- 172.21.15.33:0/2270235042 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7c0c151380 0x7f7c0c0b9180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:02.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.127+0000 7f7c11ff4640 1 -- 172.21.15.33:0/2270235042 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c0c0b9880 con 0x7f7c0c150fa0 2024-05-08T10:56:02.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.127+0000 7f7c11ff4640 1 --2- 172.21.15.33:0/2270235042 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7c0c150fa0 0x7f7c0c0b86c0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f7c080118e0 tx=0x7f7c08011ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:56:02.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.127+0000 7f7c027fc640 1 -- 172.21.15.33:0/2270235042 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c0800f9d0 con 0x7f7c0c150fa0 2024-05-08T10:56:02.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.127+0000 7f7c027fc640 1 -- 172.21.15.33:0/2270235042 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c0800fb70 con 0x7f7c0c150fa0 2024-05-08T10:56:02.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.127+0000 7f7c027fc640 1 -- 172.21.15.33:0/2270235042 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c08014440 con 0x7f7c0c150fa0 2024-05-08T10:56:02.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.127+0000 7f7c14258640 1 -- 172.21.15.33:0/2270235042 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c0c0b7900 con 0x7f7c0c150fa0 2024-05-08T10:56:02.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.127+0000 7f7c14258640 1 -- 172.21.15.33:0/2270235042 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c0c0b7ec0 con 0x7f7c0c150fa0 2024-05-08T10:56:02.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.128+0000 7f7c14258640 1 -- 172.21.15.33:0/2270235042 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7c0c09dcb0 con 0x7f7c0c150fa0 2024-05-08T10:56:02.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.128+0000 7f7c027fc640 1 -- 172.21.15.33:0/2270235042 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7c08012040 con 0x7f7c0c150fa0 2024-05-08T10:56:02.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.129+0000 7f7c027fc640 1 --2- 172.21.15.33:0/2270235042 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f7bf006b500 0x7f7bf006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:02.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.129+0000 7f7c027fc640 1 -- 172.21.15.33:0/2270235042 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f7c0808a3d0 con 0x7f7c0c150fa0 2024-05-08T10:56:02.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.129+0000 7f7c027fc640 1 --2- 172.21.15.33:0/2270235042 >> [v2:172.21.15.174:6800/1697399220,v1:172.21.15.174:6801/1697399220] conn(0x7f7bf00713c0 0x7f7bf00737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:02.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.129+0000 7f7c117f3640 1 --2- 172.21.15.33:0/2270235042 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f7bf006b500 0x7f7bf006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:02.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.129+0000 7f7c027fc640 1 -- 172.21.15.33:0/2270235042 --> [v2:172.21.15.174:6800/1697399220,v1:172.21.15.174:6801/1697399220] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7bf0073e90 con 0x7f7bf00713c0 2024-05-08T10:56:02.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.129+0000 7f7c027fc640 1 -- 172.21.15.33:0/2270235042 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7c08091050 con 0x7f7c0c150fa0 2024-05-08T10:56:02.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.129+0000 7f7c127f5640 1 --2- 172.21.15.33:0/2270235042 >> [v2:172.21.15.174:6800/1697399220,v1:172.21.15.174:6801/1697399220] conn(0x7f7bf00713c0 0x7f7bf00737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:02.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.130+0000 7f7c117f3640 1 --2- 172.21.15.33:0/2270235042 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f7bf006b500 0x7f7bf006d9c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c0a1cb0 tx=0x7f7bfc009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:56:02.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.130+0000 7f7c127f5640 1 --2- 172.21.15.33:0/2270235042 >> [v2:172.21.15.174:6800/1697399220,v1:172.21.15.174:6801/1697399220] conn(0x7f7bf00713c0 0x7f7bf00737e0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:56:02.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.130+0000 7f7c027fc640 1 -- 172.21.15.33:0/2270235042 <== osd.4 v2:172.21.15.174:6800/1697399220 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f7bf0073e90 con 0x7f7bf00713c0 2024-05-08T10:56:02.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.144+0000 7f7c14258640 1 -- 172.21.15.33:0/2270235042 --> [v2:172.21.15.174:6800/1697399220,v1:172.21.15.174:6801/1697399220] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f7c0c069d20 con 0x7f7bf00713c0 2024-05-08T10:56:02.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.144+0000 7f7c027fc640 1 -- 172.21.15.33:0/2270235042 <== osd.4 v2:172.21.15.174:6800/1697399220 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f7c0c069d20 con 0x7f7bf00713c0 2024-05-08T10:56:02.141 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-05-08T10:56:02.142 INFO:teuthology.orchestra.run.smithi033.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-08T10:56:02.142 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-05-08T10:56:02.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.144+0000 7f7c14258640 1 -- 172.21.15.33:0/2270235042 >> [v2:172.21.15.174:6800/1697399220,v1:172.21.15.174:6801/1697399220] conn(0x7f7bf00713c0 msgr2=0x7f7bf00737e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:02.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.144+0000 7f7c14258640 1 --2- 172.21.15.33:0/2270235042 >> [v2:172.21.15.174:6800/1697399220,v1:172.21.15.174:6801/1697399220] conn(0x7f7bf00713c0 0x7f7bf00737e0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:02.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.144+0000 7f7c14258640 1 -- 172.21.15.33:0/2270235042 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f7bf006b500 msgr2=0x7f7bf006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:02.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.144+0000 7f7c14258640 1 --2- 172.21.15.33:0/2270235042 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f7bf006b500 0x7f7bf006d9c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c0a1cb0 tx=0x7f7bfc009190 comp rx=0 tx=0).stop 2024-05-08T10:56:02.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.144+0000 7f7c14258640 1 -- 172.21.15.33:0/2270235042 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7c0c150fa0 msgr2=0x7f7c0c0b86c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:02.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.144+0000 7f7c14258640 1 --2- 172.21.15.33:0/2270235042 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7c0c150fa0 0x7f7c0c0b86c0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f7c080118e0 tx=0x7f7c08011ce0 comp rx=0 tx=0).stop 2024-05-08T10:56:02.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.144+0000 7f7c127f5640 1 -- 172.21.15.33:0/2270235042 reap_dead start 2024-05-08T10:56:02.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.145+0000 7f7c14258640 1 -- 172.21.15.33:0/2270235042 shutdown_connections 2024-05-08T10:56:02.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.145+0000 7f7c14258640 1 -- 172.21.15.33:0/2270235042 >> 172.21.15.33:0/2270235042 conn(0x7f7c0c09cf20 msgr2=0x7f7c0c06b370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:56:02.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.145+0000 7f7c14258640 1 -- 172.21.15.33:0/2270235042 shutdown_connections 2024-05-08T10:56:02.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.145+0000 7f7c14258640 1 -- 172.21.15.33:0/2270235042 wait complete. 2024-05-08T10:56:02.152 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-05-08T10:56:02.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.260+0000 7f8cbe530640 1 Processor -- start 2024-05-08T10:56:02.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.260+0000 7f8cbe530640 1 -- start start 2024-05-08T10:56:02.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.261+0000 7f8cbe530640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f8cb815e020 0x7f8cb80b4770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:02.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.261+0000 7f8cbe530640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cb80d4730 con 0x7f8cb80d0b70 2024-05-08T10:56:02.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.261+0000 7f8cbe530640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cb80d1d20 con 0x7f8cb815e400 2024-05-08T10:56:02.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.261+0000 7f8cbe530640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cb80ceac0 con 0x7f8cb815e020 2024-05-08T10:56:02.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.261+0000 7f8cb7fff640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f8cb815e020 0x7f8cb80b4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:02.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.261+0000 7f8cbcacd640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f8cb80d0b70 0x7f8cb80cefe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:44722/0 (socket says 172.21.15.33:44722) 2024-05-08T10:56:02.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.261+0000 7f8cb7fff640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f8cb815e020 0x7f8cb80b4770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46374/0 (socket says 172.21.15.33:46374) 2024-05-08T10:56:02.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.261+0000 7f8cbcacd640 1 -- 172.21.15.33:0/2803434674 learned_addr learned my addr 172.21.15.33:0/2803434674 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-05-08T10:56:02.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.261+0000 7f8cb7fff640 1 -- 172.21.15.33:0/2803434674 >> v1:172.21.15.174:6789/0 conn(0x7f8cb815e400 legacy=0x7f8cb80d0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:56:02.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.261+0000 7f8cb7fff640 1 -- 172.21.15.33:0/2803434674 >> v1:172.21.15.33:6789/0 conn(0x7f8cb80d0b70 legacy=0x7f8cb80cefe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:02.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.261+0000 7f8cb7fff640 1 -- 172.21.15.33:0/2803434674 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cb80d2000 con 0x7f8cb815e020 2024-05-08T10:56:02.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.262+0000 7f8cb7fff640 1 --2- 172.21.15.33:0/2803434674 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8cb815e020 0x7f8cb80b4770 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f8ca80097a0 tx=0x7f8ca802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28a82f0cd0b1ac1d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:56:02.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.262+0000 7f8cb6ffd640 1 -- 172.21.15.33:0/2803434674 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca8037070 con 0x7f8cb815e020 2024-05-08T10:56:02.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.262+0000 7f8cb6ffd640 1 -- 172.21.15.33:0/2803434674 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ca8032440 con 0x7f8cb815e020 2024-05-08T10:56:02.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.262+0000 7f8cb6ffd640 1 -- 172.21.15.33:0/2803434674 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca8032810 con 0x7f8cb815e020 2024-05-08T10:56:02.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.263+0000 7f8cbe530640 1 -- 172.21.15.33:0/2803434674 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8cb815e020 msgr2=0x7f8cb80b4770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:02.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.263+0000 7f8cbe530640 1 --2- 172.21.15.33:0/2803434674 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8cb815e020 0x7f8cb80b4770 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f8ca80097a0 tx=0x7f8ca802a1e0 comp rx=0 tx=0).stop 2024-05-08T10:56:02.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.263+0000 7f8cbe530640 1 -- 172.21.15.33:0/2803434674 shutdown_connections 2024-05-08T10:56:02.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.263+0000 7f8cbe530640 1 --2- 172.21.15.33:0/2803434674 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8cb815e020 0x7f8cb80b4770 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:02.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.263+0000 7f8cbe530640 1 -- 172.21.15.33:0/2803434674 >> 172.21.15.33:0/2803434674 conn(0x7f8cb80d3b70 msgr2=0x7f8cb80d3f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:56:02.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.263+0000 7f8cbe530640 1 -- 172.21.15.33:0/2803434674 shutdown_connections 2024-05-08T10:56:02.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.263+0000 7f8cbe530640 1 -- 172.21.15.33:0/2803434674 wait complete. 2024-05-08T10:56:02.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.264+0000 7f8cbe530640 1 Processor -- start 2024-05-08T10:56:02.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.264+0000 7f8cbe530640 1 -- start start 2024-05-08T10:56:02.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.265+0000 7f8cbe530640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8cb80d0b70 0x7f8cb80c76a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:02.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.265+0000 7f8cbe530640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8cb815e020 0x7f8cb814a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:02.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.265+0000 7f8cbe530640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8cb815e400 0x7f8cb80b8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:02.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.265+0000 7f8cbe530640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb80d0fa0 con 0x7f8cb815e020 2024-05-08T10:56:02.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.265+0000 7f8cbe530640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb80d49d0 con 0x7f8cb80d0b70 2024-05-08T10:56:02.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.265+0000 7f8cbe530640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb80d1120 con 0x7f8cb815e400 2024-05-08T10:56:02.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.265+0000 7f8cb77fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8cb815e020 0x7f8cb814a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:02.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.265+0000 7f8cb77fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8cb815e020 0x7f8cb814a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46382/0 (socket says 172.21.15.33:46382) 2024-05-08T10:56:02.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.265+0000 7f8cb77fe640 1 -- 172.21.15.33:0/1265484836 learned_addr learned my addr 172.21.15.33:0/1265484836 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:56:02.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.265+0000 7f8cb7fff640 1 --2- 172.21.15.33:0/1265484836 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8cb80d0b70 0x7f8cb80c76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:02.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.265+0000 7f8cbcacd640 1 --2- 172.21.15.33:0/1265484836 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8cb815e400 0x7f8cb80b8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:02.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.265+0000 7f8cb77fe640 1 -- 172.21.15.33:0/1265484836 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8cb815e400 msgr2=0x7f8cb80b8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:02.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.265+0000 7f8cb77fe640 1 --2- 172.21.15.33:0/1265484836 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8cb815e400 0x7f8cb80b8b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:02.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.265+0000 7f8cb77fe640 1 -- 172.21.15.33:0/1265484836 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8cb80d0b70 msgr2=0x7f8cb80c76a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:02.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.265+0000 7f8cb77fe640 1 --2- 172.21.15.33:0/1265484836 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8cb80d0b70 0x7f8cb80c76a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:02.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.265+0000 7f8cb77fe640 1 -- 172.21.15.33:0/1265484836 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cb80ca510 con 0x7f8cb815e020 2024-05-08T10:56:02.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.265+0000 7f8cb7fff640 1 --2- 172.21.15.33:0/1265484836 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8cb80d0b70 0x7f8cb80c76a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:56:02.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.265+0000 7f8cbcacd640 1 --2- 172.21.15.33:0/1265484836 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8cb815e400 0x7f8cb80b8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:56:02.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.266+0000 7f8cb77fe640 1 --2- 172.21.15.33:0/1265484836 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8cb815e020 0x7f8cb814a690 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f8ca000b3f0 tx=0x7f8ca000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:56:02.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.266+0000 7f8cb4ff9640 1 -- 172.21.15.33:0/1265484836 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca0015020 con 0x7f8cb815e020 2024-05-08T10:56:02.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.266+0000 7f8cb4ff9640 1 -- 172.21.15.33:0/1265484836 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ca0011830 con 0x7f8cb815e020 2024-05-08T10:56:02.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.266+0000 7f8cb4ff9640 1 -- 172.21.15.33:0/1265484836 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca0011c20 con 0x7f8cb815e020 2024-05-08T10:56:02.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.266+0000 7f8cbe530640 1 -- 172.21.15.33:0/1265484836 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cb80ca850 con 0x7f8cb815e020 2024-05-08T10:56:02.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.266+0000 7f8cbe530640 1 -- 172.21.15.33:0/1265484836 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cb80b8640 con 0x7f8cb815e020 2024-05-08T10:56:02.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.267+0000 7f8cbe530640 1 -- 172.21.15.33:0/1265484836 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cb80b1110 con 0x7f8cb815e020 2024-05-08T10:56:02.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.267+0000 7f8cb4ff9640 1 -- 172.21.15.33:0/1265484836 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8ca0018020 con 0x7f8cb815e020 2024-05-08T10:56:02.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.268+0000 7f8cb4ff9640 1 --2- 172.21.15.33:0/1265484836 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f8c9806b4d0 0x7f8c9806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:02.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.268+0000 7f8cb4ff9640 1 -- 172.21.15.33:0/1265484836 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f8ca0089cc0 con 0x7f8cb815e020 2024-05-08T10:56:02.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.268+0000 7f8cb7fff640 1 --2- 172.21.15.33:0/1265484836 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f8c9806b4d0 0x7f8c9806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:02.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.268+0000 7f8cb7fff640 1 --2- 172.21.15.33:0/1265484836 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f8c9806b4d0 0x7f8c9806d990 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f8ca8034000 tx=0x7f8ca802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:56:02.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.272+0000 7f8cb4ff9640 1 -- 172.21.15.33:0/1265484836 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8cb80b1110 con 0x7f8cb815e020 2024-05-08T10:56:02.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.451+0000 7f8cbe530640 1 -- 172.21.15.33:0/1265484836 --> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f8cb80d2260 con 0x7f8c9806b4d0 2024-05-08T10:56:02.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.452+0000 7f8cb4ff9640 1 -- 172.21.15.33:0/1265484836 <== mgr.4103 v2:172.21.15.174:6832/261355069 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f8cb80d2260 con 0x7f8c9806b4d0 2024-05-08T10:56:02.449 INFO:teuthology.orchestra.run.smithi033.stderr:instructed osd(s) 4 to deep-scrub 2024-05-08T10:56:02.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.453+0000 7f8cbe530640 1 -- 172.21.15.33:0/1265484836 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f8c9806b4d0 msgr2=0x7f8c9806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:02.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.453+0000 7f8cbe530640 1 --2- 172.21.15.33:0/1265484836 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f8c9806b4d0 0x7f8c9806d990 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f8ca8034000 tx=0x7f8ca802e000 comp rx=0 tx=0).stop 2024-05-08T10:56:02.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.454+0000 7f8cbe530640 1 -- 172.21.15.33:0/1265484836 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8cb815e020 msgr2=0x7f8cb814a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:02.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.454+0000 7f8cbe530640 1 --2- 172.21.15.33:0/1265484836 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8cb815e020 0x7f8cb814a690 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f8ca000b3f0 tx=0x7f8ca000b8b0 comp rx=0 tx=0).stop 2024-05-08T10:56:02.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.454+0000 7f8cbe530640 1 -- 172.21.15.33:0/1265484836 shutdown_connections 2024-05-08T10:56:02.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.454+0000 7f8cbe530640 1 --2- 172.21.15.33:0/1265484836 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f8c9806b4d0 0x7f8c9806d990 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:02.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.454+0000 7f8cbe530640 1 --2- 172.21.15.33:0/1265484836 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8cb815e400 0x7f8cb80b8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:02.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.454+0000 7f8cbe530640 1 --2- 172.21.15.33:0/1265484836 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8cb815e020 0x7f8cb814a690 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:02.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.454+0000 7f8cbe530640 1 --2- 172.21.15.33:0/1265484836 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8cb80d0b70 0x7f8cb80c76a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:02.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.454+0000 7f8cbe530640 1 -- 172.21.15.33:0/1265484836 >> 172.21.15.33:0/1265484836 conn(0x7f8cb80d3b70 msgr2=0x7f8cb80b0840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:56:02.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.454+0000 7f8cbe530640 1 -- 172.21.15.33:0/1265484836 shutdown_connections 2024-05-08T10:56:02.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.454+0000 7f8cbe530640 1 -- 172.21.15.33:0/1265484836 wait complete. 2024-05-08T10:56:02.462 INFO:tasks.ceph:Scrubbing osd.5 2024-05-08T10:56:02.462 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-05-08T10:56:02.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.573+0000 7fdb9bdd5640 1 Processor -- start 2024-05-08T10:56:02.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.574+0000 7fdb9bdd5640 1 -- start start 2024-05-08T10:56:02.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.574+0000 7fdb9bdd5640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fdb940d47e0 0x7fdb940b2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:02.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.574+0000 7fdb9bdd5640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fdb940b1070 0x7fdb94167cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:02.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.574+0000 7fdb9bdd5640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb94161a40 con 0x7fdb94161660 2024-05-08T10:56:02.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.575+0000 7fdb9bdd5640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb940b5510 con 0x7fdb940d47e0 2024-05-08T10:56:02.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.575+0000 7fdb9bdd5640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb940b1a10 con 0x7fdb940b1070 2024-05-08T10:56:02.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.575+0000 7fdb99370640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fdb940d47e0 0x7fdb940b2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:02.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.575+0000 7fdb99370640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fdb940d47e0 0x7fdb940b2aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46396/0 (socket says 172.21.15.33:46396) 2024-05-08T10:56:02.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.575+0000 7fdb99370640 1 -- 172.21.15.33:0/288708981 learned_addr learned my addr 172.21.15.33:0/288708981 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:56:02.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.575+0000 7fdb9a372640 1 --2- 172.21.15.33:0/288708981 >> v2:172.21.15.174:3300/0 conn(0x7fdb940b1070 0x7fdb94167cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:02.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.575+0000 7fdb99370640 1 -- 172.21.15.33:0/288708981 >> v2:172.21.15.174:3300/0 conn(0x7fdb940b1070 msgr2=0x7fdb94167cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:56:02.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.575+0000 7fdb99370640 1 --2- 172.21.15.33:0/288708981 >> v2:172.21.15.174:3300/0 conn(0x7fdb940b1070 0x7fdb94167cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:02.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.575+0000 7fdb99370640 1 -- 172.21.15.33:0/288708981 >> v1:172.21.15.174:6789/0 conn(0x7fdb94161660 legacy=0x7fdb940b0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:56:02.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.575+0000 7fdb99370640 1 -- 172.21.15.33:0/288708981 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb940b1cf0 con 0x7fdb940d47e0 2024-05-08T10:56:02.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.576+0000 7fdb99370640 1 --2- 172.21.15.33:0/288708981 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb940d47e0 0x7fdb940b2aa0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fdb84009870 tx=0x7fdb8402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=727a033e86efa93c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:56:02.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.576+0000 7fdb98b6f640 1 -- 172.21.15.33:0/288708981 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb84037070 con 0x7fdb940d47e0 2024-05-08T10:56:02.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.576+0000 7fdb98b6f640 1 -- 172.21.15.33:0/288708981 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb84032440 con 0x7fdb940d47e0 2024-05-08T10:56:02.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.576+0000 7fdb98b6f640 1 -- 172.21.15.33:0/288708981 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb84032810 con 0x7fdb940d47e0 2024-05-08T10:56:02.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.576+0000 7fdb9bdd5640 1 -- 172.21.15.33:0/288708981 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb940d47e0 msgr2=0x7fdb940b2aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:02.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.576+0000 7fdb9bdd5640 1 --2- 172.21.15.33:0/288708981 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb940d47e0 0x7fdb940b2aa0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fdb84009870 tx=0x7fdb8402a1c0 comp rx=0 tx=0).stop 2024-05-08T10:56:02.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.576+0000 7fdb9bdd5640 1 -- 172.21.15.33:0/288708981 shutdown_connections 2024-05-08T10:56:02.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.576+0000 7fdb9bdd5640 1 --2- 172.21.15.33:0/288708981 >> v2:172.21.15.174:3300/0 conn(0x7fdb940b1070 0x7fdb94167cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:02.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.576+0000 7fdb9bdd5640 1 --2- 172.21.15.33:0/288708981 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb940d47e0 0x7fdb940b2aa0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:02.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.576+0000 7fdb9bdd5640 1 -- 172.21.15.33:0/288708981 >> 172.21.15.33:0/288708981 conn(0x7fdb9409cf20 msgr2=0x7fdb940d3c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:56:02.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.577+0000 7fdb9bdd5640 1 -- 172.21.15.33:0/288708981 shutdown_connections 2024-05-08T10:56:02.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.577+0000 7fdb9bdd5640 1 -- 172.21.15.33:0/288708981 wait complete. 2024-05-08T10:56:02.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.578+0000 7fdb9bdd5640 1 Processor -- start 2024-05-08T10:56:02.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.578+0000 7fdb9bdd5640 1 -- start start 2024-05-08T10:56:02.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.578+0000 7fdb9bdd5640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdb940b1070 0x7fdb941f3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:02.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.578+0000 7fdb9bdd5640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb940d47e0 0x7fdb941f4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:02.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.578+0000 7fdb9bdd5640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdb94161660 0x7fdb940cc300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:02.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.579+0000 7fdb9bdd5640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb940b27d0 con 0x7fdb940d47e0 2024-05-08T10:56:02.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.579+0000 7fdb9bdd5640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb940b22b0 con 0x7fdb940b1070 2024-05-08T10:56:02.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.579+0000 7fdb9bdd5640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb940b14c0 con 0x7fdb94161660 2024-05-08T10:56:02.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.579+0000 7fdb99370640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb940d47e0 0x7fdb941f4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:02.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.579+0000 7fdb99370640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb940d47e0 0x7fdb941f4440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46400/0 (socket says 172.21.15.33:46400) 2024-05-08T10:56:02.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.579+0000 7fdb99370640 1 -- 172.21.15.33:0/113927243 learned_addr learned my addr 172.21.15.33:0/113927243 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:56:02.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.579+0000 7fdb99b71640 1 --2- 172.21.15.33:0/113927243 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdb940b1070 0x7fdb941f3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:02.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.579+0000 7fdb9a372640 1 --2- 172.21.15.33:0/113927243 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdb94161660 0x7fdb940cc300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:02.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.579+0000 7fdb99370640 1 -- 172.21.15.33:0/113927243 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdb94161660 msgr2=0x7fdb940cc300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:02.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.579+0000 7fdb99370640 1 --2- 172.21.15.33:0/113927243 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdb94161660 0x7fdb940cc300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:02.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.579+0000 7fdb99370640 1 -- 172.21.15.33:0/113927243 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdb940b1070 msgr2=0x7fdb941f3360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:02.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.579+0000 7fdb99370640 1 --2- 172.21.15.33:0/113927243 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdb940b1070 0x7fdb941f3360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:02.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.579+0000 7fdb99370640 1 -- 172.21.15.33:0/113927243 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb940b87e0 con 0x7fdb940d47e0 2024-05-08T10:56:02.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.579+0000 7fdb9a372640 1 --2- 172.21.15.33:0/113927243 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdb94161660 0x7fdb940cc300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:56:02.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.579+0000 7fdb99370640 1 --2- 172.21.15.33:0/113927243 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb940d47e0 0x7fdb941f4440 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fdb84009870 tx=0x7fdb840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:56:02.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.579+0000 7fdb8a7fc640 1 -- 172.21.15.33:0/113927243 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb84037040 con 0x7fdb940d47e0 2024-05-08T10:56:02.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.579+0000 7fdb8a7fc640 1 -- 172.21.15.33:0/113927243 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb84004230 con 0x7fdb940d47e0 2024-05-08T10:56:02.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.579+0000 7fdb8a7fc640 1 -- 172.21.15.33:0/113927243 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb84030620 con 0x7fdb940d47e0 2024-05-08T10:56:02.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.579+0000 7fdb9bdd5640 1 -- 172.21.15.33:0/113927243 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb941f4980 con 0x7fdb940d47e0 2024-05-08T10:56:02.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.579+0000 7fdb9bdd5640 1 -- 172.21.15.33:0/113927243 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb940cb4a0 con 0x7fdb940d47e0 2024-05-08T10:56:02.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.580+0000 7fdb9bdd5640 1 -- 172.21.15.33:0/113927243 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdb940cbe40 con 0x7fdb940d47e0 2024-05-08T10:56:02.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.581+0000 7fdb8a7fc640 1 -- 172.21.15.33:0/113927243 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fdb840307c0 con 0x7fdb940d47e0 2024-05-08T10:56:02.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.581+0000 7fdb8a7fc640 1 --2- 172.21.15.33:0/113927243 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fdb7806b500 0x7fdb7806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:02.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.581+0000 7fdb8a7fc640 1 -- 172.21.15.33:0/113927243 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fdb840aac70 con 0x7fdb940d47e0 2024-05-08T10:56:02.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.581+0000 7fdb8a7fc640 1 --2- 172.21.15.33:0/113927243 >> [v2:172.21.15.174:6824/1511860729,v1:172.21.15.174:6825/1511860729] conn(0x7fdb780713c0 0x7fdb780737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:02.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.581+0000 7fdb8a7fc640 1 -- 172.21.15.33:0/113927243 --> [v2:172.21.15.174:6824/1511860729,v1:172.21.15.174:6825/1511860729] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdb78073e90 con 0x7fdb780713c0 2024-05-08T10:56:02.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.581+0000 7fdb8a7fc640 1 -- 172.21.15.33:0/113927243 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdb840ad370 con 0x7fdb940d47e0 2024-05-08T10:56:02.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.582+0000 7fdb99b71640 1 --2- 172.21.15.33:0/113927243 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fdb7806b500 0x7fdb7806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:02.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.582+0000 7fdb9a372640 1 --2- 172.21.15.33:0/113927243 >> [v2:172.21.15.174:6824/1511860729,v1:172.21.15.174:6825/1511860729] conn(0x7fdb780713c0 0x7fdb780737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:02.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.582+0000 7fdb99b71640 1 --2- 172.21.15.33:0/113927243 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fdb7806b500 0x7fdb7806d9c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fdb90006fd0 tx=0x7fdb90009060 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:56:02.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.582+0000 7fdb9a372640 1 --2- 172.21.15.33:0/113927243 >> [v2:172.21.15.174:6824/1511860729,v1:172.21.15.174:6825/1511860729] conn(0x7fdb780713c0 0x7fdb780737e0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:56:02.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.583+0000 7fdb8a7fc640 1 -- 172.21.15.33:0/113927243 <== osd.5 v2:172.21.15.174:6824/1511860729 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fdb78073e90 con 0x7fdb780713c0 2024-05-08T10:56:02.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.596+0000 7fdb9bdd5640 1 -- 172.21.15.33:0/113927243 --> [v2:172.21.15.174:6824/1511860729,v1:172.21.15.174:6825/1511860729] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fdb940caf50 con 0x7fdb780713c0 2024-05-08T10:56:02.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.597+0000 7fdb8a7fc640 1 -- 172.21.15.33:0/113927243 <== osd.5 v2:172.21.15.174:6824/1511860729 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fdb940caf50 con 0x7fdb780713c0 2024-05-08T10:56:02.594 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-05-08T10:56:02.594 INFO:teuthology.orchestra.run.smithi033.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-08T10:56:02.594 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-05-08T10:56:02.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.597+0000 7fdb9bdd5640 1 -- 172.21.15.33:0/113927243 >> [v2:172.21.15.174:6824/1511860729,v1:172.21.15.174:6825/1511860729] conn(0x7fdb780713c0 msgr2=0x7fdb780737e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:02.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.597+0000 7fdb9bdd5640 1 --2- 172.21.15.33:0/113927243 >> [v2:172.21.15.174:6824/1511860729,v1:172.21.15.174:6825/1511860729] conn(0x7fdb780713c0 0x7fdb780737e0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:02.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.597+0000 7fdb9bdd5640 1 -- 172.21.15.33:0/113927243 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fdb7806b500 msgr2=0x7fdb7806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:02.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.597+0000 7fdb9bdd5640 1 --2- 172.21.15.33:0/113927243 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fdb7806b500 0x7fdb7806d9c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fdb90006fd0 tx=0x7fdb90009060 comp rx=0 tx=0).stop 2024-05-08T10:56:02.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.597+0000 7fdb9bdd5640 1 -- 172.21.15.33:0/113927243 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb940d47e0 msgr2=0x7fdb941f4440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:02.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.597+0000 7fdb9bdd5640 1 --2- 172.21.15.33:0/113927243 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb940d47e0 0x7fdb941f4440 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fdb84009870 tx=0x7fdb840046c0 comp rx=0 tx=0).stop 2024-05-08T10:56:02.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.597+0000 7fdb9a372640 1 -- 172.21.15.33:0/113927243 reap_dead start 2024-05-08T10:56:02.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.597+0000 7fdb9bdd5640 1 -- 172.21.15.33:0/113927243 shutdown_connections 2024-05-08T10:56:02.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.597+0000 7fdb9bdd5640 1 -- 172.21.15.33:0/113927243 >> 172.21.15.33:0/113927243 conn(0x7fdb9409cf20 msgr2=0x7fdb940d1a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:56:02.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.597+0000 7fdb9bdd5640 1 -- 172.21.15.33:0/113927243 shutdown_connections 2024-05-08T10:56:02.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.597+0000 7fdb9bdd5640 1 -- 172.21.15.33:0/113927243 wait complete. 2024-05-08T10:56:02.605 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-05-08T10:56:02.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.712+0000 7f6a570d6640 1 Processor -- start 2024-05-08T10:56:02.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.712+0000 7f6a570d6640 1 -- start start 2024-05-08T10:56:02.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.713+0000 7f6a570d6640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6a50145790 0x7f6a500cc330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:02.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.713+0000 7f6a570d6640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f6a5006df00 0x7f6a500cfdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:02.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.713+0000 7f6a570d6640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a5006c7a0 con 0x7f6a500cc870 2024-05-08T10:56:02.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.713+0000 7f6a570d6640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a5006ca10 con 0x7f6a5006df00 2024-05-08T10:56:02.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.713+0000 7f6a570d6640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a5006ccf0 con 0x7f6a50145790 2024-05-08T10:56:02.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.713+0000 7f6a4ffff640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f6a5006df00 0x7f6a500cfdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:02.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.713+0000 7f6a4ffff640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f6a5006df00 0x7f6a500cfdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46404/0 (socket says 172.21.15.33:46404) 2024-05-08T10:56:02.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.713+0000 7f6a4ffff640 1 -- 172.21.15.33:0/1155390117 learned_addr learned my addr 172.21.15.33:0/1155390117 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:56:02.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.714+0000 7f6a54e72640 1 --2- 172.21.15.33:0/1155390117 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6a50145790 0x7f6a500cc330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:02.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.714+0000 7f6a4ffff640 1 -- 172.21.15.33:0/1155390117 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6a50145790 msgr2=0x7f6a500cc330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:56:02.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.714+0000 7f6a4ffff640 1 --2- 172.21.15.33:0/1155390117 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6a50145790 0x7f6a500cc330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:02.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.714+0000 7f6a4ffff640 1 -- 172.21.15.33:0/1155390117 >> v1:172.21.15.174:6789/0 conn(0x7f6a500cc870 legacy=0x7f6a5015f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:02.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.714+0000 7f6a4ffff640 1 -- 172.21.15.33:0/1155390117 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a5006cfd0 con 0x7f6a5006df00 2024-05-08T10:56:02.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.714+0000 7f6a4ffff640 1 --2- 172.21.15.33:0/1155390117 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6a5006df00 0x7f6a500cfdc0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f6a38009870 tx=0x7f6a3802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4137bf6c614a46d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:56:02.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.715+0000 7f6a4f7fe640 1 -- 172.21.15.33:0/1155390117 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a38037070 con 0x7f6a5006df00 2024-05-08T10:56:02.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.715+0000 7f6a4f7fe640 1 -- 172.21.15.33:0/1155390117 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a38032440 con 0x7f6a5006df00 2024-05-08T10:56:02.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.715+0000 7f6a4f7fe640 1 -- 172.21.15.33:0/1155390117 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a38032810 con 0x7f6a5006df00 2024-05-08T10:56:02.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.715+0000 7f6a570d6640 1 -- 172.21.15.33:0/1155390117 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6a5006df00 msgr2=0x7f6a500cfdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:02.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.715+0000 7f6a570d6640 1 --2- 172.21.15.33:0/1155390117 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6a5006df00 0x7f6a500cfdc0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f6a38009870 tx=0x7f6a3802a1c0 comp rx=0 tx=0).stop 2024-05-08T10:56:02.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.715+0000 7f6a570d6640 1 -- 172.21.15.33:0/1155390117 shutdown_connections 2024-05-08T10:56:02.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.715+0000 7f6a570d6640 1 --2- 172.21.15.33:0/1155390117 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6a5006df00 0x7f6a500cfdc0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:02.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.715+0000 7f6a570d6640 1 --2- 172.21.15.33:0/1155390117 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6a50145790 0x7f6a500cc330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:02.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.715+0000 7f6a570d6640 1 -- 172.21.15.33:0/1155390117 >> 172.21.15.33:0/1155390117 conn(0x7f6a5006afc0 msgr2=0x7f6a5006b3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:56:02.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.715+0000 7f6a570d6640 1 -- 172.21.15.33:0/1155390117 shutdown_connections 2024-05-08T10:56:02.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.715+0000 7f6a570d6640 1 -- 172.21.15.33:0/1155390117 wait complete. 2024-05-08T10:56:02.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.716+0000 7f6a570d6640 1 Processor -- start 2024-05-08T10:56:02.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.716+0000 7f6a570d6640 1 -- start start 2024-05-08T10:56:02.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.717+0000 7f6a570d6640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6a500cc870 0x7f6a501f1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:02.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.717+0000 7f6a570d6640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6a50145790 0x7f6a50152e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:02.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.717+0000 7f6a570d6640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6a50153e00 0x7f6a501542b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:02.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.717+0000 7f6a570d6640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a500cf1b0 con 0x7f6a50153e00 2024-05-08T10:56:02.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.717+0000 7f6a570d6640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a500cf030 con 0x7f6a500cc870 2024-05-08T10:56:02.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.717+0000 7f6a570d6640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a500cf330 con 0x7f6a50145790 2024-05-08T10:56:02.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.717+0000 7f6a55673640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6a50153e00 0x7f6a501542b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:02.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.717+0000 7f6a55673640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6a50153e00 0x7f6a501542b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46416/0 (socket says 172.21.15.33:46416) 2024-05-08T10:56:02.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.717+0000 7f6a55673640 1 -- 172.21.15.33:0/1752978533 learned_addr learned my addr 172.21.15.33:0/1752978533 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:56:02.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.718+0000 7f6a54e72640 1 --2- 172.21.15.33:0/1752978533 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6a500cc870 0x7f6a501f1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:02.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.718+0000 7f6a4ffff640 1 --2- 172.21.15.33:0/1752978533 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6a50145790 0x7f6a50152e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:02.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.718+0000 7f6a55673640 1 -- 172.21.15.33:0/1752978533 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6a50145790 msgr2=0x7f6a50152e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:02.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.718+0000 7f6a55673640 1 --2- 172.21.15.33:0/1752978533 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6a50145790 0x7f6a50152e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:02.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.718+0000 7f6a55673640 1 -- 172.21.15.33:0/1752978533 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6a500cc870 msgr2=0x7f6a501f1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:02.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.718+0000 7f6a55673640 1 --2- 172.21.15.33:0/1752978533 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6a500cc870 0x7f6a501f1bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:02.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.718+0000 7f6a55673640 1 -- 172.21.15.33:0/1752978533 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a501548c0 con 0x7f6a50153e00 2024-05-08T10:56:02.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.718+0000 7f6a4ffff640 1 --2- 172.21.15.33:0/1752978533 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6a50145790 0x7f6a50152e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:56:02.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.718+0000 7f6a55673640 1 --2- 172.21.15.33:0/1752978533 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6a50153e00 0x7f6a501542b0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f6a48001eb0 tx=0x7f6a4800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:56:02.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.718+0000 7f6a4d7fa640 1 -- 172.21.15.33:0/1752978533 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a48017070 con 0x7f6a50153e00 2024-05-08T10:56:02.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.718+0000 7f6a4d7fa640 1 -- 172.21.15.33:0/1752978533 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a480052d0 con 0x7f6a50153e00 2024-05-08T10:56:02.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.718+0000 7f6a4d7fa640 1 -- 172.21.15.33:0/1752978533 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a48003810 con 0x7f6a50153e00 2024-05-08T10:56:02.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.718+0000 7f6a570d6640 1 -- 172.21.15.33:0/1752978533 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a50154ba0 con 0x7f6a50153e00 2024-05-08T10:56:02.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.718+0000 7f6a570d6640 1 -- 172.21.15.33:0/1752978533 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a50155160 con 0x7f6a50153e00 2024-05-08T10:56:02.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.719+0000 7f6a570d6640 1 -- 172.21.15.33:0/1752978533 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a50069d20 con 0x7f6a50153e00 2024-05-08T10:56:02.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.720+0000 7f6a4d7fa640 1 -- 172.21.15.33:0/1752978533 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6a4801a070 con 0x7f6a50153e00 2024-05-08T10:56:02.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.720+0000 7f6a4d7fa640 1 --2- 172.21.15.33:0/1752978533 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f6a3006b500 0x7f6a3006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:02.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.720+0000 7f6a4d7fa640 1 -- 172.21.15.33:0/1752978533 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f6a48089260 con 0x7f6a50153e00 2024-05-08T10:56:02.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.720+0000 7f6a54e72640 1 --2- 172.21.15.33:0/1752978533 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f6a3006b500 0x7f6a3006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:02.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.721+0000 7f6a54e72640 1 --2- 172.21.15.33:0/1752978533 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f6a3006b500 0x7f6a3006d9c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f6a400099c0 tx=0x7f6a40003990 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:56:02.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.724+0000 7f6a4d7fa640 1 -- 172.21.15.33:0/1752978533 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6a480583e0 con 0x7f6a50153e00 2024-05-08T10:56:02.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.903+0000 7f6a570d6640 1 -- 172.21.15.33:0/1752978533 --> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f6a50142870 con 0x7f6a3006b500 2024-05-08T10:56:02.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.905+0000 7f6a4d7fa640 1 -- 172.21.15.33:0/1752978533 <== mgr.4103 v2:172.21.15.174:6832/261355069 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f6a50142870 con 0x7f6a3006b500 2024-05-08T10:56:02.901 INFO:teuthology.orchestra.run.smithi033.stderr:instructed osd(s) 5 to deep-scrub 2024-05-08T10:56:02.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.906+0000 7f6a570d6640 1 -- 172.21.15.33:0/1752978533 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f6a3006b500 msgr2=0x7f6a3006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:02.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.906+0000 7f6a570d6640 1 --2- 172.21.15.33:0/1752978533 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f6a3006b500 0x7f6a3006d9c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f6a400099c0 tx=0x7f6a40003990 comp rx=0 tx=0).stop 2024-05-08T10:56:02.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.906+0000 7f6a570d6640 1 -- 172.21.15.33:0/1752978533 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6a50153e00 msgr2=0x7f6a501542b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:02.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.906+0000 7f6a570d6640 1 --2- 172.21.15.33:0/1752978533 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6a50153e00 0x7f6a501542b0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f6a48001eb0 tx=0x7f6a4800c890 comp rx=0 tx=0).stop 2024-05-08T10:56:02.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.906+0000 7f6a570d6640 1 -- 172.21.15.33:0/1752978533 shutdown_connections 2024-05-08T10:56:02.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.906+0000 7f6a570d6640 1 --2- 172.21.15.33:0/1752978533 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f6a3006b500 0x7f6a3006d9c0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:02.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.906+0000 7f6a570d6640 1 --2- 172.21.15.33:0/1752978533 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6a50153e00 0x7f6a501542b0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:02.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.906+0000 7f6a570d6640 1 --2- 172.21.15.33:0/1752978533 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6a50145790 0x7f6a50152e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:02.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.906+0000 7f6a570d6640 1 --2- 172.21.15.33:0/1752978533 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6a500cc870 0x7f6a501f1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:02.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.906+0000 7f6a570d6640 1 -- 172.21.15.33:0/1752978533 >> 172.21.15.33:0/1752978533 conn(0x7f6a5006afc0 msgr2=0x7f6a500cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:56:02.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.906+0000 7f6a570d6640 1 -- 172.21.15.33:0/1752978533 shutdown_connections 2024-05-08T10:56:02.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:02.906+0000 7f6a570d6640 1 -- 172.21.15.33:0/1752978533 wait complete. 2024-05-08T10:56:02.914 INFO:tasks.ceph:Scrubbing osd.6 2024-05-08T10:56:02.914 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-05-08T10:56:03.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.026+0000 7f4fdcf42640 1 Processor -- start 2024-05-08T10:56:03.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.026+0000 7f4fdcf42640 1 -- start start 2024-05-08T10:56:03.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.026+0000 7f4fdcf42640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f4fd815e040 0x7f4fd815ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:03.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.027+0000 7f4fdcf42640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f4fd815f3c0 0x7f4fd81619a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:03.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.027+0000 7f4fdcf42640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fd80ced40 con 0x7f4fd8161ee0 2024-05-08T10:56:03.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.027+0000 7f4fdcf42640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fd8162890 con 0x7f4fd815e040 2024-05-08T10:56:03.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.027+0000 7f4fdcf42640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fd8162310 con 0x7f4fd815f3c0 2024-05-08T10:56:03.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.027+0000 7f4fd659c640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f4fd815e040 0x7f4fd815ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:03.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.027+0000 7f4fd6d9d640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f4fd8161ee0 0x7f4fd80d0500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:44736/0 (socket says 172.21.15.33:44736) 2024-05-08T10:56:03.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.027+0000 7f4fd6d9d640 1 -- 172.21.15.33:0/1095362055 learned_addr learned my addr 172.21.15.33:0/1095362055 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-05-08T10:56:03.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.027+0000 7f4fcffff640 1 --2- 172.21.15.33:0/1095362055 >> v2:172.21.15.174:3300/0 conn(0x7f4fd815f3c0 0x7f4fd81619a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:03.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.027+0000 7f4fd659c640 1 -- 172.21.15.33:0/1095362055 >> v2:172.21.15.174:3300/0 conn(0x7f4fd815f3c0 msgr2=0x7f4fd81619a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:56:03.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.027+0000 7f4fd659c640 1 --2- 172.21.15.33:0/1095362055 >> v2:172.21.15.174:3300/0 conn(0x7f4fd815f3c0 0x7f4fd81619a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:03.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.027+0000 7f4fd659c640 1 -- 172.21.15.33:0/1095362055 >> v1:172.21.15.33:6789/0 conn(0x7f4fd8161ee0 legacy=0x7f4fd80d0500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:03.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.027+0000 7f4fd5d9b640 1 -- 172.21.15.33:0/1095362055 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 136544133 0 0) 0x7f4fd80ced40 con 0x7f4fd8161ee0 2024-05-08T10:56:03.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.027+0000 7f4fd659c640 1 -- 172.21.15.33:0/1095362055 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fd80cf020 con 0x7f4fd815e040 2024-05-08T10:56:03.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.028+0000 7f4fd659c640 1 --2- 172.21.15.33:0/1095362055 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4fd815e040 0x7f4fd815ee80 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f4fd808e010 tx=0x7f4fc802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1030e789b49e9c81 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:56:03.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.028+0000 7f4fd5d9b640 1 -- 172.21.15.33:0/1095362055 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc8037070 con 0x7f4fd815e040 2024-05-08T10:56:03.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.028+0000 7f4fd5d9b640 1 -- 172.21.15.33:0/1095362055 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fc8032440 con 0x7f4fd815e040 2024-05-08T10:56:03.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.028+0000 7f4fd5d9b640 1 -- 172.21.15.33:0/1095362055 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc8032810 con 0x7f4fd815e040 2024-05-08T10:56:03.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.028+0000 7f4fdcf42640 1 -- 172.21.15.33:0/1095362055 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4fd815e040 msgr2=0x7f4fd815ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:03.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.028+0000 7f4fdcf42640 1 --2- 172.21.15.33:0/1095362055 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4fd815e040 0x7f4fd815ee80 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f4fd808e010 tx=0x7f4fc802a1a0 comp rx=0 tx=0).stop 2024-05-08T10:56:03.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.029+0000 7f4fdcf42640 1 -- 172.21.15.33:0/1095362055 shutdown_connections 2024-05-08T10:56:03.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.029+0000 7f4fdcf42640 1 --2- 172.21.15.33:0/1095362055 >> v2:172.21.15.174:3300/0 conn(0x7f4fd815f3c0 0x7f4fd81619a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:03.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.029+0000 7f4fdcf42640 1 --2- 172.21.15.33:0/1095362055 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4fd815e040 0x7f4fd815ee80 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:03.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.029+0000 7f4fdcf42640 1 -- 172.21.15.33:0/1095362055 >> 172.21.15.33:0/1095362055 conn(0x7f4fd809cec0 msgr2=0x7f4fd80d3c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:56:03.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.029+0000 7f4fdcf42640 1 -- 172.21.15.33:0/1095362055 shutdown_connections 2024-05-08T10:56:03.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.029+0000 7f4fdcf42640 1 -- 172.21.15.33:0/1095362055 wait complete. 2024-05-08T10:56:03.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.030+0000 7f4fdcf42640 1 Processor -- start 2024-05-08T10:56:03.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.030+0000 7f4fdcf42640 1 -- start start 2024-05-08T10:56:03.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.031+0000 7f4fdcf42640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4fd815f3c0 0x7f4fd80b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:03.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.031+0000 7f4fdcf42640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4fd8161ee0 0x7f4fd80ca310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:03.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.031+0000 7f4fdcf42640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4fd80b8a00 0x7f4fd81e90a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:03.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.031+0000 7f4fdcf42640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd80cf8c0 con 0x7f4fd815f3c0 2024-05-08T10:56:03.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.031+0000 7f4fdcf42640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd80cf5e0 con 0x7f4fd80b8a00 2024-05-08T10:56:03.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.031+0000 7f4fdcf42640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd80ce8f0 con 0x7f4fd8161ee0 2024-05-08T10:56:03.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.031+0000 7f4fd659c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4fd815f3c0 0x7f4fd80b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:03.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.031+0000 7f4fd659c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4fd815f3c0 0x7f4fd80b71e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46434/0 (socket says 172.21.15.33:46434) 2024-05-08T10:56:03.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.031+0000 7f4fd659c640 1 -- 172.21.15.33:0/3576890692 learned_addr learned my addr 172.21.15.33:0/3576890692 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:56:03.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.031+0000 7f4fd659c640 1 -- 172.21.15.33:0/3576890692 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4fd8161ee0 msgr2=0x7f4fd80ca310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:03.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.031+0000 7f4fd659c640 1 --2- 172.21.15.33:0/3576890692 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4fd8161ee0 0x7f4fd80ca310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:03.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.031+0000 7f4fd6d9d640 1 --2- 172.21.15.33:0/3576890692 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4fd80b8a00 0x7f4fd81e90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:03.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.031+0000 7f4fd659c640 1 -- 172.21.15.33:0/3576890692 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4fd80b8a00 msgr2=0x7f4fd81e90a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:03.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.031+0000 7f4fd659c640 1 --2- 172.21.15.33:0/3576890692 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4fd80b8a00 0x7f4fd81e90a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:03.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.031+0000 7f4fd659c640 1 -- 172.21.15.33:0/3576890692 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fd80b7810 con 0x7f4fd815f3c0 2024-05-08T10:56:03.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.031+0000 7f4fd659c640 1 --2- 172.21.15.33:0/3576890692 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4fd815f3c0 0x7f4fd80b71e0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f4fc8000c00 tx=0x7f4fc80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:56:03.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.031+0000 7f4fceffd640 1 -- 172.21.15.33:0/3576890692 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc8037040 con 0x7f4fd815f3c0 2024-05-08T10:56:03.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.032+0000 7f4fceffd640 1 -- 172.21.15.33:0/3576890692 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fc8042070 con 0x7f4fd815f3c0 2024-05-08T10:56:03.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.032+0000 7f4fdcf42640 1 -- 172.21.15.33:0/3576890692 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fd80b7af0 con 0x7f4fd815f3c0 2024-05-08T10:56:03.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.032+0000 7f4fceffd640 1 -- 172.21.15.33:0/3576890692 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc8030bd0 con 0x7f4fd815f3c0 2024-05-08T10:56:03.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.032+0000 7f4fdcf42640 1 -- 172.21.15.33:0/3576890692 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fd80b80b0 con 0x7f4fd815f3c0 2024-05-08T10:56:03.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.032+0000 7f4fdcf42640 1 -- 172.21.15.33:0/3576890692 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4fd80c7650 con 0x7f4fd815f3c0 2024-05-08T10:56:03.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.033+0000 7f4fceffd640 1 -- 172.21.15.33:0/3576890692 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4fc8047460 con 0x7f4fd815f3c0 2024-05-08T10:56:03.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.033+0000 7f4fceffd640 1 --2- 172.21.15.33:0/3576890692 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f4fb806b4d0 0x7f4fb806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:03.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.034+0000 7f4fceffd640 1 -- 172.21.15.33:0/3576890692 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f4fc80aabb0 con 0x7f4fd815f3c0 2024-05-08T10:56:03.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.034+0000 7f4fceffd640 1 --2- 172.21.15.33:0/3576890692 >> [v2:172.21.15.174:6816/2326407945,v1:172.21.15.174:6817/2326407945] conn(0x7f4fb8071390 0x7f4fb80737b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:03.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.034+0000 7f4fceffd640 1 -- 172.21.15.33:0/3576890692 --> [v2:172.21.15.174:6816/2326407945,v1:172.21.15.174:6817/2326407945] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4fc8049e70 con 0x7f4fb8071390 2024-05-08T10:56:03.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.034+0000 7f4fceffd640 1 -- 172.21.15.33:0/3576890692 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4fc80af280 con 0x7f4fd815f3c0 2024-05-08T10:56:03.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.034+0000 7f4fcffff640 1 --2- 172.21.15.33:0/3576890692 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f4fb806b4d0 0x7f4fb806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:03.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.034+0000 7f4fd6d9d640 1 --2- 172.21.15.33:0/3576890692 >> [v2:172.21.15.174:6816/2326407945,v1:172.21.15.174:6817/2326407945] conn(0x7f4fb8071390 0x7f4fb80737b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:03.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.034+0000 7f4fd6d9d640 1 --2- 172.21.15.33:0/3576890692 >> [v2:172.21.15.174:6816/2326407945,v1:172.21.15.174:6817/2326407945] conn(0x7f4fb8071390 0x7f4fb80737b0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:56:03.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.034+0000 7f4fcffff640 1 --2- 172.21.15.33:0/3576890692 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f4fb806b4d0 0x7f4fb806d990 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f4fd81f7400 tx=0x7f4fc0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:56:03.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.035+0000 7f4fceffd640 1 -- 172.21.15.33:0/3576890692 <== osd.6 v2:172.21.15.174:6816/2326407945 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f4fc8049e70 con 0x7f4fb8071390 2024-05-08T10:56:03.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.048+0000 7f4fdcf42640 1 -- 172.21.15.33:0/3576890692 --> [v2:172.21.15.174:6816/2326407945,v1:172.21.15.174:6817/2326407945] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f4fd8069d20 con 0x7f4fb8071390 2024-05-08T10:56:03.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.049+0000 7f4fceffd640 1 -- 172.21.15.33:0/3576890692 <== osd.6 v2:172.21.15.174:6816/2326407945 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f4fd8069d20 con 0x7f4fb8071390 2024-05-08T10:56:03.046 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-05-08T10:56:03.046 INFO:teuthology.orchestra.run.smithi033.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-08T10:56:03.046 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-05-08T10:56:03.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.049+0000 7f4fdcf42640 1 -- 172.21.15.33:0/3576890692 >> [v2:172.21.15.174:6816/2326407945,v1:172.21.15.174:6817/2326407945] conn(0x7f4fb8071390 msgr2=0x7f4fb80737b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:03.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.049+0000 7f4fdcf42640 1 --2- 172.21.15.33:0/3576890692 >> [v2:172.21.15.174:6816/2326407945,v1:172.21.15.174:6817/2326407945] conn(0x7f4fb8071390 0x7f4fb80737b0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:03.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.049+0000 7f4fdcf42640 1 -- 172.21.15.33:0/3576890692 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f4fb806b4d0 msgr2=0x7f4fb806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:03.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.049+0000 7f4fdcf42640 1 --2- 172.21.15.33:0/3576890692 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f4fb806b4d0 0x7f4fb806d990 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f4fd81f7400 tx=0x7f4fc0008040 comp rx=0 tx=0).stop 2024-05-08T10:56:03.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.049+0000 7f4fdcf42640 1 -- 172.21.15.33:0/3576890692 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4fd815f3c0 msgr2=0x7f4fd80b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:03.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.049+0000 7f4fdcf42640 1 --2- 172.21.15.33:0/3576890692 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4fd815f3c0 0x7f4fd80b71e0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f4fc8000c00 tx=0x7f4fc80046c0 comp rx=0 tx=0).stop 2024-05-08T10:56:03.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.049+0000 7f4fd6d9d640 1 -- 172.21.15.33:0/3576890692 reap_dead start 2024-05-08T10:56:03.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.049+0000 7f4fdcf42640 1 -- 172.21.15.33:0/3576890692 shutdown_connections 2024-05-08T10:56:03.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.049+0000 7f4fdcf42640 1 -- 172.21.15.33:0/3576890692 >> 172.21.15.33:0/3576890692 conn(0x7f4fd809cec0 msgr2=0x7f4fd806b870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:56:03.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.049+0000 7f4fdcf42640 1 -- 172.21.15.33:0/3576890692 shutdown_connections 2024-05-08T10:56:03.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.049+0000 7f4fdcf42640 1 -- 172.21.15.33:0/3576890692 wait complete. 2024-05-08T10:56:03.057 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-05-08T10:56:03.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.165+0000 7fb9de26b640 1 Processor -- start 2024-05-08T10:56:03.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.166+0000 7fb9de26b640 1 -- start start 2024-05-08T10:56:03.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.166+0000 7fb9de26b640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb9d80cfdc0 0x7fb9d80d0220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:03.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.166+0000 7fb9de26b640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb9d815cd80 0x7fb9d815d210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:03.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.166+0000 7fb9de26b640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9d80b4140 con 0x7fb9d8144630 2024-05-08T10:56:03.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.166+0000 7fb9de26b640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9d80d0760 con 0x7fb9d80cfdc0 2024-05-08T10:56:03.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.166+0000 7fb9de26b640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d815c330 con 0x7fb9d815cd80 2024-05-08T10:56:03.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.167+0000 7fb9d7fff640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fb9d8144630 0x7fb9d80b35d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:44746/0 (socket says 172.21.15.33:44746) 2024-05-08T10:56:03.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.167+0000 7fb9d7fff640 1 -- 172.21.15.33:0/3358402831 learned_addr learned my addr 172.21.15.33:0/3358402831 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-05-08T10:56:03.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.167+0000 7fb9d77fe640 1 --2- 172.21.15.33:0/3358402831 >> v2:172.21.15.174:3300/0 conn(0x7fb9d80cfdc0 0x7fb9d80d0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:03.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.167+0000 7fb9dc808640 1 --2- 172.21.15.33:0/3358402831 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb9d815cd80 0x7fb9d815d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:03.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.167+0000 7fb9d6ffd640 1 -- 172.21.15.33:0/3358402831 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3829494497 0 0) 0x7fb9d80b4140 con 0x7fb9d8144630 2024-05-08T10:56:03.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.167+0000 7fb9d6ffd640 1 -- 172.21.15.33:0/3358402831 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9c0005730 con 0x7fb9d8144630 2024-05-08T10:56:03.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.167+0000 7fb9d6ffd640 1 -- 172.21.15.33:0/3358402831 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3082961226 0 0) 0x7fb9c0005730 con 0x7fb9d8144630 2024-05-08T10:56:03.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.167+0000 7fb9d6ffd640 1 -- 172.21.15.33:0/3358402831 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb9d815cd80 msgr2=0x7fb9d815d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:56:03.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.167+0000 7fb9d6ffd640 1 --2- 172.21.15.33:0/3358402831 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb9d815cd80 0x7fb9d815d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:03.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.167+0000 7fb9d6ffd640 1 -- 172.21.15.33:0/3358402831 >> v2:172.21.15.174:3300/0 conn(0x7fb9d80cfdc0 msgr2=0x7fb9d80d0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:56:03.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.167+0000 7fb9d6ffd640 1 --2- 172.21.15.33:0/3358402831 >> v2:172.21.15.174:3300/0 conn(0x7fb9d80cfdc0 0x7fb9d80d0220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:03.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.167+0000 7fb9d6ffd640 1 -- 172.21.15.33:0/3358402831 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9d80b4420 con 0x7fb9d8144630 2024-05-08T10:56:03.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.167+0000 7fb9d6ffd640 1 -- 172.21.15.33:0/3358402831 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2948294915 0 0) 0x7fb9c8001670 con 0x7fb9d8144630 2024-05-08T10:56:03.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.167+0000 7fb9d6ffd640 1 -- 172.21.15.33:0/3358402831 >> v1:172.21.15.33:6789/0 conn(0x7fb9d8144630 legacy=0x7fb9d80b35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:03.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.167+0000 7fb9d6ffd640 1 --2- 172.21.15.33:0/3358402831 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb9d815cd80 0x7fb9c0005bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:03.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.167+0000 7fb9d6ffd640 1 --2- 172.21.15.33:0/3358402831 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb9c0006140 0x7fb9c0006a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:03.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.167+0000 7fb9d6ffd640 1 --2- 172.21.15.33:0/3358402831 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb9c0006f50 0x7fb9c00073d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:03.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.167+0000 7fb9d6ffd640 1 -- 172.21.15.33:0/3358402831 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d815c330 con 0x7fb9c0006140 2024-05-08T10:56:03.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.167+0000 7fb9d6ffd640 1 -- 172.21.15.33:0/3358402831 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c000dbd0 con 0x7fb9c0006f50 2024-05-08T10:56:03.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.167+0000 7fb9d6ffd640 1 -- 172.21.15.33:0/3358402831 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c000dd50 con 0x7fb9d815cd80 2024-05-08T10:56:03.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.167+0000 7fb9d77fe640 1 --2- 172.21.15.33:0/3358402831 >> v2:172.21.15.174:3300/0 conn(0x7fb9d80cfdc0 0x7fb9d80d0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T10:56:03.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.168+0000 7fb9d7fff640 1 --2- 172.21.15.33:0/3358402831 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb9d815cd80 0x7fb9c0005bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:03.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.168+0000 7fb9d77fe640 1 --2- 172.21.15.33:0/3358402831 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb9c0006140 0x7fb9c0006a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:03.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.168+0000 7fb9dc808640 1 --2- 172.21.15.33:0/3358402831 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb9c0006f50 0x7fb9c00073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:03.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.168+0000 7fb9d77fe640 1 -- 172.21.15.33:0/3358402831 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb9d815cd80 msgr2=0x7fb9c0005bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:56:03.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.168+0000 7fb9d77fe640 1 --2- 172.21.15.33:0/3358402831 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb9d815cd80 0x7fb9c0005bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:03.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.168+0000 7fb9d77fe640 1 -- 172.21.15.33:0/3358402831 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb9c0006f50 msgr2=0x7fb9c00073d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:56:03.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.168+0000 7fb9d77fe640 1 --2- 172.21.15.33:0/3358402831 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb9c0006f50 0x7fb9c00073d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:03.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.168+0000 7fb9d77fe640 1 -- 172.21.15.33:0/3358402831 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9c0005730 con 0x7fb9c0006140 2024-05-08T10:56:03.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.169+0000 7fb9d77fe640 1 --2- 172.21.15.33:0/3358402831 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb9c0006140 0x7fb9c0006a10 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc009c70 tx=0x7fb9c0007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d228bec8196ae5df server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:56:03.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.169+0000 7fb9d6ffd640 1 -- 172.21.15.33:0/3358402831 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9cc009840 con 0x7fb9c0006140 2024-05-08T10:56:03.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.169+0000 7fb9d6ffd640 1 -- 172.21.15.33:0/3358402831 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9cc004020 con 0x7fb9c0006140 2024-05-08T10:56:03.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.169+0000 7fb9d6ffd640 1 -- 172.21.15.33:0/3358402831 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9cc0043d0 con 0x7fb9c0006140 2024-05-08T10:56:03.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.169+0000 7fb9de26b640 1 -- 172.21.15.33:0/3358402831 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb9c0006140 msgr2=0x7fb9c0006a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:03.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.169+0000 7fb9de26b640 1 --2- 172.21.15.33:0/3358402831 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb9c0006140 0x7fb9c0006a10 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc009c70 tx=0x7fb9c0007a40 comp rx=0 tx=0).stop 2024-05-08T10:56:03.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.169+0000 7fb9dc808640 1 -- 172.21.15.33:0/3358402831 reap_dead start 2024-05-08T10:56:03.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.169+0000 7fb9de26b640 1 -- 172.21.15.33:0/3358402831 shutdown_connections 2024-05-08T10:56:03.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.169+0000 7fb9de26b640 1 -- 172.21.15.33:0/3358402831 >> 172.21.15.33:0/3358402831 conn(0x7fb9d806afc0 msgr2=0x7fb9d806b3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:56:03.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.169+0000 7fb9de26b640 1 -- 172.21.15.33:0/3358402831 shutdown_connections 2024-05-08T10:56:03.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.169+0000 7fb9de26b640 1 -- 172.21.15.33:0/3358402831 wait complete. 2024-05-08T10:56:03.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.170+0000 7fb9de26b640 1 Processor -- start 2024-05-08T10:56:03.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.171+0000 7fb9de26b640 1 -- start start 2024-05-08T10:56:03.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.171+0000 7fb9de26b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb9c0006140 0x7fb9d8133f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:03.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.171+0000 7fb9de26b640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb9d80706e0 0x7fb9d81f6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:03.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.171+0000 7fb9de26b640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb9d815b1e0 0x7fb9d815b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:03.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.171+0000 7fb9de26b640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d80b2be0 con 0x7fb9c0006140 2024-05-08T10:56:03.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.171+0000 7fb9de26b640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d815c860 con 0x7fb9d815b1e0 2024-05-08T10:56:03.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.171+0000 7fb9de26b640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d80b3ce0 con 0x7fb9d80706e0 2024-05-08T10:56:03.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.171+0000 7fb9d7fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb9c0006140 0x7fb9d8133f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:03.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.172+0000 7fb9d7fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb9c0006140 0x7fb9d8133f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46448/0 (socket says 172.21.15.33:46448) 2024-05-08T10:56:03.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.172+0000 7fb9d7fff640 1 -- 172.21.15.33:0/2386289969 learned_addr learned my addr 172.21.15.33:0/2386289969 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:56:03.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.172+0000 7fb9dc808640 1 --2- 172.21.15.33:0/2386289969 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb9d815b1e0 0x7fb9d815b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:03.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.172+0000 7fb9d77fe640 1 --2- 172.21.15.33:0/2386289969 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb9d80706e0 0x7fb9d81f6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:03.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.172+0000 7fb9d7fff640 1 -- 172.21.15.33:0/2386289969 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb9d80706e0 msgr2=0x7fb9d81f6cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:03.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.172+0000 7fb9d7fff640 1 --2- 172.21.15.33:0/2386289969 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb9d80706e0 0x7fb9d81f6cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:03.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.172+0000 7fb9d7fff640 1 -- 172.21.15.33:0/2386289969 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb9d815b1e0 msgr2=0x7fb9d815b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:03.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.172+0000 7fb9d7fff640 1 --2- 172.21.15.33:0/2386289969 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb9d815b1e0 0x7fb9d815b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:03.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.172+0000 7fb9d7fff640 1 -- 172.21.15.33:0/2386289969 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9d81344b0 con 0x7fb9c0006140 2024-05-08T10:56:03.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.172+0000 7fb9d7fff640 1 --2- 172.21.15.33:0/2386289969 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb9c0006140 0x7fb9d8133f70 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fb9c8007340 tx=0x7fb9c8007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:56:03.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.172+0000 7fb9d4ff9640 1 -- 172.21.15.33:0/2386289969 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9c801a070 con 0x7fb9c0006140 2024-05-08T10:56:03.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.172+0000 7fb9d4ff9640 1 -- 172.21.15.33:0/2386289969 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9c800f940 con 0x7fb9c0006140 2024-05-08T10:56:03.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.172+0000 7fb9de26b640 1 -- 172.21.15.33:0/2386289969 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9d8070ca0 con 0x7fb9c0006140 2024-05-08T10:56:03.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.172+0000 7fb9d4ff9640 1 -- 172.21.15.33:0/2386289969 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9c800fd10 con 0x7fb9c0006140 2024-05-08T10:56:03.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.172+0000 7fb9de26b640 1 -- 172.21.15.33:0/2386289969 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9d80aefe0 con 0x7fb9c0006140 2024-05-08T10:56:03.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.173+0000 7fb9de26b640 1 -- 172.21.15.33:0/2386289969 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9d8069d20 con 0x7fb9c0006140 2024-05-08T10:56:03.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.174+0000 7fb9d4ff9640 1 -- 172.21.15.33:0/2386289969 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb9c801d070 con 0x7fb9c0006140 2024-05-08T10:56:03.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.174+0000 7fb9d4ff9640 1 --2- 172.21.15.33:0/2386289969 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fb9c406b500 0x7fb9c406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:03.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.174+0000 7fb9d4ff9640 1 -- 172.21.15.33:0/2386289969 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fb9c8089800 con 0x7fb9c0006140 2024-05-08T10:56:03.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.175+0000 7fb9d77fe640 1 --2- 172.21.15.33:0/2386289969 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fb9c406b500 0x7fb9c406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:03.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.175+0000 7fb9d77fe640 1 --2- 172.21.15.33:0/2386289969 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fb9c406b500 0x7fb9c406d9c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc032000 tx=0x7fb9cc008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:56:03.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.178+0000 7fb9d4ff9640 1 -- 172.21.15.33:0/2386289969 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb9c8058290 con 0x7fb9c0006140 2024-05-08T10:56:03.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.357+0000 7fb9de26b640 1 -- 172.21.15.33:0/2386289969 --> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7fb9d8070f80 con 0x7fb9c406b500 2024-05-08T10:56:03.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.357+0000 7fb9d4ff9640 1 -- 172.21.15.33:0/2386289969 <== mgr.4103 v2:172.21.15.174:6832/261355069 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb9cc005990 con 0x7fb9c406b500 2024-05-08T10:56:03.355 INFO:teuthology.orchestra.run.smithi033.stderr:instructed osd(s) 6 to deep-scrub 2024-05-08T10:56:03.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.359+0000 7fb9de26b640 1 -- 172.21.15.33:0/2386289969 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fb9c406b500 msgr2=0x7fb9c406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:03.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.359+0000 7fb9de26b640 1 --2- 172.21.15.33:0/2386289969 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fb9c406b500 0x7fb9c406d9c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc032000 tx=0x7fb9cc008030 comp rx=0 tx=0).stop 2024-05-08T10:56:03.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.359+0000 7fb9de26b640 1 -- 172.21.15.33:0/2386289969 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb9c0006140 msgr2=0x7fb9d8133f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:03.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.359+0000 7fb9de26b640 1 --2- 172.21.15.33:0/2386289969 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb9c0006140 0x7fb9d8133f70 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fb9c8007340 tx=0x7fb9c8007800 comp rx=0 tx=0).stop 2024-05-08T10:56:03.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.359+0000 7fb9de26b640 1 -- 172.21.15.33:0/2386289969 shutdown_connections 2024-05-08T10:56:03.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.359+0000 7fb9de26b640 1 --2- 172.21.15.33:0/2386289969 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7fb9c406b500 0x7fb9c406d9c0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:03.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.359+0000 7fb9de26b640 1 --2- 172.21.15.33:0/2386289969 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb9d815b1e0 0x7fb9d815b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:03.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.359+0000 7fb9de26b640 1 --2- 172.21.15.33:0/2386289969 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb9d80706e0 0x7fb9d81f6cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:03.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.359+0000 7fb9de26b640 1 --2- 172.21.15.33:0/2386289969 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb9c0006140 0x7fb9d8133f70 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:03.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.359+0000 7fb9de26b640 1 -- 172.21.15.33:0/2386289969 >> 172.21.15.33:0/2386289969 conn(0x7fb9d806afc0 msgr2=0x7fb9d80b1df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:56:03.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.359+0000 7fb9de26b640 1 -- 172.21.15.33:0/2386289969 shutdown_connections 2024-05-08T10:56:03.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.359+0000 7fb9de26b640 1 -- 172.21.15.33:0/2386289969 wait complete. 2024-05-08T10:56:03.368 INFO:tasks.ceph:Scrubbing osd.7 2024-05-08T10:56:03.368 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-05-08T10:56:03.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.478+0000 7f3b9b42a640 1 Processor -- start 2024-05-08T10:56:03.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.478+0000 7f3b9b42a640 1 -- start start 2024-05-08T10:56:03.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.479+0000 7f3b9b42a640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f3b9415de60 0x7f3b940ce6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:03.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.479+0000 7f3b9b42a640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3b940d45f0 0x7f3b940d2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:03.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.479+0000 7f3b9b42a640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b940d1be0 con 0x7f3b940d2670 2024-05-08T10:56:03.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.479+0000 7f3b9b42a640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b940d2ae0 con 0x7f3b9415de60 2024-05-08T10:56:03.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.479+0000 7f3b9b42a640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b940ced40 con 0x7f3b940d45f0 2024-05-08T10:56:03.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.479+0000 7f3b991c6640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f3b9415de60 0x7f3b940ce6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:03.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.479+0000 7f3b991c6640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f3b9415de60 0x7f3b940ce6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46450/0 (socket says 172.21.15.33:46450) 2024-05-08T10:56:03.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.479+0000 7f3b991c6640 1 -- 172.21.15.33:0/1343508050 learned_addr learned my addr 172.21.15.33:0/1343508050 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:56:03.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.479+0000 7f3b999c7640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f3b940d2670 0x7f3b940d0310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:44758/0 (socket says 172.21.15.33:44758) 2024-05-08T10:56:03.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.479+0000 7f3b989c5640 1 --2- 172.21.15.33:0/1343508050 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3b940d45f0 0x7f3b940d2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:03.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.479+0000 7f3b991c6640 1 -- 172.21.15.33:0/1343508050 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3b940d45f0 msgr2=0x7f3b940d2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:56:03.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.479+0000 7f3b991c6640 1 --2- 172.21.15.33:0/1343508050 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3b940d45f0 0x7f3b940d2130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:03.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.479+0000 7f3b991c6640 1 -- 172.21.15.33:0/1343508050 >> v1:172.21.15.33:6789/0 conn(0x7f3b940d2670 legacy=0x7f3b940d0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:03.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.479+0000 7f3b991c6640 1 -- 172.21.15.33:0/1343508050 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b940cf020 con 0x7f3b9415de60 2024-05-08T10:56:03.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.479+0000 7f3b8bfff640 1 -- 172.21.15.33:0/1343508050 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 358224229 0 0) 0x7f3b940d1be0 con 0x7f3b940d2670 2024-05-08T10:56:03.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.480+0000 7f3b991c6640 1 --2- 172.21.15.33:0/1343508050 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b9415de60 0x7f3b940ce6f0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f3b90009e50 tx=0x7f3b9002a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da6ee7a8649da0c1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:56:03.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.480+0000 7f3b8bfff640 1 -- 172.21.15.33:0/1343508050 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b90036070 con 0x7f3b9415de60 2024-05-08T10:56:03.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.480+0000 7f3b8bfff640 1 -- 172.21.15.33:0/1343508050 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b90031600 con 0x7f3b9415de60 2024-05-08T10:56:03.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.480+0000 7f3b8bfff640 1 -- 172.21.15.33:0/1343508050 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b900319d0 con 0x7f3b9415de60 2024-05-08T10:56:03.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.481+0000 7f3b9b42a640 1 -- 172.21.15.33:0/1343508050 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b9415de60 msgr2=0x7f3b940ce6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:03.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.481+0000 7f3b9b42a640 1 --2- 172.21.15.33:0/1343508050 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b9415de60 0x7f3b940ce6f0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f3b90009e50 tx=0x7f3b9002a7a0 comp rx=0 tx=0).stop 2024-05-08T10:56:03.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.481+0000 7f3b9b42a640 1 -- 172.21.15.33:0/1343508050 shutdown_connections 2024-05-08T10:56:03.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.481+0000 7f3b9b42a640 1 --2- 172.21.15.33:0/1343508050 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3b940d45f0 0x7f3b940d2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:03.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.481+0000 7f3b9b42a640 1 --2- 172.21.15.33:0/1343508050 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b9415de60 0x7f3b940ce6f0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:03.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.481+0000 7f3b9b42a640 1 -- 172.21.15.33:0/1343508050 >> 172.21.15.33:0/1343508050 conn(0x7f3b9409cea0 msgr2=0x7f3b940d3b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:56:03.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.481+0000 7f3b9b42a640 1 -- 172.21.15.33:0/1343508050 shutdown_connections 2024-05-08T10:56:03.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.481+0000 7f3b9b42a640 1 -- 172.21.15.33:0/1343508050 wait complete. 2024-05-08T10:56:03.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.482+0000 7f3b9b42a640 1 Processor -- start 2024-05-08T10:56:03.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.482+0000 7f3b9b42a640 1 -- start start 2024-05-08T10:56:03.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.483+0000 7f3b9b42a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b940d2670 0x7f3b941e8280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:03.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.483+0000 7f3b9b42a640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3b940d45f0 0x7f3b940cc150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:03.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.483+0000 7f3b9b42a640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3b9415de60 0x7f3b940cd380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:03.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.483+0000 7f3b9b42a640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b940cf8c0 con 0x7f3b940d2670 2024-05-08T10:56:03.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.483+0000 7f3b9b42a640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b940cf5e0 con 0x7f3b940d45f0 2024-05-08T10:56:03.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.483+0000 7f3b9b42a640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b940d4a10 con 0x7f3b9415de60 2024-05-08T10:56:03.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.483+0000 7f3b991c6640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b940d2670 0x7f3b941e8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:03.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.483+0000 7f3b991c6640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b940d2670 0x7f3b941e8280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46462/0 (socket says 172.21.15.33:46462) 2024-05-08T10:56:03.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.483+0000 7f3b991c6640 1 -- 172.21.15.33:0/2558561228 learned_addr learned my addr 172.21.15.33:0/2558561228 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:56:03.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.483+0000 7f3b991c6640 1 -- 172.21.15.33:0/2558561228 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3b9415de60 msgr2=0x7f3b940cd380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:03.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.483+0000 7f3b991c6640 1 --2- 172.21.15.33:0/2558561228 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3b9415de60 0x7f3b940cd380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:03.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.483+0000 7f3b991c6640 1 -- 172.21.15.33:0/2558561228 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3b940d45f0 msgr2=0x7f3b940cc150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:03.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.483+0000 7f3b991c6640 1 --2- 172.21.15.33:0/2558561228 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3b940d45f0 0x7f3b940cc150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:03.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.483+0000 7f3b991c6640 1 -- 172.21.15.33:0/2558561228 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b940cb0b0 con 0x7f3b940d2670 2024-05-08T10:56:03.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.483+0000 7f3b991c6640 1 --2- 172.21.15.33:0/2558561228 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b940d2670 0x7f3b941e8280 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f3b90034040 tx=0x7f3b90004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:56:03.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.483+0000 7f3b89ffb640 1 -- 172.21.15.33:0/2558561228 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b90036050 con 0x7f3b940d2670 2024-05-08T10:56:03.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.483+0000 7f3b89ffb640 1 -- 172.21.15.33:0/2558561228 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b90042070 con 0x7f3b940d2670 2024-05-08T10:56:03.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.483+0000 7f3b9b42a640 1 -- 172.21.15.33:0/2558561228 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b940cb390 con 0x7f3b940d2670 2024-05-08T10:56:03.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.483+0000 7f3b89ffb640 1 -- 172.21.15.33:0/2558561228 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b90009510 con 0x7f3b940d2670 2024-05-08T10:56:03.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.484+0000 7f3b9b42a640 1 -- 172.21.15.33:0/2558561228 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b940cb950 con 0x7f3b940d2670 2024-05-08T10:56:03.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.484+0000 7f3b9b42a640 1 -- 172.21.15.33:0/2558561228 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3b940cbd20 con 0x7f3b940d2670 2024-05-08T10:56:03.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.485+0000 7f3b89ffb640 1 -- 172.21.15.33:0/2558561228 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3b90007bd0 con 0x7f3b940d2670 2024-05-08T10:56:03.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.485+0000 7f3b89ffb640 1 --2- 172.21.15.33:0/2558561228 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f3b7806b4d0 0x7f3b7806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:03.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.486+0000 7f3b89ffb640 1 -- 172.21.15.33:0/2558561228 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f3b900aae70 con 0x7f3b940d2670 2024-05-08T10:56:03.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.486+0000 7f3b989c5640 1 --2- 172.21.15.33:0/2558561228 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f3b7806b4d0 0x7f3b7806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:03.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.486+0000 7f3b89ffb640 1 --2- 172.21.15.33:0/2558561228 >> [v2:172.21.15.174:6808/1637570253,v1:172.21.15.174:6809/1637570253] conn(0x7f3b78071390 0x7f3b780737b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:03.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.486+0000 7f3b89ffb640 1 -- 172.21.15.33:0/2558561228 --> [v2:172.21.15.174:6808/1637570253,v1:172.21.15.174:6809/1637570253] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3b9004ae80 con 0x7f3b78071390 2024-05-08T10:56:03.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.486+0000 7f3b89ffb640 1 -- 172.21.15.33:0/2558561228 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3b900ad570 con 0x7f3b940d2670 2024-05-08T10:56:03.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.486+0000 7f3b999c7640 1 --2- 172.21.15.33:0/2558561228 >> [v2:172.21.15.174:6808/1637570253,v1:172.21.15.174:6809/1637570253] conn(0x7f3b78071390 0x7f3b780737b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:03.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.486+0000 7f3b989c5640 1 --2- 172.21.15.33:0/2558561228 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f3b7806b4d0 0x7f3b7806d990 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f3b84006fd0 tx=0x7f3b84008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:56:03.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.486+0000 7f3b999c7640 1 --2- 172.21.15.33:0/2558561228 >> [v2:172.21.15.174:6808/1637570253,v1:172.21.15.174:6809/1637570253] conn(0x7f3b78071390 0x7f3b780737b0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:56:03.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.487+0000 7f3b89ffb640 1 -- 172.21.15.33:0/2558561228 <== osd.7 v2:172.21.15.174:6808/1637570253 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f3b9004ae80 con 0x7f3b78071390 2024-05-08T10:56:03.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.501+0000 7f3b9b42a640 1 -- 172.21.15.33:0/2558561228 --> [v2:172.21.15.174:6808/1637570253,v1:172.21.15.174:6809/1637570253] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f3b94069d20 con 0x7f3b78071390 2024-05-08T10:56:03.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.501+0000 7f3b89ffb640 1 -- 172.21.15.33:0/2558561228 <== osd.7 v2:172.21.15.174:6808/1637570253 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f3b94069d20 con 0x7f3b78071390 2024-05-08T10:56:03.498 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-05-08T10:56:03.498 INFO:teuthology.orchestra.run.smithi033.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-08T10:56:03.499 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-05-08T10:56:03.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.501+0000 7f3b9b42a640 1 -- 172.21.15.33:0/2558561228 >> [v2:172.21.15.174:6808/1637570253,v1:172.21.15.174:6809/1637570253] conn(0x7f3b78071390 msgr2=0x7f3b780737b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:03.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.501+0000 7f3b9b42a640 1 --2- 172.21.15.33:0/2558561228 >> [v2:172.21.15.174:6808/1637570253,v1:172.21.15.174:6809/1637570253] conn(0x7f3b78071390 0x7f3b780737b0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:03.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.501+0000 7f3b9b42a640 1 -- 172.21.15.33:0/2558561228 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f3b7806b4d0 msgr2=0x7f3b7806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:03.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.501+0000 7f3b9b42a640 1 --2- 172.21.15.33:0/2558561228 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f3b7806b4d0 0x7f3b7806d990 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f3b84006fd0 tx=0x7f3b84008040 comp rx=0 tx=0).stop 2024-05-08T10:56:03.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.501+0000 7f3b9b42a640 1 -- 172.21.15.33:0/2558561228 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b940d2670 msgr2=0x7f3b941e8280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:03.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.501+0000 7f3b9b42a640 1 --2- 172.21.15.33:0/2558561228 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b940d2670 0x7f3b941e8280 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f3b90034040 tx=0x7f3b90004a40 comp rx=0 tx=0).stop 2024-05-08T10:56:03.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.501+0000 7f3b999c7640 1 -- 172.21.15.33:0/2558561228 reap_dead start 2024-05-08T10:56:03.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.502+0000 7f3b9b42a640 1 -- 172.21.15.33:0/2558561228 shutdown_connections 2024-05-08T10:56:03.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.502+0000 7f3b9b42a640 1 -- 172.21.15.33:0/2558561228 >> 172.21.15.33:0/2558561228 conn(0x7f3b9409cea0 msgr2=0x7f3b940d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:56:03.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.502+0000 7f3b9b42a640 1 -- 172.21.15.33:0/2558561228 shutdown_connections 2024-05-08T10:56:03.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.502+0000 7f3b9b42a640 1 -- 172.21.15.33:0/2558561228 wait complete. 2024-05-08T10:56:03.509 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-05-08T10:56:03.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.616+0000 7ff00eb0a640 1 Processor -- start 2024-05-08T10:56:03.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.617+0000 7ff00eb0a640 1 -- start start 2024-05-08T10:56:03.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.617+0000 7ff00eb0a640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff008144630 0x7ff0080b35d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:03.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.617+0000 7ff00eb0a640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff0080d04d0 0x7ff00815cd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:03.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.617+0000 7ff00eb0a640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0080b4140 con 0x7ff0080b3b10 2024-05-08T10:56:03.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.617+0000 7ff00eb0a640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff00815c330 con 0x7ff0080d04d0 2024-05-08T10:56:03.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.617+0000 7ff00eb0a640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0080b4420 con 0x7ff008144630 2024-05-08T10:56:03.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.618+0000 7ff00d0a7640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff0080d04d0 0x7ff00815cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:03.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.618+0000 7ff00c8a6640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff008144630 0x7ff0080b35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:03.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.618+0000 7ff00d0a7640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff0080d04d0 0x7ff00815cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.33:39118/0 (socket says 172.21.15.33:39118) 2024-05-08T10:56:03.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.618+0000 7ff00d0a7640 1 -- 172.21.15.33:0/3983199542 learned_addr learned my addr 172.21.15.33:0/3983199542 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:56:03.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.618+0000 7ff007fff640 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7ff0080b3b10 0x7ff0080cfdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.33:44078/0 (socket says 172.21.15.33:44078) 2024-05-08T10:56:03.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.618+0000 7ff00d0a7640 1 -- 172.21.15.33:0/3983199542 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff008144630 msgr2=0x7ff0080b35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:56:03.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.618+0000 7ff00d0a7640 1 --2- 172.21.15.33:0/3983199542 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff008144630 0x7ff0080b35d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:03.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.618+0000 7ff00d0a7640 1 -- 172.21.15.33:0/3983199542 >> v1:172.21.15.174:6789/0 conn(0x7ff0080b3b10 legacy=0x7ff0080cfdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:03.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.618+0000 7ff00d0a7640 1 -- 172.21.15.33:0/3983199542 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff00815c580 con 0x7ff0080d04d0 2024-05-08T10:56:03.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.618+0000 7ff0077fe640 1 -- 172.21.15.33:0/3983199542 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1858444839 0 0) 0x7ff0080b4140 con 0x7ff0080b3b10 2024-05-08T10:56:03.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.618+0000 7ff00c8a6640 1 --2- 172.21.15.33:0/3983199542 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff008144630 0x7ff0080b35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T10:56:03.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.619+0000 7ff00d0a7640 1 --2- 172.21.15.33:0/3983199542 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff0080d04d0 0x7ff00815cd80 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff000009e50 tx=0x7ff00002a710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3dbde97f07623e57 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:56:03.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.619+0000 7ff0077fe640 1 -- 172.21.15.33:0/3983199542 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff000036070 con 0x7ff0080d04d0 2024-05-08T10:56:03.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.619+0000 7ff0077fe640 1 -- 172.21.15.33:0/3983199542 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff000031600 con 0x7ff0080d04d0 2024-05-08T10:56:03.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.619+0000 7ff0077fe640 1 -- 172.21.15.33:0/3983199542 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0000319d0 con 0x7ff0080d04d0 2024-05-08T10:56:03.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.619+0000 7ff00eb0a640 1 -- 172.21.15.33:0/3983199542 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff0080d04d0 msgr2=0x7ff00815cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:03.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.619+0000 7ff00eb0a640 1 --2- 172.21.15.33:0/3983199542 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff0080d04d0 0x7ff00815cd80 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff000009e50 tx=0x7ff00002a710 comp rx=0 tx=0).stop 2024-05-08T10:56:03.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.620+0000 7ff00eb0a640 1 -- 172.21.15.33:0/3983199542 shutdown_connections 2024-05-08T10:56:03.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.620+0000 7ff00eb0a640 1 --2- 172.21.15.33:0/3983199542 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff0080d04d0 0x7ff00815cd80 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:03.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.620+0000 7ff00eb0a640 1 --2- 172.21.15.33:0/3983199542 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff008144630 0x7ff0080b35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:03.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.620+0000 7ff00eb0a640 1 -- 172.21.15.33:0/3983199542 >> 172.21.15.33:0/3983199542 conn(0x7ff00806afc0 msgr2=0x7ff00806b3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:56:03.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.620+0000 7ff00eb0a640 1 -- 172.21.15.33:0/3983199542 shutdown_connections 2024-05-08T10:56:03.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.620+0000 7ff00eb0a640 1 -- 172.21.15.33:0/3983199542 wait complete. 2024-05-08T10:56:03.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.621+0000 7ff00eb0a640 1 Processor -- start 2024-05-08T10:56:03.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.621+0000 7ff00eb0a640 1 -- start start 2024-05-08T10:56:03.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.622+0000 7ff00eb0a640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff0080b3b10 0x7ff0081f37e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:03.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.622+0000 7ff00eb0a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff0080d04d0 0x7ff0081f51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:03.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.622+0000 7ff00eb0a640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff008144630 0x7ff008152290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:03.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.622+0000 7ff00eb0a640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff00815d2c0 con 0x7ff0080d04d0 2024-05-08T10:56:03.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.622+0000 7ff00eb0a640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0080b2be0 con 0x7ff008144630 2024-05-08T10:56:03.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.622+0000 7ff00eb0a640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff00815d440 con 0x7ff0080b3b10 2024-05-08T10:56:03.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.622+0000 7ff007fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff0080d04d0 0x7ff0081f51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:03.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.622+0000 7ff007fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff0080d04d0 0x7ff0081f51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46474/0 (socket says 172.21.15.33:46474) 2024-05-08T10:56:03.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.622+0000 7ff007fff640 1 -- 172.21.15.33:0/23153169 learned_addr learned my addr 172.21.15.33:0/23153169 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:56:03.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.622+0000 7ff00c8a6640 1 --2- 172.21.15.33:0/23153169 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff0080b3b10 0x7ff0081f37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:03.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.622+0000 7ff00d0a7640 1 --2- 172.21.15.33:0/23153169 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff008144630 0x7ff008152290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:03.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.622+0000 7ff007fff640 1 -- 172.21.15.33:0/23153169 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff0080b3b10 msgr2=0x7ff0081f37e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:03.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.622+0000 7ff007fff640 1 --2- 172.21.15.33:0/23153169 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff0080b3b10 0x7ff0081f37e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:03.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.622+0000 7ff007fff640 1 -- 172.21.15.33:0/23153169 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff008144630 msgr2=0x7ff008152290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:03.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.622+0000 7ff007fff640 1 --2- 172.21.15.33:0/23153169 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff008144630 0x7ff008152290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:03.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.622+0000 7ff007fff640 1 -- 172.21.15.33:0/23153169 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff00813ab20 con 0x7ff0080d04d0 2024-05-08T10:56:03.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.622+0000 7ff007fff640 1 --2- 172.21.15.33:0/23153169 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff0080d04d0 0x7ff0081f51b0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7feffc00c4d0 tx=0x7feffc00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:56:03.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.623+0000 7ff0057fa640 1 -- 172.21.15.33:0/23153169 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feffc018070 con 0x7ff0080d04d0 2024-05-08T10:56:03.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.623+0000 7ff0057fa640 1 -- 172.21.15.33:0/23153169 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feffc007500 con 0x7ff0080d04d0 2024-05-08T10:56:03.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.623+0000 7ff00eb0a640 1 -- 172.21.15.33:0/23153169 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff00813adc0 con 0x7ff0080d04d0 2024-05-08T10:56:03.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.623+0000 7ff0057fa640 1 -- 172.21.15.33:0/23153169 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feffc004a20 con 0x7ff0080d04d0 2024-05-08T10:56:03.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.623+0000 7ff00eb0a640 1 -- 172.21.15.33:0/23153169 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff00815de50 con 0x7ff0080d04d0 2024-05-08T10:56:03.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.624+0000 7ff00eb0a640 1 -- 172.21.15.33:0/23153169 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff008151da0 con 0x7ff0080d04d0 2024-05-08T10:56:03.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.624+0000 7ff0057fa640 1 -- 172.21.15.33:0/23153169 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7feffc01b070 con 0x7ff0080d04d0 2024-05-08T10:56:03.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.625+0000 7ff0057fa640 1 --2- 172.21.15.33:0/23153169 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7feff406b4d0 0x7feff406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:03.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.625+0000 7ff0057fa640 1 -- 172.21.15.33:0/23153169 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7feffc089140 con 0x7ff0080d04d0 2024-05-08T10:56:03.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.625+0000 7ff00c8a6640 1 --2- 172.21.15.33:0/23153169 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7feff406b4d0 0x7feff406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:03.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.625+0000 7ff00c8a6640 1 --2- 172.21.15.33:0/23153169 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7feff406b4d0 0x7feff406d990 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7feff8009560 tx=0x7feff8009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:56:03.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.629+0000 7ff0057fa640 1 -- 172.21.15.33:0/23153169 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff008151da0 con 0x7ff0080d04d0 2024-05-08T10:56:03.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.808+0000 7ff00eb0a640 1 -- 172.21.15.33:0/23153169 --> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7ff008069d20 con 0x7feff406b4d0 2024-05-08T10:56:03.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.809+0000 7ff0057fa640 1 -- 172.21.15.33:0/23153169 <== mgr.4103 v2:172.21.15.174:6832/261355069 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ff008069d20 con 0x7feff406b4d0 2024-05-08T10:56:03.806 INFO:teuthology.orchestra.run.smithi033.stderr:instructed osd(s) 7 to deep-scrub 2024-05-08T10:56:03.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.810+0000 7ff00eb0a640 1 -- 172.21.15.33:0/23153169 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7feff406b4d0 msgr2=0x7feff406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:03.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.810+0000 7ff00eb0a640 1 --2- 172.21.15.33:0/23153169 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7feff406b4d0 0x7feff406d990 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7feff8009560 tx=0x7feff8009190 comp rx=0 tx=0).stop 2024-05-08T10:56:03.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.811+0000 7ff00eb0a640 1 -- 172.21.15.33:0/23153169 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff0080d04d0 msgr2=0x7ff0081f51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:03.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.811+0000 7ff00eb0a640 1 --2- 172.21.15.33:0/23153169 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff0080d04d0 0x7ff0081f51b0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7feffc00c4d0 tx=0x7feffc00c990 comp rx=0 tx=0).stop 2024-05-08T10:56:03.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.811+0000 7ff00eb0a640 1 -- 172.21.15.33:0/23153169 shutdown_connections 2024-05-08T10:56:03.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.811+0000 7ff00eb0a640 1 --2- 172.21.15.33:0/23153169 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7feff406b4d0 0x7feff406d990 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:03.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.811+0000 7ff00eb0a640 1 --2- 172.21.15.33:0/23153169 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff008144630 0x7ff008152290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:03.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.811+0000 7ff00eb0a640 1 --2- 172.21.15.33:0/23153169 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff0080d04d0 0x7ff0081f51b0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:03.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.811+0000 7ff00eb0a640 1 --2- 172.21.15.33:0/23153169 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff0080b3b10 0x7ff0081f37e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:03.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.811+0000 7ff00eb0a640 1 -- 172.21.15.33:0/23153169 >> 172.21.15.33:0/23153169 conn(0x7ff00806afc0 msgr2=0x7ff00815b000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:56:03.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.811+0000 7ff00eb0a640 1 -- 172.21.15.33:0/23153169 shutdown_connections 2024-05-08T10:56:03.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.811+0000 7ff00eb0a640 1 -- 172.21.15.33:0/23153169 wait complete. 2024-05-08T10:56:03.819 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T10:56:03.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.926+0000 7f80c8aee640 1 Processor -- start 2024-05-08T10:56:03.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.926+0000 7f80c8aee640 1 -- start start 2024-05-08T10:56:03.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.927+0000 7f80c8aee640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f80c40cc290 0x7f80c415b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:03.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.927+0000 7f80c8aee640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f80c4072110 0x7f80c406dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:03.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.927+0000 7f80c8aee640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80c40cfb60 con 0x7f80c406d7d0 2024-05-08T10:56:03.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.927+0000 7f80c8aee640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80c406e170 con 0x7f80c4072110 2024-05-08T10:56:03.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.927+0000 7f80c8aee640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80c415bec0 con 0x7f80c40cc290 2024-05-08T10:56:03.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.928+0000 7f80c259c640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f80c40cc290 0x7f80c415b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:03.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.928+0000 7f80c2d9d640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f80c4072110 0x7f80c406dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:03.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.928+0000 7f80c1d9b640 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f80c406d7d0 0x7f80c415e520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.33:44090/0 (socket says 172.21.15.33:44090) 2024-05-08T10:56:03.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.928+0000 7f80c1d9b640 1 -- 172.21.15.33:0/1023705830 learned_addr learned my addr 172.21.15.33:0/1023705830 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-05-08T10:56:03.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.928+0000 7f80c259c640 1 -- 172.21.15.33:0/1023705830 >> v2:172.21.15.174:3300/0 conn(0x7f80c4072110 msgr2=0x7f80c406dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:56:03.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.928+0000 7f80c259c640 1 --2- 172.21.15.33:0/1023705830 >> v2:172.21.15.174:3300/0 conn(0x7f80c4072110 0x7f80c406dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:03.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.928+0000 7f80c259c640 1 -- 172.21.15.33:0/1023705830 >> v1:172.21.15.174:6789/0 conn(0x7f80c406d7d0 legacy=0x7f80c415e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:03.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.928+0000 7f80c259c640 1 -- 172.21.15.33:0/1023705830 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80c40cfe40 con 0x7f80c40cc290 2024-05-08T10:56:03.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.929+0000 7f80c259c640 1 --2- 172.21.15.33:0/1023705830 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f80c40cc290 0x7f80c415b980 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f80b4009d90 tx=0x7f80b402a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=666e098c6ab3596d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:56:03.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.929+0000 7f80c159a640 1 -- 172.21.15.33:0/1023705830 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b4031600 con 0x7f80c40cc290 2024-05-08T10:56:03.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.929+0000 7f80c159a640 1 -- 172.21.15.33:0/1023705830 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80b40317a0 con 0x7f80c40cc290 2024-05-08T10:56:03.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.929+0000 7f80c159a640 1 -- 172.21.15.33:0/1023705830 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b4031b70 con 0x7f80c40cc290 2024-05-08T10:56:03.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.929+0000 7f80c8aee640 1 -- 172.21.15.33:0/1023705830 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f80c40cc290 msgr2=0x7f80c415b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:03.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.929+0000 7f80c8aee640 1 --2- 172.21.15.33:0/1023705830 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f80c40cc290 0x7f80c415b980 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f80b4009d90 tx=0x7f80b402a5d0 comp rx=0 tx=0).stop 2024-05-08T10:56:03.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.930+0000 7f80c8aee640 1 -- 172.21.15.33:0/1023705830 shutdown_connections 2024-05-08T10:56:03.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.930+0000 7f80c8aee640 1 --2- 172.21.15.33:0/1023705830 >> v2:172.21.15.174:3300/0 conn(0x7f80c4072110 0x7f80c406dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:03.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.930+0000 7f80c8aee640 1 --2- 172.21.15.33:0/1023705830 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f80c40cc290 0x7f80c415b980 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:03.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.930+0000 7f80c8aee640 1 -- 172.21.15.33:0/1023705830 >> 172.21.15.33:0/1023705830 conn(0x7f80c406aba0 msgr2=0x7f80c406afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:56:03.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.930+0000 7f80c8aee640 1 -- 172.21.15.33:0/1023705830 shutdown_connections 2024-05-08T10:56:03.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.930+0000 7f80c8aee640 1 -- 172.21.15.33:0/1023705830 wait complete. 2024-05-08T10:56:03.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.931+0000 7f80c8aee640 1 Processor -- start 2024-05-08T10:56:03.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.931+0000 7f80c8aee640 1 -- start start 2024-05-08T10:56:03.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.932+0000 7f80c8aee640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80c406d7d0 0x7f80c415da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:03.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.932+0000 7f80c8aee640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f80c4072110 0x7f80c41423f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:03.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.932+0000 7f80c8aee640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f80c40cc290 0x7f80c4154260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:03.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.932+0000 7f80c8aee640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80c40d0400 con 0x7f80c406d7d0 2024-05-08T10:56:03.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.932+0000 7f80c8aee640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80c40d0770 con 0x7f80c4072110 2024-05-08T10:56:03.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.932+0000 7f80c8aee640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80c40b36b0 con 0x7f80c40cc290 2024-05-08T10:56:03.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.932+0000 7f80c259c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80c406d7d0 0x7f80c415da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:03.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.932+0000 7f80c259c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80c406d7d0 0x7f80c415da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46488/0 (socket says 172.21.15.33:46488) 2024-05-08T10:56:03.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.932+0000 7f80c259c640 1 -- 172.21.15.33:0/4244398311 learned_addr learned my addr 172.21.15.33:0/4244398311 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:56:03.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.932+0000 7f80c2d9d640 1 --2- 172.21.15.33:0/4244398311 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f80c40cc290 0x7f80c4154260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:03.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.932+0000 7f80c1d9b640 1 --2- 172.21.15.33:0/4244398311 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f80c4072110 0x7f80c41423f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:03.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.932+0000 7f80c259c640 1 -- 172.21.15.33:0/4244398311 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f80c40cc290 msgr2=0x7f80c4154260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:03.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.932+0000 7f80c259c640 1 --2- 172.21.15.33:0/4244398311 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f80c40cc290 0x7f80c4154260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:03.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.932+0000 7f80c259c640 1 -- 172.21.15.33:0/4244398311 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f80c4072110 msgr2=0x7f80c41423f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:03.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.932+0000 7f80c259c640 1 --2- 172.21.15.33:0/4244398311 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f80c4072110 0x7f80c41423f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:03.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.932+0000 7f80c259c640 1 -- 172.21.15.33:0/4244398311 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80c4142930 con 0x7f80c406d7d0 2024-05-08T10:56:03.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.932+0000 7f80c259c640 1 --2- 172.21.15.33:0/4244398311 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80c406d7d0 0x7f80c415da90 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f80b4009eb0 tx=0x7f80b4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:56:03.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.932+0000 7f80baffd640 1 -- 172.21.15.33:0/4244398311 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b4040070 con 0x7f80c406d7d0 2024-05-08T10:56:03.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.933+0000 7f80baffd640 1 -- 172.21.15.33:0/4244398311 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80b4030be0 con 0x7f80c406d7d0 2024-05-08T10:56:03.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.933+0000 7f80c8aee640 1 -- 172.21.15.33:0/4244398311 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80c40afb60 con 0x7f80c406d7d0 2024-05-08T10:56:03.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.933+0000 7f80baffd640 1 -- 172.21.15.33:0/4244398311 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b4009450 con 0x7f80c406d7d0 2024-05-08T10:56:03.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.933+0000 7f80c8aee640 1 -- 172.21.15.33:0/4244398311 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80c40b0120 con 0x7f80c406d7d0 2024-05-08T10:56:03.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.934+0000 7f80c8aee640 1 -- 172.21.15.33:0/4244398311 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80c4069d20 con 0x7f80c406d7d0 2024-05-08T10:56:03.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.934+0000 7f80baffd640 1 -- 172.21.15.33:0/4244398311 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f80b4039040 con 0x7f80c406d7d0 2024-05-08T10:56:03.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.934+0000 7f80baffd640 1 --2- 172.21.15.33:0/4244398311 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f80a406b4d0 0x7f80a406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:03.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.935+0000 7f80baffd640 1 -- 172.21.15.33:0/4244398311 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f80b40ab380 con 0x7f80c406d7d0 2024-05-08T10:56:03.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.935+0000 7f80c1d9b640 1 --2- 172.21.15.33:0/4244398311 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f80a406b4d0 0x7f80a406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:03.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.935+0000 7f80c1d9b640 1 --2- 172.21.15.33:0/4244398311 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f80a406b4d0 0x7f80a406d990 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f80c415d030 tx=0x7f80ac007e80 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:56:03.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:03.938+0000 7f80baffd640 1 -- 172.21.15.33:0/4244398311 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f80c4142930 con 0x7f80c406d7d0 2024-05-08T10:56:04.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:04.116+0000 7f80c8aee640 1 -- 172.21.15.33:0/4244398311 --> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f80c40707a0 con 0x7f80a406b4d0 2024-05-08T10:56:04.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:04.117+0000 7f80baffd640 1 -- 172.21.15.33:0/4244398311 <== mgr.4103 v2:172.21.15.174:6832/261355069 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+13484 (secure 0 0 0) 0x7f80c40707a0 con 0x7f80a406b4d0 2024-05-08T10:56:04.114 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:56:04.114 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-05-08T10:56:04.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:04.119+0000 7f80c8aee640 1 -- 172.21.15.33:0/4244398311 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f80a406b4d0 msgr2=0x7f80a406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:04.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:04.119+0000 7f80c8aee640 1 --2- 172.21.15.33:0/4244398311 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f80a406b4d0 0x7f80a406d990 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f80c415d030 tx=0x7f80ac007e80 comp rx=0 tx=0).stop 2024-05-08T10:56:04.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:04.119+0000 7f80c8aee640 1 -- 172.21.15.33:0/4244398311 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80c406d7d0 msgr2=0x7f80c415da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:04.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:04.119+0000 7f80c8aee640 1 --2- 172.21.15.33:0/4244398311 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80c406d7d0 0x7f80c415da90 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f80b4009eb0 tx=0x7f80b4004a40 comp rx=0 tx=0).stop 2024-05-08T10:56:04.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:04.119+0000 7f80c8aee640 1 -- 172.21.15.33:0/4244398311 shutdown_connections 2024-05-08T10:56:04.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:04.119+0000 7f80c8aee640 1 --2- 172.21.15.33:0/4244398311 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f80a406b4d0 0x7f80a406d990 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:04.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:04.119+0000 7f80c8aee640 1 --2- 172.21.15.33:0/4244398311 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f80c40cc290 0x7f80c4154260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:04.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:04.119+0000 7f80c8aee640 1 --2- 172.21.15.33:0/4244398311 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f80c4072110 0x7f80c41423f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:04.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:04.119+0000 7f80c8aee640 1 --2- 172.21.15.33:0/4244398311 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80c406d7d0 0x7f80c415da90 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:04.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:04.119+0000 7f80c8aee640 1 -- 172.21.15.33:0/4244398311 >> 172.21.15.33:0/4244398311 conn(0x7f80c406aba0 msgr2=0x7f80c415e290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:56:04.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:04.119+0000 7f80c8aee640 1 -- 172.21.15.33:0/4244398311 shutdown_connections 2024-05-08T10:56:04.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:04.119+0000 7f80c8aee640 1 -- 172.21.15.33:0/4244398311 wait complete. 2024-05-08T10:56:04.127 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":69,"stamp":"2024-05-08T10:56:02.960061+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":57,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":220408,"kb_used_data":4232,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754312,"statfs":{"total":773094113280,"available":772868415488,"internally_reserved":0,"allocated":4333568,"data_stored":2394936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-27936,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-17,"num_read_kb":-13,"num_write":-115,"num_write_kb":-69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001589"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":194,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-08T10:55:56.063075+0000","last_change":"2024-05-08T10:54:40.015226+0000","last_active":"2024-05-08T10:55:56.063075+0000","last_peered":"2024-05-08T10:55:56.063075+0000","last_clean":"2024-05-08T10:55:56.063075+0000","last_became_active":"2024-05-08T10:54:40.014219+0000","last_became_peered":"2024-05-08T10:54:40.014219+0000","last_unstale":"2024-05-08T10:55:56.063075+0000","last_undegraded":"2024-05-08T10:55:56.063075+0000","last_fullsized":"2024-05-08T10:55:56.063075+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T10:54:38.989328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T10:54:38.989328+0000","last_clean_scrub_stamp":"2024-05-08T10:54:38.989328+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:10:59.668786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27984,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343856,"statfs":{"total":96636764160,"available":96608108544,"internally_reserved":0,"allocated":987136,"data_stored":742143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574868,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27408,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":393216,"data_stored":151775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27408,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":393216,"data_stored":151775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27408,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":393216,"data_stored":151775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27408,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":393216,"data_stored":151775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27404,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":393216,"data_stored":151775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27404,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":393216,"data_stored":151775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574869,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27984,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343856,"statfs":{"total":96636764160,"available":96608108544,"internally_reserved":0,"allocated":987136,"data_stored":742143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T10:56:04.129 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-05-08T10:54:38.989328+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=10, tm_min=54, tm_sec=38, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=10, tm_min=55, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T10:56:04.130 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-08T10:56:20.911 DEBUG:teuthology.orchestra.run.smithi033:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T10:56:20.915 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T10:56:24.131 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T10:56:24.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.250+0000 7f90ebe31640 1 Processor -- start 2024-05-08T10:56:24.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.250+0000 7f90ebe31640 1 -- start start 2024-05-08T10:56:24.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.251+0000 7f90ebe31640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f90e413fa10 0x7f90e415af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:24.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.251+0000 7f90ebe31640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f90e413fdf0 0x7f90e413d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:24.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.251+0000 7f90ebe31640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90e406c860 con 0x7f90e40b3600 2024-05-08T10:56:24.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.251+0000 7f90ebe31640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90e406cb40 con 0x7f90e413fdf0 2024-05-08T10:56:24.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.251+0000 7f90ebe31640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90e406ce20 con 0x7f90e413fa10 2024-05-08T10:56:24.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.251+0000 7f90e93cc640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f90e413fdf0 0x7f90e413d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:24.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.251+0000 7f90e93cc640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f90e413fdf0 0x7f90e413d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45692/0 (socket says 172.21.15.33:45692) 2024-05-08T10:56:24.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.251+0000 7f90e93cc640 1 -- 172.21.15.33:0/2499650660 learned_addr learned my addr 172.21.15.33:0/2499650660 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:56:24.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.251+0000 7f90e9bcd640 1 --2- 172.21.15.33:0/2499650660 >> v2:172.21.15.174:3300/0 conn(0x7f90e413fa10 0x7f90e415af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:24.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.251+0000 7f90e93cc640 1 -- 172.21.15.33:0/2499650660 >> v2:172.21.15.174:3300/0 conn(0x7f90e413fa10 msgr2=0x7f90e415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:56:24.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.251+0000 7f90e93cc640 1 --2- 172.21.15.33:0/2499650660 >> v2:172.21.15.174:3300/0 conn(0x7f90e413fa10 0x7f90e415af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:24.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.251+0000 7f90e93cc640 1 -- 172.21.15.33:0/2499650660 >> v1:172.21.15.174:6789/0 conn(0x7f90e40b3600 legacy=0x7f90e406d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:24.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.251+0000 7f90e93cc640 1 -- 172.21.15.33:0/2499650660 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90e406d100 con 0x7f90e413fdf0 2024-05-08T10:56:24.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.252+0000 7f90e93cc640 1 --2- 172.21.15.33:0/2499650660 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90e413fdf0 0x7f90e413d740 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f90e406eb60 tx=0x7f90d402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8467b66d5856d5dd server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:56:24.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.252+0000 7f90e8bcb640 1 -- 172.21.15.33:0/2499650660 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d4037070 con 0x7f90e413fdf0 2024-05-08T10:56:24.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.252+0000 7f90e8bcb640 1 -- 172.21.15.33:0/2499650660 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90d4032440 con 0x7f90e413fdf0 2024-05-08T10:56:24.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.252+0000 7f90e8bcb640 1 -- 172.21.15.33:0/2499650660 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d4032810 con 0x7f90e413fdf0 2024-05-08T10:56:24.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.253+0000 7f90ebe31640 1 -- 172.21.15.33:0/2499650660 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90e413fdf0 msgr2=0x7f90e413d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:24.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.253+0000 7f90ebe31640 1 --2- 172.21.15.33:0/2499650660 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90e413fdf0 0x7f90e413d740 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f90e406eb60 tx=0x7f90d402a270 comp rx=0 tx=0).stop 2024-05-08T10:56:24.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.253+0000 7f90ebe31640 1 -- 172.21.15.33:0/2499650660 shutdown_connections 2024-05-08T10:56:24.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.253+0000 7f90ebe31640 1 --2- 172.21.15.33:0/2499650660 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90e413fdf0 0x7f90e413d740 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:24.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.253+0000 7f90ebe31640 1 --2- 172.21.15.33:0/2499650660 >> v2:172.21.15.174:3300/0 conn(0x7f90e413fa10 0x7f90e415af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:24.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.253+0000 7f90ebe31640 1 -- 172.21.15.33:0/2499650660 >> 172.21.15.33:0/2499650660 conn(0x7f90e406aba0 msgr2=0x7f90e406afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:56:24.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.253+0000 7f90ebe31640 1 -- 172.21.15.33:0/2499650660 shutdown_connections 2024-05-08T10:56:24.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.253+0000 7f90ebe31640 1 -- 172.21.15.33:0/2499650660 wait complete. 2024-05-08T10:56:24.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.254+0000 7f90ebe31640 1 Processor -- start 2024-05-08T10:56:24.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.254+0000 7f90ebe31640 1 -- start start 2024-05-08T10:56:24.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.255+0000 7f90ebe31640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f90e40b3600 0x7f90e4140240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:24.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.255+0000 7f90ebe31640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90e413fa10 0x7f90e4140dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:24.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.255+0000 7f90ebe31640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f90e413fdf0 0x7f90e413bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:24.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.255+0000 7f90ebe31640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90e413de00 con 0x7f90e413fa10 2024-05-08T10:56:24.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.255+0000 7f90ebe31640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90e413dc80 con 0x7f90e40b3600 2024-05-08T10:56:24.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.255+0000 7f90ebe31640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90e406dd30 con 0x7f90e413fdf0 2024-05-08T10:56:24.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.255+0000 7f90e93cc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90e413fa10 0x7f90e4140dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:24.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.255+0000 7f90e93cc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90e413fa10 0x7f90e4140dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45694/0 (socket says 172.21.15.33:45694) 2024-05-08T10:56:24.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.255+0000 7f90e93cc640 1 -- 172.21.15.33:0/4274024230 learned_addr learned my addr 172.21.15.33:0/4274024230 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:56:24.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.255+0000 7f90e9bcd640 1 --2- 172.21.15.33:0/4274024230 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f90e40b3600 0x7f90e4140240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:24.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.255+0000 7f90ea3ce640 1 --2- 172.21.15.33:0/4274024230 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f90e413fdf0 0x7f90e413bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:24.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.255+0000 7f90e93cc640 1 -- 172.21.15.33:0/4274024230 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f90e413fdf0 msgr2=0x7f90e413bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:24.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.255+0000 7f90e93cc640 1 --2- 172.21.15.33:0/4274024230 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f90e413fdf0 0x7f90e413bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:24.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.255+0000 7f90e93cc640 1 -- 172.21.15.33:0/4274024230 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f90e40b3600 msgr2=0x7f90e4140240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:24.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.255+0000 7f90e93cc640 1 --2- 172.21.15.33:0/4274024230 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f90e40b3600 0x7f90e4140240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:24.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.255+0000 7f90e93cc640 1 -- 172.21.15.33:0/4274024230 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90e4140780 con 0x7f90e413fa10 2024-05-08T10:56:24.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.255+0000 7f90e9bcd640 1 --2- 172.21.15.33:0/4274024230 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f90e40b3600 0x7f90e4140240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:56:24.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.255+0000 7f90ea3ce640 1 --2- 172.21.15.33:0/4274024230 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f90e413fdf0 0x7f90e413bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:56:24.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.256+0000 7f90e93cc640 1 --2- 172.21.15.33:0/4274024230 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90e413fa10 0x7f90e4140dc0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f90d4000c00 tx=0x7f90d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:56:24.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.256+0000 7f90da7fc640 1 -- 172.21.15.33:0/4274024230 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d4037040 con 0x7f90e413fa10 2024-05-08T10:56:24.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.256+0000 7f90da7fc640 1 -- 172.21.15.33:0/4274024230 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90d4042070 con 0x7f90e413fa10 2024-05-08T10:56:24.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.256+0000 7f90ebe31640 1 -- 172.21.15.33:0/4274024230 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90e4142c60 con 0x7f90e413fa10 2024-05-08T10:56:24.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.256+0000 7f90da7fc640 1 -- 172.21.15.33:0/4274024230 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d4030880 con 0x7f90e413fa10 2024-05-08T10:56:24.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.256+0000 7f90ebe31640 1 -- 172.21.15.33:0/4274024230 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90e4143220 con 0x7f90e413fa10 2024-05-08T10:56:24.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.257+0000 7f90ebe31640 1 -- 172.21.15.33:0/4274024230 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90e4069d20 con 0x7f90e413fa10 2024-05-08T10:56:24.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.257+0000 7f90da7fc640 1 -- 172.21.15.33:0/4274024230 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f90d4030a20 con 0x7f90e413fa10 2024-05-08T10:56:24.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.258+0000 7f90da7fc640 1 --2- 172.21.15.33:0/4274024230 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f90c806b4d0 0x7f90c806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:24.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.258+0000 7f90da7fc640 1 -- 172.21.15.33:0/4274024230 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f90d40aa760 con 0x7f90e413fa10 2024-05-08T10:56:24.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.258+0000 7f90e9bcd640 1 --2- 172.21.15.33:0/4274024230 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f90c806b4d0 0x7f90c806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:24.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.259+0000 7f90e9bcd640 1 --2- 172.21.15.33:0/4274024230 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f90c806b4d0 0x7f90c806d990 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f90e0007520 tx=0x7f90e000b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:56:24.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.262+0000 7f90da7fc640 1 -- 172.21.15.33:0/4274024230 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f90d4079a00 con 0x7f90e413fa10 2024-05-08T10:56:24.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.442+0000 7f90ebe31640 1 -- 172.21.15.33:0/4274024230 --> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f90e415a730 con 0x7f90c806b4d0 2024-05-08T10:56:24.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.443+0000 7f90da7fc640 1 -- 172.21.15.33:0/4274024230 <== mgr.4103 v2:172.21.15.174:6832/261355069 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+13354 (secure 0 0 0) 0x7f90e415a730 con 0x7f90c806b4d0 2024-05-08T10:56:24.441 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:56:24.441 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-05-08T10:56:24.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.445+0000 7f90ebe31640 1 -- 172.21.15.33:0/4274024230 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f90c806b4d0 msgr2=0x7f90c806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:24.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.445+0000 7f90ebe31640 1 --2- 172.21.15.33:0/4274024230 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f90c806b4d0 0x7f90c806d990 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f90e0007520 tx=0x7f90e000b040 comp rx=0 tx=0).stop 2024-05-08T10:56:24.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.445+0000 7f90ebe31640 1 -- 172.21.15.33:0/4274024230 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90e413fa10 msgr2=0x7f90e4140dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:24.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.445+0000 7f90ebe31640 1 --2- 172.21.15.33:0/4274024230 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90e413fa10 0x7f90e4140dc0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f90d4000c00 tx=0x7f90d40046c0 comp rx=0 tx=0).stop 2024-05-08T10:56:24.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.446+0000 7f90ebe31640 1 -- 172.21.15.33:0/4274024230 shutdown_connections 2024-05-08T10:56:24.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.446+0000 7f90ebe31640 1 --2- 172.21.15.33:0/4274024230 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f90c806b4d0 0x7f90c806d990 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:24.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.446+0000 7f90ebe31640 1 --2- 172.21.15.33:0/4274024230 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f90e413fdf0 0x7f90e413bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:24.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.446+0000 7f90ebe31640 1 --2- 172.21.15.33:0/4274024230 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90e413fa10 0x7f90e4140dc0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:24.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.446+0000 7f90ebe31640 1 --2- 172.21.15.33:0/4274024230 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f90e40b3600 0x7f90e4140240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:24.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.446+0000 7f90ebe31640 1 -- 172.21.15.33:0/4274024230 >> 172.21.15.33:0/4274024230 conn(0x7f90e406aba0 msgr2=0x7f90e413d290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:56:24.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.446+0000 7f90ebe31640 1 -- 172.21.15.33:0/4274024230 shutdown_connections 2024-05-08T10:56:24.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.446+0000 7f90ebe31640 1 -- 172.21.15.33:0/4274024230 wait complete. 2024-05-08T10:56:24.454 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":79,"stamp":"2024-05-08T10:56:22.964052+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":220400,"kb_used_data":4232,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754320,"statfs":{"total":773094113280,"available":772868423680,"internally_reserved":0,"allocated":4333568,"data_stored":2394936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002416"},"pg_stats":[{"pgid":"1.0","version":"34'119","reported_seq":205,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-08T10:56:04.308860+0000","last_change":"2024-05-08T10:56:04.308896+0000","last_active":"2024-05-08T10:56:04.308860+0000","last_peered":"2024-05-08T10:56:04.308860+0000","last_clean":"2024-05-08T10:56:04.308860+0000","last_became_active":"2024-05-08T10:54:40.014219+0000","last_became_peered":"2024-05-08T10:54:40.014219+0000","last_unstale":"2024-05-08T10:56:04.308860+0000","last_undegraded":"2024-05-08T10:56:04.308860+0000","last_fullsized":"2024-05-08T10:56:04.308860+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'119","last_scrub_stamp":"2024-05-08T10:56:04.308771+0000","last_deep_scrub":"34'119","last_deep_scrub_stamp":"2024-05-08T10:56:04.308771+0000","last_clean_scrub_stamp":"2024-05-08T10:56:04.308771+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:49:53.280296+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574872,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27980,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343860,"statfs":{"total":96636764160,"available":96608112640,"internally_reserved":0,"allocated":987136,"data_stored":742143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574872,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27408,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":393216,"data_stored":151775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574872,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27408,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":393216,"data_stored":151775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574872,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27408,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":393216,"data_stored":151775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574872,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27408,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":393216,"data_stored":151775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574872,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27404,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":393216,"data_stored":151775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27404,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":393216,"data_stored":151775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574873,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27980,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343860,"statfs":{"total":96636764160,"available":96608112640,"internally_reserved":0,"allocated":987136,"data_stored":742143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T10:56:24.455 DEBUG:teuthology.orchestra.run.smithi033:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-05-08T10:56:24.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.561+0000 7f3e74212640 1 Processor -- start 2024-05-08T10:56:24.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.561+0000 7f3e74212640 1 -- start start 2024-05-08T10:56:24.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.562+0000 7f3e74212640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f3e6c15e180 0x7f3e6c06aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:24.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.562+0000 7f3e74212640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f3e6c0b3530 0x7f3e6c06c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:24.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.562+0000 7f3e74212640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e6c06b1d0 con 0x7f3e6c0b3150 2024-05-08T10:56:24.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.562+0000 7f3e74212640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e6c06bde0 con 0x7f3e6c15e180 2024-05-08T10:56:24.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.562+0000 7f3e74212640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e6c06b4b0 con 0x7f3e6c0b3530 2024-05-08T10:56:24.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.562+0000 7f3e717ad640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f3e6c15e180 0x7f3e6c06aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:24.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.562+0000 7f3e717ad640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f3e6c15e180 0x7f3e6c06aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45698/0 (socket says 172.21.15.33:45698) 2024-05-08T10:56:24.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.562+0000 7f3e717ad640 1 -- 172.21.15.33:0/1881298600 learned_addr learned my addr 172.21.15.33:0/1881298600 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:56:24.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.562+0000 7f3e71fae640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f3e6c0b3150 0x7f3e6c15da70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:37100/0 (socket says 172.21.15.33:37100) 2024-05-08T10:56:24.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.562+0000 7f3e727af640 1 --2- 172.21.15.33:0/1881298600 >> v2:172.21.15.174:3300/0 conn(0x7f3e6c0b3530 0x7f3e6c06c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:24.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.562+0000 7f3e717ad640 1 -- 172.21.15.33:0/1881298600 >> v2:172.21.15.174:3300/0 conn(0x7f3e6c0b3530 msgr2=0x7f3e6c06c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:56:24.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.562+0000 7f3e717ad640 1 --2- 172.21.15.33:0/1881298600 >> v2:172.21.15.174:3300/0 conn(0x7f3e6c0b3530 0x7f3e6c06c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:24.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.562+0000 7f3e717ad640 1 -- 172.21.15.33:0/1881298600 >> v1:172.21.15.33:6789/0 conn(0x7f3e6c0b3150 legacy=0x7f3e6c15da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:24.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.562+0000 7f3e717ad640 1 -- 172.21.15.33:0/1881298600 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e6c06b790 con 0x7f3e6c15e180 2024-05-08T10:56:24.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.563+0000 7f3e717ad640 1 --2- 172.21.15.33:0/1881298600 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e6c15e180 0x7f3e6c06aba0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c161a90 tx=0x7f3e5c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=591ef34e1974a08f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:56:24.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.563+0000 7f3e70fac640 1 -- 172.21.15.33:0/1881298600 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e5c037070 con 0x7f3e6c15e180 2024-05-08T10:56:24.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.563+0000 7f3e70fac640 1 -- 172.21.15.33:0/1881298600 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e5c032440 con 0x7f3e6c15e180 2024-05-08T10:56:24.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.563+0000 7f3e70fac640 1 -- 172.21.15.33:0/1881298600 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e5c032810 con 0x7f3e6c15e180 2024-05-08T10:56:24.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.563+0000 7f3e74212640 1 -- 172.21.15.33:0/1881298600 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e6c15e180 msgr2=0x7f3e6c06aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:24.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.563+0000 7f3e74212640 1 --2- 172.21.15.33:0/1881298600 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e6c15e180 0x7f3e6c06aba0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c161a90 tx=0x7f3e5c02a270 comp rx=0 tx=0).stop 2024-05-08T10:56:24.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.564+0000 7f3e74212640 1 -- 172.21.15.33:0/1881298600 shutdown_connections 2024-05-08T10:56:24.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.564+0000 7f3e74212640 1 --2- 172.21.15.33:0/1881298600 >> v2:172.21.15.174:3300/0 conn(0x7f3e6c0b3530 0x7f3e6c06c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:24.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.564+0000 7f3e74212640 1 --2- 172.21.15.33:0/1881298600 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e6c15e180 0x7f3e6c06aba0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:24.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.564+0000 7f3e74212640 1 -- 172.21.15.33:0/1881298600 >> 172.21.15.33:0/1881298600 conn(0x7f3e6c0b1be0 msgr2=0x7f3e6c0b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:56:24.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.564+0000 7f3e74212640 1 -- 172.21.15.33:0/1881298600 shutdown_connections 2024-05-08T10:56:24.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.564+0000 7f3e74212640 1 -- 172.21.15.33:0/1881298600 wait complete. 2024-05-08T10:56:24.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.565+0000 7f3e74212640 1 Processor -- start 2024-05-08T10:56:24.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.565+0000 7f3e74212640 1 -- start start 2024-05-08T10:56:24.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.566+0000 7f3e74212640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e6c0b3150 0x7f3e6c1f6f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:24.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.566+0000 7f3e74212640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3e6c0b3530 0x7f3e6c0c46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:24.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.566+0000 7f3e74212640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3e6c15e180 0x7f3e6c06ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:24.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.566+0000 7f3e74212640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e6c1626e0 con 0x7f3e6c0b3150 2024-05-08T10:56:24.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.566+0000 7f3e74212640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e6c162560 con 0x7f3e6c0b3530 2024-05-08T10:56:24.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.566+0000 7f3e74212640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e6c162860 con 0x7f3e6c15e180 2024-05-08T10:56:24.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.566+0000 7f3e71fae640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e6c0b3150 0x7f3e6c1f6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:24.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.566+0000 7f3e71fae640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e6c0b3150 0x7f3e6c1f6f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45714/0 (socket says 172.21.15.33:45714) 2024-05-08T10:56:24.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.566+0000 7f3e71fae640 1 -- 172.21.15.33:0/567865562 learned_addr learned my addr 172.21.15.33:0/567865562 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:56:24.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.566+0000 7f3e717ad640 1 --2- 172.21.15.33:0/567865562 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3e6c0b3530 0x7f3e6c0c46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:24.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.566+0000 7f3e727af640 1 --2- 172.21.15.33:0/567865562 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3e6c15e180 0x7f3e6c06ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:24.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.566+0000 7f3e71fae640 1 -- 172.21.15.33:0/567865562 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3e6c15e180 msgr2=0x7f3e6c06ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:24.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.566+0000 7f3e71fae640 1 --2- 172.21.15.33:0/567865562 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3e6c15e180 0x7f3e6c06ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:24.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.566+0000 7f3e71fae640 1 -- 172.21.15.33:0/567865562 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3e6c0b3530 msgr2=0x7f3e6c0c46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:24.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.566+0000 7f3e71fae640 1 --2- 172.21.15.33:0/567865562 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3e6c0b3530 0x7f3e6c0c46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:24.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.566+0000 7f3e71fae640 1 -- 172.21.15.33:0/567865562 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e6c0c4be0 con 0x7f3e6c0b3150 2024-05-08T10:56:24.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.566+0000 7f3e717ad640 1 --2- 172.21.15.33:0/567865562 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3e6c0b3530 0x7f3e6c0c46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T10:56:24.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.566+0000 7f3e71fae640 1 --2- 172.21.15.33:0/567865562 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e6c0b3150 0x7f3e6c1f6f80 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f3e6800c7c0 tx=0x7f3e6800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:56:24.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.566+0000 7f3e627fc640 1 -- 172.21.15.33:0/567865562 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e68017070 con 0x7f3e6c0b3150 2024-05-08T10:56:24.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.566+0000 7f3e627fc640 1 -- 172.21.15.33:0/567865562 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e6800a640 con 0x7f3e6c0b3150 2024-05-08T10:56:24.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.566+0000 7f3e74212640 1 -- 172.21.15.33:0/567865562 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e6c1f7640 con 0x7f3e6c0b3150 2024-05-08T10:56:24.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.566+0000 7f3e627fc640 1 -- 172.21.15.33:0/567865562 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e6800a9f0 con 0x7f3e6c0b3150 2024-05-08T10:56:24.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.566+0000 7f3e74212640 1 -- 172.21.15.33:0/567865562 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e6c1f7c00 con 0x7f3e6c0b3150 2024-05-08T10:56:24.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.567+0000 7f3e74212640 1 -- 172.21.15.33:0/567865562 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e6c069d20 con 0x7f3e6c0b3150 2024-05-08T10:56:24.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.568+0000 7f3e627fc640 1 -- 172.21.15.33:0/567865562 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3e6801a070 con 0x7f3e6c0b3150 2024-05-08T10:56:24.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.568+0000 7f3e627fc640 1 --2- 172.21.15.33:0/567865562 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f3e5006b500 0x7f3e5006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:24.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.568+0000 7f3e627fc640 1 -- 172.21.15.33:0/567865562 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f3e68089460 con 0x7f3e6c0b3150 2024-05-08T10:56:24.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.568+0000 7f3e717ad640 1 --2- 172.21.15.33:0/567865562 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f3e5006b500 0x7f3e5006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:24.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.569+0000 7f3e717ad640 1 --2- 172.21.15.33:0/567865562 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f3e5006b500 0x7f3e5006d9c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c034000 tx=0x7f3e5c02e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:56:24.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.572+0000 7f3e627fc640 1 -- 172.21.15.33:0/567865562 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3e68057f90 con 0x7f3e6c0b3150 2024-05-08T10:56:24.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.754+0000 7f3e74212640 1 -- 172.21.15.33:0/567865562 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f3e6c073fb0 con 0x7f3e6c0b3150 2024-05-08T10:56:24.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.757+0000 7f3e627fc640 1 -- 172.21.15.33:0/567865562 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v12)=0 v12) v1 ==== 123+0+0 (secure 0 0 0) 0x7f3e6805c030 con 0x7f3e6c0b3150 2024-05-08T10:56:24.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.759+0000 7f3e627fc640 1 -- 172.21.15.33:0/567865562 <== mon.0 v2:172.21.15.33:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f3e680605f0 con 0x7f3e6c0b3150 2024-05-08T10:56:24.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.760+0000 7f3e74212640 1 -- 172.21.15.33:0/567865562 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f3e5006b500 msgr2=0x7f3e5006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:24.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.760+0000 7f3e74212640 1 --2- 172.21.15.33:0/567865562 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f3e5006b500 0x7f3e5006d9c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c034000 tx=0x7f3e5c02e000 comp rx=0 tx=0).stop 2024-05-08T10:56:24.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.760+0000 7f3e74212640 1 -- 172.21.15.33:0/567865562 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e6c0b3150 msgr2=0x7f3e6c1f6f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:24.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.760+0000 7f3e74212640 1 --2- 172.21.15.33:0/567865562 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e6c0b3150 0x7f3e6c1f6f80 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f3e6800c7c0 tx=0x7f3e6800cc80 comp rx=0 tx=0).stop 2024-05-08T10:56:24.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.760+0000 7f3e74212640 1 -- 172.21.15.33:0/567865562 shutdown_connections 2024-05-08T10:56:24.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.760+0000 7f3e74212640 1 --2- 172.21.15.33:0/567865562 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f3e5006b500 0x7f3e5006d9c0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:24.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.760+0000 7f3e74212640 1 --2- 172.21.15.33:0/567865562 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3e6c15e180 0x7f3e6c06ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:24.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.760+0000 7f3e74212640 1 --2- 172.21.15.33:0/567865562 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3e6c0b3530 0x7f3e6c0c46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:24.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.760+0000 7f3e74212640 1 --2- 172.21.15.33:0/567865562 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e6c0b3150 0x7f3e6c1f6f80 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:24.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.760+0000 7f3e74212640 1 -- 172.21.15.33:0/567865562 >> 172.21.15.33:0/567865562 conn(0x7f3e6c0b1be0 msgr2=0x7f3e6c0b1320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:56:24.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.760+0000 7f3e74212640 1 -- 172.21.15.33:0/567865562 shutdown_connections 2024-05-08T10:56:24.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.760+0000 7f3e74212640 1 -- 172.21.15.33:0/567865562 wait complete. 2024-05-08T10:56:24.769 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-08T10:56:24.769 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T10:56:24.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.875+0000 7f8a9217e640 1 Processor -- start 2024-05-08T10:56:24.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.875+0000 7f8a9217e640 1 -- start start 2024-05-08T10:56:24.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.876+0000 7f8a9217e640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f8a8c0d03c0 0x7f8a8c0d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:24.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.876+0000 7f8a9217e640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f8a8c0d07a0 0x7f8a8c0b6990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:24.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.876+0000 7f8a9217e640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a8c0ce650 con 0x7f8a8c0b6ed0 2024-05-08T10:56:24.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.876+0000 7f8a9217e640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a8c0d1e60 con 0x7f8a8c0d03c0 2024-05-08T10:56:24.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.876+0000 7f8a9217e640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a8c0d4250 con 0x7f8a8c0d07a0 2024-05-08T10:56:24.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.876+0000 7f8a8b7fe640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f8a8c0d03c0 0x7f8a8c0d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:24.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.876+0000 7f8a8b7fe640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f8a8c0d03c0 0x7f8a8c0d1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45726/0 (socket says 172.21.15.33:45726) 2024-05-08T10:56:24.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.876+0000 7f8a8b7fe640 1 -- 172.21.15.33:0/2877406128 learned_addr learned my addr 172.21.15.33:0/2877406128 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:56:24.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.876+0000 7f8a8bfff640 1 --1- 172.21.15.33:0/2877406128 >> v1:172.21.15.33:6789/0 conn(0x7f8a8c0b6ed0 0x7f8a8c0cf0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:37114/0 (socket says 172.21.15.33:37114) 2024-05-08T10:56:24.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.877+0000 7f8a8b7fe640 1 -- 172.21.15.33:0/2877406128 >> v2:172.21.15.174:3300/0 conn(0x7f8a8c0d07a0 msgr2=0x7f8a8c0b6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T10:56:24.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.877+0000 7f8a8affd640 1 --2- 172.21.15.33:0/2877406128 >> v2:172.21.15.174:3300/0 conn(0x7f8a8c0d07a0 0x7f8a8c0b6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:24.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.877+0000 7f8a8a7fc640 1 -- 172.21.15.33:0/2877406128 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3854115108 0 0) 0x7f8a8c0ce650 con 0x7f8a8c0b6ed0 2024-05-08T10:56:24.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.877+0000 7f8a8b7fe640 1 --2- 172.21.15.33:0/2877406128 >> v2:172.21.15.174:3300/0 conn(0x7f8a8c0d07a0 0x7f8a8c0b6990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:24.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.877+0000 7f8a8b7fe640 1 -- 172.21.15.33:0/2877406128 >> v1:172.21.15.33:6789/0 conn(0x7f8a8c0b6ed0 legacy=0x7f8a8c0cf0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:24.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.877+0000 7f8a8b7fe640 1 -- 172.21.15.33:0/2877406128 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a8c0d4530 con 0x7f8a8c0d03c0 2024-05-08T10:56:24.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.877+0000 7f8a8b7fe640 1 --2- 172.21.15.33:0/2877406128 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8a8c0d03c0 0x7f8a8c0d1920 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c08e160 tx=0x7f8a7c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4275fa69153f681f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:56:24.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.878+0000 7f8a8a7fc640 1 -- 172.21.15.33:0/2877406128 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a7c037070 con 0x7f8a8c0d03c0 2024-05-08T10:56:24.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.878+0000 7f8a8a7fc640 1 -- 172.21.15.33:0/2877406128 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f8a7c032440 con 0x7f8a8c0d03c0 2024-05-08T10:56:24.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.878+0000 7f8a8a7fc640 1 -- 172.21.15.33:0/2877406128 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a7c032830 con 0x7f8a8c0d03c0 2024-05-08T10:56:24.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.878+0000 7f8a9217e640 1 -- 172.21.15.33:0/2877406128 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8a8c0d03c0 msgr2=0x7f8a8c0d1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:24.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.878+0000 7f8a9217e640 1 --2- 172.21.15.33:0/2877406128 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8a8c0d03c0 0x7f8a8c0d1920 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c08e160 tx=0x7f8a7c02a270 comp rx=0 tx=0).stop 2024-05-08T10:56:24.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.878+0000 7f8a9217e640 1 -- 172.21.15.33:0/2877406128 shutdown_connections 2024-05-08T10:56:24.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.878+0000 7f8a9217e640 1 --2- 172.21.15.33:0/2877406128 >> v2:172.21.15.174:3300/0 conn(0x7f8a8c0d07a0 0x7f8a8c0b6990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:24.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.878+0000 7f8a9217e640 1 --2- 172.21.15.33:0/2877406128 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8a8c0d03c0 0x7f8a8c0d1920 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:24.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.878+0000 7f8a9217e640 1 -- 172.21.15.33:0/2877406128 >> 172.21.15.33:0/2877406128 conn(0x7f8a8c09ce90 msgr2=0x7f8a8c0d3b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:56:24.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.878+0000 7f8a9217e640 1 -- 172.21.15.33:0/2877406128 shutdown_connections 2024-05-08T10:56:24.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.878+0000 7f8a9217e640 1 -- 172.21.15.33:0/2877406128 wait complete. 2024-05-08T10:56:24.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.879+0000 7f8a9217e640 1 Processor -- start 2024-05-08T10:56:24.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.880+0000 7f8a9217e640 1 -- start start 2024-05-08T10:56:24.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.880+0000 7f8a9217e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8a8c0d03c0 0x7f8a8c157060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:24.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.880+0000 7f8a9217e640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8a8c0d07a0 0x7f8a8c0b72c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:24.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.880+0000 7f8a9217e640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8a8c0b7800 0x7f8a8c157ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:24.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.880+0000 7f8a9217e640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a8c0cebd0 con 0x7f8a8c0d03c0 2024-05-08T10:56:24.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.880+0000 7f8a9217e640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a8c0ce8f0 con 0x7f8a8c0b7800 2024-05-08T10:56:24.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.880+0000 7f8a9217e640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a8c0b4db0 con 0x7f8a8c0d07a0 2024-05-08T10:56:24.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.880+0000 7f8a8b7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8a8c0d03c0 0x7f8a8c157060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:24.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.880+0000 7f8a8b7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8a8c0d03c0 0x7f8a8c157060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45730/0 (socket says 172.21.15.33:45730) 2024-05-08T10:56:24.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.880+0000 7f8a8b7fe640 1 -- 172.21.15.33:0/3005906317 learned_addr learned my addr 172.21.15.33:0/3005906317 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T10:56:24.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.881+0000 7f8a8bfff640 1 --2- 172.21.15.33:0/3005906317 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8a8c0b7800 0x7f8a8c157ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:24.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.881+0000 7f8a8affd640 1 --2- 172.21.15.33:0/3005906317 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8a8c0d07a0 0x7f8a8c0b72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:24.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.881+0000 7f8a8b7fe640 1 -- 172.21.15.33:0/3005906317 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8a8c0d07a0 msgr2=0x7f8a8c0b72c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:24.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.881+0000 7f8a8b7fe640 1 --2- 172.21.15.33:0/3005906317 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8a8c0d07a0 0x7f8a8c0b72c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:24.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.881+0000 7f8a8b7fe640 1 -- 172.21.15.33:0/3005906317 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8a8c0b7800 msgr2=0x7f8a8c157ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:24.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.881+0000 7f8a8b7fe640 1 --2- 172.21.15.33:0/3005906317 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8a8c0b7800 0x7f8a8c157ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:24.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.881+0000 7f8a8b7fe640 1 -- 172.21.15.33:0/3005906317 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a8c1575a0 con 0x7f8a8c0d03c0 2024-05-08T10:56:24.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.881+0000 7f8a8affd640 1 --2- 172.21.15.33:0/3005906317 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8a8c0d07a0 0x7f8a8c0b72c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T10:56:24.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.881+0000 7f8a8b7fe640 1 --2- 172.21.15.33:0/3005906317 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8a8c0d03c0 0x7f8a8c157060 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f8a7c000c00 tx=0x7f8a7c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:56:24.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.881+0000 7f8a73fff640 1 -- 172.21.15.33:0/3005906317 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a7c041020 con 0x7f8a8c0d03c0 2024-05-08T10:56:24.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.881+0000 7f8a73fff640 1 -- 172.21.15.33:0/3005906317 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f8a7c030970 con 0x7f8a8c0d03c0 2024-05-08T10:56:24.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.881+0000 7f8a9217e640 1 -- 172.21.15.33:0/3005906317 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a8c158c50 con 0x7f8a8c0d03c0 2024-05-08T10:56:24.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.881+0000 7f8a73fff640 1 -- 172.21.15.33:0/3005906317 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a7c037040 con 0x7f8a8c0d03c0 2024-05-08T10:56:24.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.881+0000 7f8a9217e640 1 -- 172.21.15.33:0/3005906317 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a8c159210 con 0x7f8a8c0d03c0 2024-05-08T10:56:24.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.882+0000 7f8a9217e640 1 -- 172.21.15.33:0/3005906317 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a8c069d20 con 0x7f8a8c0d03c0 2024-05-08T10:56:24.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.883+0000 7f8a73fff640 1 -- 172.21.15.33:0/3005906317 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8a7c044020 con 0x7f8a8c0d03c0 2024-05-08T10:56:24.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.883+0000 7f8a73fff640 1 --2- 172.21.15.33:0/3005906317 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f8a7806b4d0 0x7f8a7806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T10:56:24.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.883+0000 7f8a73fff640 1 -- 172.21.15.33:0/3005906317 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f8a7c0aaac0 con 0x7f8a8c0d03c0 2024-05-08T10:56:24.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.883+0000 7f8a8affd640 1 --2- 172.21.15.33:0/3005906317 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f8a7806b4d0 0x7f8a7806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T10:56:24.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.884+0000 7f8a8affd640 1 --2- 172.21.15.33:0/3005906317 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f8a7806b4d0 0x7f8a7806d990 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c0b7e10 tx=0x7f8a80008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T10:56:24.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:24.887+0000 7f8a73fff640 1 -- 172.21.15.33:0/3005906317 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8a7c04b030 con 0x7f8a8c0d03c0 2024-05-08T10:56:25.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:25.108+0000 7f8a9217e640 1 -- 172.21.15.33:0/3005906317 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8a8c06c280 con 0x7f8a8c0d03c0 2024-05-08T10:56:25.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:25.108+0000 7f8a73fff640 1 -- 172.21.15.33:0/3005906317 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+3705 (secure 0 0 0) 0x7f8a7c079bb0 con 0x7f8a8c0d03c0 2024-05-08T10:56:25.106 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T10:56:25.106 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":16,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4592,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6836/2731663891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":2731663891},{"type":"v1","addr":"172.21.15.174:6836","nonce":2731663891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":4598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/2004985147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6833","nonce":2004985147},{"type":"v1","addr":"172.21.15.33:6835","nonce":2004985147}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4702,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6837/3164144740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6835","nonce":3164144740},{"type":"v1","addr":"172.21.15.174:6837","nonce":3164144740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5232,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6834/1723527699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":1723527699},{"type":"v1","addr":"172.21.15.33:6834","nonce":1723527699}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":16}],"filesystems":[]} 2024-05-08T10:56:25.106 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 16 2024-05-08T10:56:25.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:25.111+0000 7f8a9217e640 1 -- 172.21.15.33:0/3005906317 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f8a7806b4d0 msgr2=0x7f8a7806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:25.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:25.111+0000 7f8a9217e640 1 --2- 172.21.15.33:0/3005906317 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f8a7806b4d0 0x7f8a7806d990 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c0b7e10 tx=0x7f8a80008040 comp rx=0 tx=0).stop 2024-05-08T10:56:25.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:25.111+0000 7f8a9217e640 1 -- 172.21.15.33:0/3005906317 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8a8c0d03c0 msgr2=0x7f8a8c157060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T10:56:25.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:25.111+0000 7f8a9217e640 1 --2- 172.21.15.33:0/3005906317 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8a8c0d03c0 0x7f8a8c157060 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f8a7c000c00 tx=0x7f8a7c0046c0 comp rx=0 tx=0).stop 2024-05-08T10:56:25.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:25.111+0000 7f8a9217e640 1 -- 172.21.15.33:0/3005906317 shutdown_connections 2024-05-08T10:56:25.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:25.111+0000 7f8a9217e640 1 --2- 172.21.15.33:0/3005906317 >> [v2:172.21.15.174:6832/261355069,v1:172.21.15.174:6833/261355069] conn(0x7f8a7806b4d0 0x7f8a7806d990 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:25.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:25.111+0000 7f8a9217e640 1 --2- 172.21.15.33:0/3005906317 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8a8c0b7800 0x7f8a8c157ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:25.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:25.111+0000 7f8a9217e640 1 --2- 172.21.15.33:0/3005906317 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8a8c0d07a0 0x7f8a8c0b72c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:25.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:25.111+0000 7f8a9217e640 1 --2- 172.21.15.33:0/3005906317 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8a8c0d03c0 0x7f8a8c157060 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T10:56:25.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:25.111+0000 7f8a9217e640 1 -- 172.21.15.33:0/3005906317 >> 172.21.15.33:0/3005906317 conn(0x7f8a8c09ce90 msgr2=0x7f8a8c0b87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T10:56:25.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:25.111+0000 7f8a9217e640 1 -- 172.21.15.33:0/3005906317 shutdown_connections 2024-05-08T10:56:25.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T10:56:25.111+0000 7f8a9217e640 1 -- 172.21.15.33:0/3005906317 wait complete. 2024-05-08T10:56:25.119 DEBUG:tasks.cephfs.filesystem:already dead... 2024-05-08T10:56:25.120 INFO:teuthology.misc:Shutting down mds daemons... 2024-05-08T10:56:25.120 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-08T10:56:25.120 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T10:56:25.130 INFO:tasks.ceph.mds.a:Stopped 2024-05-08T10:56:25.130 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-08T10:56:25.130 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T10:56:25.180 INFO:tasks.ceph.mds.c:Stopped 2024-05-08T10:56:25.180 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-08T10:56:25.180 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T10:56:25.192 INFO:tasks.ceph.mds.b:Stopped 2024-05-08T10:56:25.192 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-08T10:56:25.193 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T10:56:25.244 INFO:tasks.ceph.mds.d:Stopped 2024-05-08T10:56:25.245 INFO:teuthology.misc:Shutting down osd daemons... 2024-05-08T10:56:25.245 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-05-08T10:56:25.245 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T10:56:25.271 INFO:tasks.ceph.osd.0:Stopped 2024-05-08T10:56:25.271 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-05-08T10:56:25.271 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T10:56:25.338 INFO:tasks.ceph.osd.1:Stopped 2024-05-08T10:56:25.338 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-05-08T10:56:25.338 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T10:56:25.413 INFO:tasks.ceph.osd.2:Stopped 2024-05-08T10:56:25.413 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-05-08T10:56:25.414 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T10:56:25.480 INFO:tasks.ceph.osd.3:Stopped 2024-05-08T10:56:25.480 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-05-08T10:56:25.480 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T10:56:25.510 INFO:tasks.ceph.osd.4:Stopped 2024-05-08T10:56:25.510 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-05-08T10:56:25.510 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T10:56:25.589 INFO:tasks.ceph.osd.5:Stopped 2024-05-08T10:56:25.590 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-05-08T10:56:25.590 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T10:56:25.664 INFO:tasks.ceph.osd.6:Stopped 2024-05-08T10:56:25.664 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-05-08T10:56:25.665 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T10:56:25.743 INFO:tasks.ceph.osd.7:Stopped 2024-05-08T10:56:25.743 INFO:teuthology.misc:Shutting down mgr daemons... 2024-05-08T10:56:25.743 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-05-08T10:56:25.743 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T10:56:25.769 INFO:tasks.ceph.mgr.y:Stopped 2024-05-08T10:56:25.770 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-05-08T10:56:25.770 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T10:56:25.815 INFO:tasks.ceph.mgr.x:Stopped 2024-05-08T10:56:25.815 INFO:teuthology.misc:Shutting down mon daemons... 2024-05-08T10:56:25.815 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-05-08T10:56:25.815 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T10:56:25.830 INFO:tasks.ceph.mon.a:Stopped 2024-05-08T10:56:25.830 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-05-08T10:56:25.830 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T10:56:25.868 INFO:tasks.ceph.mon.b:Stopped 2024-05-08T10:56:25.868 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-05-08T10:56:25.868 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T10:56:25.921 INFO:tasks.ceph.mon.c:Stopped 2024-05-08T10:56:25.921 INFO:tasks.ceph:Checking cluster log for badness... 2024-05-08T10:56:25.921 DEBUG:teuthology.orchestra.run.smithi033:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | head -n 1 2024-05-08T10:56:25.958 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi033.front.sepia.ceph.com 2024-05-08T10:56:25.958 DEBUG:teuthology.orchestra.run.smithi033:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-05-08T10:56:26.139 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi033.front.sepia.ceph.com 2024-05-08T10:56:26.140 DEBUG:teuthology.orchestra.run.smithi033:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-05-08T10:56:26.218 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi033.front.sepia.ceph.com 2024-05-08T10:56:26.219 DEBUG:teuthology.orchestra.run.smithi033:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-05-08T10:56:26.272 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi033.front.sepia.ceph.com 2024-05-08T10:56:26.272 DEBUG:teuthology.orchestra.run.smithi033:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-05-08T10:56:26.321 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi174.front.sepia.ceph.com 2024-05-08T10:56:26.322 DEBUG:teuthology.orchestra.run.smithi174:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-05-08T10:56:26.478 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi174.front.sepia.ceph.com 2024-05-08T10:56:26.478 DEBUG:teuthology.orchestra.run.smithi174:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-05-08T10:56:26.543 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi174.front.sepia.ceph.com 2024-05-08T10:56:26.543 DEBUG:teuthology.orchestra.run.smithi174:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-05-08T10:56:26.608 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi174.front.sepia.ceph.com 2024-05-08T10:56:26.608 DEBUG:teuthology.orchestra.run.smithi174:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-05-08T10:56:26.675 INFO:tasks.ceph:Archiving mon data... 2024-05-08T10:56:26.676 DEBUG:teuthology.misc:Transferring archived files from smithi033:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/jcollin-2024-05-08_10:38:33-fs:functional-main-distro-default-smithi/7697403/data/mon.a.tgz 2024-05-08T10:56:26.676 DEBUG:teuthology.orchestra.run.smithi033:> mktemp 2024-05-08T10:56:26.693 INFO:teuthology.orchestra.run.smithi033.stdout:/tmp/tmp.MzEitFFhMS 2024-05-08T10:56:26.694 DEBUG:teuthology.orchestra.run.smithi033:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.MzEitFFhMS 2024-05-08T10:56:26.828 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod 0666 /tmp/tmp.MzEitFFhMS 2024-05-08T10:56:26.914 DEBUG:teuthology.orchestra.remote:smithi033:/tmp/tmp.MzEitFFhMS is 267KB 2024-05-08T10:56:27.010 DEBUG:teuthology.orchestra.run.smithi033:> rm -fr /tmp/tmp.MzEitFFhMS 2024-05-08T10:56:27.027 DEBUG:teuthology.misc:Transferring archived files from smithi174:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/jcollin-2024-05-08_10:38:33-fs:functional-main-distro-default-smithi/7697403/data/mon.b.tgz 2024-05-08T10:56:27.027 DEBUG:teuthology.orchestra.run.smithi174:> mktemp 2024-05-08T10:56:27.046 INFO:teuthology.orchestra.run.smithi174.stdout:/tmp/tmp.AOcMauNtpH 2024-05-08T10:56:27.046 DEBUG:teuthology.orchestra.run.smithi174:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.AOcMauNtpH 2024-05-08T10:56:27.187 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod 0666 /tmp/tmp.AOcMauNtpH 2024-05-08T10:56:27.272 DEBUG:teuthology.orchestra.remote:smithi174:/tmp/tmp.AOcMauNtpH is 360KB 2024-05-08T10:56:27.368 DEBUG:teuthology.orchestra.run.smithi174:> rm -fr /tmp/tmp.AOcMauNtpH 2024-05-08T10:56:27.384 DEBUG:teuthology.misc:Transferring archived files from smithi174:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/jcollin-2024-05-08_10:38:33-fs:functional-main-distro-default-smithi/7697403/data/mon.c.tgz 2024-05-08T10:56:27.384 DEBUG:teuthology.orchestra.run.smithi174:> mktemp 2024-05-08T10:56:27.439 INFO:teuthology.orchestra.run.smithi174.stdout:/tmp/tmp.crxDg3mAv1 2024-05-08T10:56:27.439 DEBUG:teuthology.orchestra.run.smithi174:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.crxDg3mAv1 2024-05-08T10:56:27.568 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod 0666 /tmp/tmp.crxDg3mAv1 2024-05-08T10:56:27.651 DEBUG:teuthology.orchestra.remote:smithi174:/tmp/tmp.crxDg3mAv1 is 360KB 2024-05-08T10:56:27.748 DEBUG:teuthology.orchestra.run.smithi174:> rm -fr /tmp/tmp.crxDg3mAv1 2024-05-08T10:56:27.763 INFO:tasks.ceph:Cleaning ceph cluster... 2024-05-08T10:56:27.763 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-08T10:56:27.765 DEBUG:teuthology.orchestra.run.smithi174:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-08T10:56:27.850 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-05-08T10:56:27.883 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-05-08T10:56:27.883 INFO:tasks.ceph:Archiving crash dumps... 2024-05-08T10:56:27.884 DEBUG:teuthology.misc:Transferring archived files from smithi033:/var/lib/ceph/crash to /home/teuthworker/archive/jcollin-2024-05-08_10:38:33-fs:functional-main-distro-default-smithi/7697403/remote/smithi033/crash 2024-05-08T10:56:27.885 DEBUG:teuthology.orchestra.run.smithi033:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-08T10:56:27.920 DEBUG:teuthology.misc:Transferring archived files from smithi174:/var/lib/ceph/crash to /home/teuthworker/archive/jcollin-2024-05-08_10:38:33-fs:functional-main-distro-default-smithi/7697403/remote/smithi174/crash 2024-05-08T10:56:27.920 DEBUG:teuthology.orchestra.run.smithi174:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-08T10:56:27.946 INFO:tasks.ceph:Shutting down logrotate 2024-05-08T10:56:27.947 DEBUG:teuthology.orchestra.run.smithi033:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T10:56:27.965 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T10:56:28.039 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-05-08T10:56:28.066 DEBUG:teuthology.orchestra.run.smithi174:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-05-08T10:56:28.094 INFO:tasks.ceph:Compressing logs... 2024-05-08T10:56:28.094 DEBUG:teuthology.orchestra.run.smithi033:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-08T10:56:28.109 DEBUG:teuthology.orchestra.run.smithi174:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-08T10:56:28.176 INFO:teuthology.orchestra.run.smithi174.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35659.log 2024-05-08T10:56:28.176 INFO:teuthology.orchestra.run.smithi174.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.42337.log 2024-05-08T10:56:28.176 INFO:teuthology.orchestra.run.smithi174.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-05-08T10:56:28.176 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph-client.admin.35659.log: /var/log/ceph/ceph-client.3.42337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.41940.log 2024-05-08T10:56:28.176 INFO:teuthology.orchestra.run.smithi174.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.35659.log.gz 2024-05-08T10:56:28.176 INFO:teuthology.orchestra.run.smithi174.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.3.42337.log.gz 2024-05-08T10:56:28.176 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-05-08T10:56:28.176 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph-client.1.41940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35528.log 0.0% 2024-05-08T10:56:28.176 INFO:teuthology.orchestra.run.smithi174.stderr: -- replaced with /var/log/ceph/ceph-client.1.41940.log.gz 2024-05-08T10:56:28.176 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph.audit.log: gzip 91.0% -- replaced with /var/log/ceph/ceph.log.gz -5 2024-05-08T10:56:28.176 INFO:teuthology.orchestra.run.smithi174.stderr: --verbose -- /var/log/ceph/ceph-osd.7.log 2024-05-08T10:56:28.177 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph-client.admin.35528.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-05-08T10:56:28.177 INFO:teuthology.orchestra.run.smithi174.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35528.log.gz 2024-05-08T10:56:28.177 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-05-08T10:56:28.177 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35739.log 2024-05-08T10:56:28.177 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-05-08T10:56:28.177 INFO:teuthology.orchestra.run.smithi174.stderr: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-05-08T10:56:28.177 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph-client.admin.35739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35699.log 2024-05-08T10:56:28.177 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph-osd.4.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35739.log.gz 2024-05-08T10:56:28.177 INFO:teuthology.orchestra.run.smithi174.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-05-08T10:56:28.177 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph-client.admin.35699.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-05-08T10:56:28.177 INFO:teuthology.orchestra.run.smithi174.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.35699.log.gz 2024-05-08T10:56:28.177 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35488.log 2024-05-08T10:56:28.177 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-05-08T10:56:28.177 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph-client.admin.35488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35612.log 2024-05-08T10:56:28.178 INFO:teuthology.orchestra.run.smithi174.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.35488.log.gz 2024-05-08T10:56:28.186 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43052.log 2024-05-08T10:56:28.186 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49535.log 2024-05-08T10:56:28.186 INFO:teuthology.orchestra.run.smithi033.stderr:gzip/var/log/ceph/ceph-client.admin.43052.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.50081.log 2024-05-08T10:56:28.186 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.49535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41510.log 2024-05-08T10:56:28.186 INFO:teuthology.orchestra.run.smithi033.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43052.log.gz 2024-05-08T10:56:28.186 INFO:teuthology.orchestra.run.smithi033.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49535.log.gz 2024-05-08T10:56:28.186 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.50081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41992.log 2024-05-08T10:56:28.186 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.41510.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50081.log.gz 2024-05-08T10:56:28.186 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47257.log 2024-05-08T10:56:28.186 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.41992.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41510.log.gz 2024-05-08T10:56:28.186 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43420.log 2024-05-08T10:56:28.186 INFO:teuthology.orchestra.run.smithi033.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41992.log.gz 2024-05-08T10:56:28.186 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.47257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46766.log 2024-05-08T10:56:28.187 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.43420.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.47257.log.gz 2024-05-08T10:56:28.187 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.29334.log 2024-05-08T10:56:28.187 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.46766.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43420.log.gz 2024-05-08T10:56:28.187 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43050.log 2024-05-08T10:56:28.187 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph.tmp-client.admin.29334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49451.log 2024-05-08T10:56:28.187 INFO:teuthology.orchestra.run.smithi033.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.29334.log.gz 2024-05-08T10:56:28.187 INFO:teuthology.orchestra.run.smithi033.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.46766.log.gz 2024-05-08T10:56:28.187 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42378.log 2024-05-08T10:56:28.187 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.43050.log: /var/log/ceph/ceph-client.admin.49451.log: gzip -5 --verbose 88.0% -- /var/log/ceph/ceph-client.admin.47618.log -- replaced with /var/log/ceph/ceph-client.admin.43050.log.gz 2024-05-08T10:56:28.187 INFO:teuthology.orchestra.run.smithi033.stderr: 2024-05-08T10:56:28.187 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.42378.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49451.log.gz 2024-05-08T10:56:28.187 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41382.log 2024-05-08T10:56:28.187 INFO:teuthology.orchestra.run.smithi033.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42378.log.gz 2024-05-08T10:56:28.187 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.47618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42719.log 2024-05-08T10:56:28.187 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.41382.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47618.log.gz 2024-05-08T10:56:28.188 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44817.log 2024-05-08T10:56:28.188 INFO:teuthology.orchestra.run.smithi033.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41382.log.gz 2024-05-08T10:56:28.188 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.42719.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-05-08T10:56:28.188 INFO:teuthology.orchestra.run.smithi033.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42719.log.gz 2024-05-08T10:56:28.188 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.44817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49829.log 2024-05-08T10:56:28.188 INFO:teuthology.orchestra.run.smithi033.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44817.log.gz 2024-05-08T10:56:28.188 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35407.log 2024-05-08T10:56:28.188 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.49829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41824.log 2024-05-08T10:56:28.188 INFO:teuthology.orchestra.run.smithi033.stderr: 83.7% -- replaced with /var/log/ceph/ceph.log.gz 2024-05-08T10:56:28.188 INFO:teuthology.orchestra.run.smithi033.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49829.log.gz 2024-05-08T10:56:28.188 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.35407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41656.log 2024-05-08T10:56:28.188 INFO:teuthology.orchestra.run.smithi033.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35407.log.gz 2024-05-08T10:56:28.188 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.41824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45653.log 2024-05-08T10:56:28.188 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.41656.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.41824.log.gzgzip 2024-05-08T10:56:28.188 INFO:teuthology.orchestra.run.smithi033.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.44169.log 2024-05-08T10:56:28.188 INFO:teuthology.orchestra.run.smithi033.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41656.log.gz 2024-05-08T10:56:28.189 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.45653.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-05-08T10:56:28.189 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.44169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44691.log 2024-05-08T10:56:28.189 INFO:teuthology.orchestra.run.smithi033.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45653.log.gz 2024-05-08T10:56:28.189 INFO:teuthology.orchestra.run.smithi033.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44169.log.gz 2024-05-08T10:56:28.189 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42373.log 2024-05-08T10:56:28.189 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.44691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49703.log 2024-05-08T10:56:28.189 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.42373.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44691.log.gz 2024-05-08T10:56:28.189 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41300.log 2024-05-08T10:56:28.189 INFO:teuthology.orchestra.run.smithi033.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.42373.log.gz/var/log/ceph/ceph-client.admin.49703.log: 2024-05-08T10:56:28.189 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43053.log 2024-05-08T10:56:28.189 INFO:teuthology.orchestra.run.smithi033.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49703.log.gz 2024-05-08T10:56:28.189 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.41300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42720.log 2024-05-08T10:56:28.189 INFO:teuthology.orchestra.run.smithi033.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41300.log.gz 2024-05-08T10:56:28.189 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.43053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45569.log 2024-05-08T10:56:28.189 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.42720.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43053.log.gz 2024-05-08T10:56:28.190 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45951.log 2024-05-08T10:56:28.190 INFO:teuthology.orchestra.run.smithi033.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42720.log.gz 2024-05-08T10:56:28.190 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.45569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50123.log 2024-05-08T10:56:28.190 INFO:teuthology.orchestra.run.smithi033.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45569.log.gz 2024-05-08T10:56:28.190 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.45951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48034.log 2024-05-08T10:56:28.190 INFO:teuthology.orchestra.run.smithi033.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45951.log.gz/var/log/ceph/ceph-client.admin.50123.log: 2024-05-08T10:56:28.190 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-05-08T10:56:28.190 INFO:teuthology.orchestra.run.smithi033.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50123.log.gz 2024-05-08T10:56:28.190 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.0.48034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47199.log 2024-05-08T10:56:28.190 INFO:teuthology.orchestra.run.smithi033.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.48034.log.gz 2024-05-08T10:56:28.190 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35675.log 2024-05-08T10:56:28.190 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.47199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44607.log 2024-05-08T10:56:28.190 INFO:teuthology.orchestra.run.smithi033.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47199.log.gz 2024-05-08T10:56:28.190 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.35675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45425.log 2024-05-08T10:56:28.190 INFO:teuthology.orchestra.run.smithi033.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.35675.log.gz 2024-05-08T10:56:28.191 INFO:teuthology.orchestra.run.smithi033.stderr: 89.0% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-05-08T10:56:28.191 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50225.log 2024-05-08T10:56:28.191 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.44607.log: /var/log/ceph/ceph-client.admin.45425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47722.log 2024-05-08T10:56:28.191 INFO:teuthology.orchestra.run.smithi033.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45425.log.gz 2024-05-08T10:56:28.191 INFO:teuthology.orchestra.run.smithi033.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.44607.log.gz 2024-05-08T10:56:28.191 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.50225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49871.log 2024-05-08T10:56:28.191 INFO:teuthology.orchestra.run.smithi033.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50225.log.gz 2024-05-08T10:56:28.191 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.47722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42712.log 2024-05-08T10:56:28.191 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.49871.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47722.log.gz 2024-05-08T10:56:28.191 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44733.log 2024-05-08T10:56:28.191 INFO:teuthology.orchestra.run.smithi033.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49871.log.gz 2024-05-08T10:56:28.191 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.42712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48738.log 2024-05-08T10:56:28.191 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.44733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49009.log 89.2% 2024-05-08T10:56:28.191 INFO:teuthology.orchestra.run.smithi033.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42712.log.gz 2024-05-08T10:56:28.191 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.48738.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44733.log.gz 2024-05-08T10:56:28.191 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42718.log 2024-05-08T10:56:28.192 INFO:teuthology.orchestra.run.smithi033.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48738.log.gz 2024-05-08T10:56:28.192 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.49009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43378.log 2024-05-08T10:56:28.192 INFO:teuthology.orchestra.run.smithi033.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49009.log.gz 2024-05-08T10:56:28.192 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.42718.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-05-08T10:56:28.192 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.43378.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42718.log.gz 2024-05-08T10:56:28.192 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49051.log 2024-05-08T10:56:28.192 INFO:teuthology.orchestra.run.smithi033.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43378.log.gz 2024-05-08T10:56:28.192 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45383.log 2024-05-08T10:56:28.192 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.49051.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41782.log 2024-05-08T10:56:28.192 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.45383.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49051.log.gz 2024-05-08T10:56:28.192 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42118.log 2024-05-08T10:56:28.192 INFO:teuthology.orchestra.run.smithi033.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.45383.log.gz 2024-05-08T10:56:28.192 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41908.log 2024-05-08T10:56:28.192 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.41782.log: /var/log/ceph/ceph-client.admin.42118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49493.log 2024-05-08T10:56:28.192 INFO:teuthology.orchestra.run.smithi033.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41782.log.gz 2024-05-08T10:56:28.193 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.41908.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42118.log.gz 2024-05-08T10:56:28.193 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50265.log 2024-05-08T10:56:28.193 INFO:teuthology.orchestra.run.smithi033.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.41908.log.gz 2024-05-08T10:56:28.193 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42383.log 2024-05-08T10:56:28.193 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.49493.log: /var/log/ceph/ceph-client.admin.50265.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45090.log 2024-05-08T10:56:28.193 INFO:teuthology.orchestra.run.smithi033.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49493.log.gz 2024-05-08T10:56:28.193 INFO:teuthology.orchestra.run.smithi033.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50265.log.gz 2024-05-08T10:56:28.193 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.42383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46682.log 2024-05-08T10:56:28.193 INFO:teuthology.orchestra.run.smithi033.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42383.log.gz 2024-05-08T10:56:28.193 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43051.log 2024-05-08T10:56:28.193 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.45090.log: /var/log/ceph/ceph-client.admin.46682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48864.log 2024-05-08T10:56:28.193 INFO:teuthology.orchestra.run.smithi033.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45090.log.gz 2024-05-08T10:56:28.193 INFO:teuthology.orchestra.run.smithi033.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46682.log.gz 2024-05-08T10:56:28.193 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.43051.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41740.log 2024-05-08T10:56:28.193 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-05-08T10:56:28.194 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.48864.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43051.log.gz 2024-05-08T10:56:28.194 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.41740.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48864.log.gz 2024-05-08T10:56:28.194 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42702.log 2024-05-08T10:56:28.194 INFO:teuthology.orchestra.run.smithi033.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.41740.log.gz 2024-05-08T10:56:28.194 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43462.log 2024-05-08T10:56:28.194 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-mds.c.log: /var/log/ceph/ceph-client.admin.42702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42916.log 2024-05-08T10:56:28.194 INFO:teuthology.orchestra.run.smithi033.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.42702.log.gz 2024-05-08T10:56:28.194 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.43462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42076.log 2024-05-08T10:56:28.194 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.42916.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.43462.log.gz 2024-05-08T10:56:28.194 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-05-08T10:56:28.194 INFO:teuthology.orchestra.run.smithi033.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42916.log.gz/var/log/ceph/ceph-client.admin.42076.log: 2024-05-08T10:56:28.194 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-05-08T10:56:28.194 INFO:teuthology.orchestra.run.smithi033.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.42076.log.gz 2024-05-08T10:56:28.194 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46472.log 2024-05-08T10:56:28.194 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-05-08T10:56:28.195 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.46472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48678.log 2024-05-08T10:56:28.195 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42717.log 2024-05-08T10:56:28.195 INFO:teuthology.orchestra.run.smithi033.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46472.log.gz 2024-05-08T10:56:28.195 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.48678.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.48678.log.gz 2024-05-08T10:56:28.195 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45012.log 2024-05-08T10:56:28.195 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.42717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49325.log 2024-05-08T10:56:28.195 INFO:teuthology.orchestra.run.smithi033.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42717.log.gz 2024-05-08T10:56:28.195 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.45012.log: gzip -5 --verbose 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45012.log.gz 2024-05-08T10:56:28.195 INFO:teuthology.orchestra.run.smithi033.stderr: -- /var/log/ceph/ceph-client.admin.48359.log 2024-05-08T10:56:28.195 INFO:teuthology.orchestra.run.smithi033.stderr: 92.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48254.log 2024-05-08T10:56:28.195 INFO:teuthology.orchestra.run.smithi033.stderr: -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-05-08T10:56:28.195 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.49325.log: /var/log/ceph/ceph-client.admin.48359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45341.log 2024-05-08T10:56:28.195 INFO:teuthology.orchestra.run.smithi033.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49325.log.gz 2024-05-08T10:56:28.195 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.48254.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.48359.log.gz 2024-05-08T10:56:28.195 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48906.log 2024-05-08T10:56:28.195 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.45341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47504.log 2024-05-08T10:56:28.196 INFO:teuthology.orchestra.run.smithi033.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48254.log.gz 2024-05-08T10:56:28.196 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.48906.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45341.log.gz 2024-05-08T10:56:28.196 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46640.log 2024-05-08T10:56:28.196 INFO:teuthology.orchestra.run.smithi033.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48906.log.gz 2024-05-08T10:56:28.196 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.47504.log: -- /var/log/ceph/ceph-client.admin.42202.log 2024-05-08T10:56:28.196 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.46640.log: 89.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43336.log 2024-05-08T10:56:28.196 INFO:teuthology.orchestra.run.smithi033.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47504.log.gz 2024-05-08T10:56:28.196 INFO:teuthology.orchestra.run.smithi033.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46640.log.gz 2024-05-08T10:56:28.196 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.42202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49093.log 2024-05-08T10:56:28.196 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.43336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41866.log 2024-05-08T10:56:28.196 INFO:teuthology.orchestra.run.smithi033.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42202.log.gz 2024-05-08T10:56:28.196 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.49093.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43336.log.gz 2024-05-08T10:56:28.196 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46832.log 2024-05-08T10:56:28.196 INFO:teuthology.orchestra.run.smithi033.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49093.log.gz 2024-05-08T10:56:28.196 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46293.log 2024-05-08T10:56:28.197 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.41866.log: /var/log/ceph/ceph-client.admin.46832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45908.log 2024-05-08T10:56:28.197 INFO:teuthology.orchestra.run.smithi033.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.46832.log.gz/var/log/ceph/ceph-client.admin.46293.log: 2024-05-08T10:56:28.197 INFO:teuthology.orchestra.run.smithi033.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.41866.log.gz 2024-05-08T10:56:28.197 INFO:teuthology.orchestra.run.smithi033.stderr: 89.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43056.log 2024-05-08T10:56:28.197 INFO:teuthology.orchestra.run.smithi033.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46293.log.gz 2024-05-08T10:56:28.197 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.45908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45611.log 2024-05-08T10:56:28.197 INFO:teuthology.orchestra.run.smithi033.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45908.log.gz 2024-05-08T10:56:28.197 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-05-08T10:56:28.197 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.43056.log: /var/log/ceph/ceph-client.admin.45611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48542.log 2024-05-08T10:56:28.197 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-mon.a.log: 88.3% 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43056.log.gz 2024-05-08T10:56:28.197 INFO:teuthology.orchestra.run.smithi033.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45611.log.gz 2024-05-08T10:56:28.197 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47467.log 2024-05-08T10:56:28.197 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47846.log 2024-05-08T10:56:28.197 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.48542.log: /var/log/ceph/ceph-client.admin.47467.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.48542.log.gz 2024-05-08T10:56:28.197 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46037.log 2024-05-08T10:56:28.198 INFO:teuthology.orchestra.run.smithi033.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.47467.log.gz 2024-05-08T10:56:28.198 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.47846.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47846.log.gz 2024-05-08T10:56:28.198 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47331.log 2024-05-08T10:56:28.198 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44901.log 2024-05-08T10:56:28.198 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.46037.log: /var/log/ceph/ceph-client.admin.47331.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46037.log.gz 2024-05-08T10:56:28.198 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42382.log 2024-05-08T10:56:28.198 INFO:teuthology.orchestra.run.smithi033.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.47331.log.gz 2024-05-08T10:56:28.198 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.44901.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44901.log.gz 2024-05-08T10:56:28.198 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46121.log 2024-05-08T10:56:28.198 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42381.log 2024-05-08T10:56:28.198 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.42382.log: /var/log/ceph/ceph-client.admin.46121.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42382.log.gz 2024-05-08T10:56:28.198 INFO:teuthology.orchestra.run.smithi033.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46121.log.gz 2024-05-08T10:56:28.198 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41204.log 2024-05-08T10:56:28.198 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.42381.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42381.log.gz 2024-05-08T10:56:28.198 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50165.log 2024-05-08T10:56:28.199 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42034.log 2024-05-08T10:56:28.199 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.41204.log: /var/log/ceph/ceph-client.admin.50165.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41204.log.gz 2024-05-08T10:56:28.199 INFO:teuthology.orchestra.run.smithi033.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50165.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43252.log 2024-05-08T10:56:28.199 INFO:teuthology.orchestra.run.smithi033.stderr: 2024-05-08T10:56:28.199 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.42034.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42034.log.gz 2024-05-08T10:56:28.199 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49661.log 2024-05-08T10:56:28.199 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48966.log 2024-05-08T10:56:28.199 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.43252.log: /var/log/ceph/ceph-client.admin.49661.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43252.log.gz 2024-05-08T10:56:28.199 INFO:teuthology.orchestra.run.smithi033.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49661.log.gz 2024-05-08T10:56:28.199 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49997.log 2024-05-08T10:56:28.199 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.48966.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48966.log.gz 2024-05-08T10:56:28.199 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41596.log 2024-05-08T10:56:28.199 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47430.log 2024-05-08T10:56:28.199 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.49997.log: /var/log/ceph/ceph-client.admin.41596.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49997.log.gz 2024-05-08T10:56:28.199 INFO:teuthology.orchestra.run.smithi033.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41596.log.gz 2024-05-08T10:56:28.200 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41123.log 2024-05-08T10:56:28.200 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.47430.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.47430.log.gz 2024-05-08T10:56:28.200 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41950.log 2024-05-08T10:56:28.200 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45485.log 2024-05-08T10:56:28.200 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.41123.log: /var/log/ceph/ceph-client.admin.41950.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41123.log.gz 2024-05-08T10:56:28.200 INFO:teuthology.orchestra.run.smithi033.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.41950.log.gz 2024-05-08T10:56:28.200 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42715.log 2024-05-08T10:56:28.200 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.45485.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45485.log.gz 2024-05-08T10:56:28.200 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49745.log 2024-05-08T10:56:28.200 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42713.log 2024-05-08T10:56:28.200 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.42715.log: /var/log/ceph/ceph-client.admin.49745.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42715.log.gz 2024-05-08T10:56:28.206 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35779.log 2024-05-08T10:56:28.206 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph-client.admin.35612.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.35612.log.gz 2024-05-08T10:56:28.206 INFO:teuthology.orchestra.run.smithi174.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35568.log 2024-05-08T10:56:28.207 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph-client.admin.35779.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.35779.log.gz 2024-05-08T10:56:28.207 INFO:teuthology.orchestra.run.smithi174.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-05-08T10:56:28.207 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph-client.admin.35568.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.35568.log.gz 2024-05-08T10:56:28.207 INFO:teuthology.orchestra.run.smithi174.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-05-08T10:56:28.208 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph-mds.d.log: 91.4% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-05-08T10:56:28.208 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph-mon.b.log: 91.6% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-05-08T10:56:28.209 INFO:teuthology.orchestra.run.smithi174.stderr: 94.3% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-05-08T10:56:28.235 INFO:teuthology.orchestra.run.smithi174.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-05-08T10:56:28.237 INFO:teuthology.orchestra.run.smithi033.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49745.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49787.log 2024-05-08T10:56:28.237 INFO:teuthology.orchestra.run.smithi033.stderr: 2024-05-08T10:56:28.238 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.42713.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.42713.log.gz 2024-05-08T10:56:28.238 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47661.log 2024-05-08T10:56:28.238 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48636.log 2024-05-08T10:56:28.238 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.49787.log: /var/log/ceph/ceph-client.admin.47661.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49787.log.gz 2024-05-08T10:56:28.238 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46514.log 2024-05-08T10:56:28.238 INFO:teuthology.orchestra.run.smithi033.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.47661.log.gz 2024-05-08T10:56:28.238 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.48636.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.48636.log.gz 2024-05-08T10:56:28.238 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42160.log 2024-05-08T10:56:28.238 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45527.log 2024-05-08T10:56:28.238 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.46514.log: /var/log/ceph/ceph-client.admin.42160.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46514.log.gz 2024-05-08T10:56:28.238 INFO:teuthology.orchestra.run.smithi033.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.42160.log.gz 2024-05-08T10:56:28.238 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41698.log 2024-05-08T10:56:28.238 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.45527.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45527.log.gz 2024-05-08T10:56:28.238 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45866.log 2024-05-08T10:56:28.239 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42379.log 2024-05-08T10:56:28.239 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.41698.log: /var/log/ceph/ceph-client.admin.45866.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.41698.log.gz 2024-05-08T10:56:28.239 INFO:teuthology.orchestra.run.smithi033.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45866.log.gz 2024-05-08T10:56:28.239 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45257.log 2024-05-08T10:56:28.239 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.42379.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42379.log.gz 2024-05-08T10:56:28.239 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44775.log 2024-05-08T10:56:28.239 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48433.log 2024-05-08T10:56:28.239 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.45257.log: /var/log/ceph/ceph-client.admin.44775.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45257.log.gz 2024-05-08T10:56:28.239 INFO:teuthology.orchestra.run.smithi033.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44775.log.gz 2024-05-08T10:56:28.239 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48192.log 2024-05-08T10:56:28.239 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46079.log 2024-05-08T10:56:28.239 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.48433.log: /var/log/ceph/ceph-client.admin.48192.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.48433.log.gz 2024-05-08T10:56:28.239 INFO:teuthology.orchestra.run.smithi033.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48192.log.gz 2024-05-08T10:56:28.239 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41466.log 2024-05-08T10:56:28.239 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43546.log 2024-05-08T10:56:28.240 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.46079.log: /var/log/ceph/ceph-client.admin.41466.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46079.log.gz 2024-05-08T10:56:28.240 INFO:teuthology.orchestra.run.smithi033.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.41466.log.gz 2024-05-08T10:56:28.240 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41554.log 2024-05-08T10:56:28.240 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50307.log 2024-05-08T10:56:28.240 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.43546.log: /var/log/ceph/ceph-client.admin.41554.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.41554.log.gz 2024-05-08T10:56:28.240 INFO:teuthology.orchestra.run.smithi033.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.43546.log.gz 2024-05-08T10:56:28.240 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45299.log 2024-05-08T10:56:28.240 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46163.log 2024-05-08T10:56:28.240 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.50307.log: /var/log/ceph/ceph-client.admin.45299.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50307.log.gz 2024-05-08T10:56:28.240 INFO:teuthology.orchestra.run.smithi033.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45299.log.gz 2024-05-08T10:56:28.240 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43055.log 2024-05-08T10:56:28.240 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35790.log 2024-05-08T10:56:28.240 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.46163.log: /var/log/ceph/ceph-client.admin.43055.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46163.log.gz 2024-05-08T10:56:28.240 INFO:teuthology.orchestra.run.smithi033.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43055.log.gz 2024-05-08T10:56:28.241 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46598.log 2024-05-08T10:56:28.241 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47557.log 2024-05-08T10:56:28.241 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.35790.log: /var/log/ceph/ceph-client.admin.46598.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35790.log.gz 2024-05-08T10:56:28.241 INFO:teuthology.orchestra.run.smithi033.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46598.log.gz 2024-05-08T10:56:28.241 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48130.log 2024-05-08T10:56:28.241 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.47557.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.47557.log.gz 2024-05-08T10:56:28.241 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43294.log 2024-05-08T10:56:28.241 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46344.log 2024-05-08T10:56:28.241 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.48130.log: /var/log/ceph/ceph-client.admin.43294.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48130.log.gz 2024-05-08T10:56:28.241 INFO:teuthology.orchestra.run.smithi033.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43294.log.gz 2024-05-08T10:56:28.241 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43054.log 2024-05-08T10:56:28.241 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.46344.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46344.log.gz 2024-05-08T10:56:28.241 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42384.log 2024-05-08T10:56:28.241 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49913.log 2024-05-08T10:56:28.241 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.43054.log: 92.7% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-05-08T10:56:28.242 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.42384.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43054.log.gz 2024-05-08T10:56:28.242 INFO:teuthology.orchestra.run.smithi033.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42384.log.gz 2024-05-08T10:56:28.242 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44033.log 2024-05-08T10:56:28.242 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.49913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48396.log 2024-05-08T10:56:28.242 INFO:teuthology.orchestra.run.smithi033.stderr: 88.5%/var/log/ceph/ceph-client.0.44033.log: -- replaced with /var/log/ceph/ceph-client.admin.49913.log.gz 2024-05-08T10:56:28.242 INFO:teuthology.orchestra.run.smithi033.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.44033.log.gz 2024-05-08T10:56:28.242 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49619.log 2024-05-08T10:56:28.242 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.48396.log: /var/log/ceph/ceph-client.admin.49409.log 2024-05-08T10:56:28.242 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44649.log 2024-05-08T10:56:28.242 INFO:teuthology.orchestra.run.smithi033.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48396.log.gz 2024-05-08T10:56:28.242 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.49619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41424.log 2024-05-08T10:56:28.242 INFO:teuthology.orchestra.run.smithi033.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49619.log.gz 2024-05-08T10:56:28.242 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.44649.log: /var/log/ceph/ceph-client.admin.49409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45180.log 2024-05-08T10:56:28.242 INFO:teuthology.orchestra.run.smithi033.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49409.log.gz 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44649.log.gz 2024-05-08T10:56:28.243 INFO:teuthology.orchestra.run.smithi033.stderr: 2024-05-08T10:56:28.243 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.41424.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41424.log.gz 2024-05-08T10:56:28.243 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47784.log 2024-05-08T10:56:28.243 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.45180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48316.log 2024-05-08T10:56:28.243 INFO:teuthology.orchestra.run.smithi033.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45180.log.gz 2024-05-08T10:56:28.243 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.47784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47387.log 2024-05-08T10:56:28.243 INFO:teuthology.orchestra.run.smithi033.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47784.log.gz 2024-05-08T10:56:28.243 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.48316.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-05-08T10:56:28.243 INFO:teuthology.orchestra.run.smithi033.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48316.log.gz 2024-05-08T10:56:28.243 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.47387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46386.log 2024-05-08T10:56:28.243 INFO:teuthology.orchestra.run.smithi033.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47387.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48822.log 2024-05-08T10:56:28.243 INFO:teuthology.orchestra.run.smithi033.stderr: 2024-05-08T10:56:28.243 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-mds.a.log: /var/log/ceph/ceph-client.admin.46386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.44473.log 2024-05-08T10:56:28.243 INFO:teuthology.orchestra.run.smithi033.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46386.log.gz 2024-05-08T10:56:28.243 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.48822.log: 91.7% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-05-08T10:56:28.244 INFO:teuthology.orchestra.run.smithi033.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48822.log.gz 2024-05-08T10:56:28.244 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45695.log 2024-05-08T10:56:28.244 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.2.44473.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.2.44473.log.gz 2024-05-08T10:56:28.244 INFO:teuthology.orchestra.run.smithi033.stderr: --verbose -- /var/log/ceph/ceph-client.admin.49577.log 2024-05-08T10:56:28.244 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.45695.log: gzip -5 --verbose -- 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45695.log.gz 2024-05-08T10:56:28.244 INFO:teuthology.orchestra.run.smithi033.stderr: /var/log/ceph/ceph-client.admin.45995.log 2024-05-08T10:56:28.244 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.49577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49955.log 2024-05-08T10:56:28.244 INFO:teuthology.orchestra.run.smithi033.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49577.log.gz 2024-05-08T10:56:28.244 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.45995.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46205.log 2024-05-08T10:56:28.244 INFO:teuthology.orchestra.run.smithi033.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45995.log.gz 2024-05-08T10:56:28.244 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47020.log 2024-05-08T10:56:28.244 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.49955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42377.log 2024-05-08T10:56:28.244 INFO:teuthology.orchestra.run.smithi033.stderr: 88.4%/var/log/ceph/ceph-client.admin.46205.log: -- replaced with /var/log/ceph/ceph-client.admin.49955.log.gz 2024-05-08T10:56:28.244 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.0.47020.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.47020.log.gz 2024-05-08T10:56:28.244 INFO:teuthology.orchestra.run.smithi033.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46205.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48780.log 2024-05-08T10:56:28.245 INFO:teuthology.orchestra.run.smithi033.stderr: 2024-05-08T10:56:28.245 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.42377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45775.log 2024-05-08T10:56:28.245 INFO:teuthology.orchestra.run.smithi033.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42377.log.gz 2024-05-08T10:56:28.245 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.48780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46724.log 2024-05-08T10:56:28.245 INFO:teuthology.orchestra.run.smithi033.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48780.log.gz 2024-05-08T10:56:28.245 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.45775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49367.log 2024-05-08T10:56:28.245 INFO:teuthology.orchestra.run.smithi033.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45775.log.gz 2024-05-08T10:56:28.245 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43684.log 2024-05-08T10:56:28.245 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.46724.log: /var/log/ceph/ceph-client.admin.49367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44859.log 2024-05-08T10:56:28.245 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.43684.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46724.log.gz 2024-05-08T10:56:28.245 INFO:teuthology.orchestra.run.smithi033.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49367.log.gz 2024-05-08T10:56:28.245 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47294.log 2024-05-08T10:56:28.245 INFO:teuthology.orchestra.run.smithi033.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.43684.log.gz 2024-05-08T10:56:28.245 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46249.log 2024-05-08T10:56:28.245 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.44859.log: /var/log/ceph/ceph-client.admin.47294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46556.log 2024-05-08T10:56:28.245 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.46249.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44859.log.gz 2024-05-08T10:56:28.246 INFO:teuthology.orchestra.run.smithi033.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47294.log.gz 2024-05-08T10:56:28.246 INFO:teuthology.orchestra.run.smithi033.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46249.log.gz 2024-05-08T10:56:28.246 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43504.log 2024-05-08T10:56:28.246 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49135.log 2024-05-08T10:56:28.246 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.46556.log: /var/log/ceph/ceph-client.admin.43504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50039.log 2024-05-08T10:56:28.246 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.49135.log: 88.4% 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46556.log.gz 2024-05-08T10:56:28.246 INFO:teuthology.orchestra.run.smithi033.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43504.log.gz 2024-05-08T10:56:28.246 INFO:teuthology.orchestra.run.smithi033.stderr: 88.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.49135.log.gz 2024-05-08T10:56:28.246 INFO:teuthology.orchestra.run.smithi033.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.46428.log 2024-05-08T10:56:28.246 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.50039.log: /var/log/ceph/ceph-client.admin.46428.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50039.log.gz 2024-05-08T10:56:28.246 INFO:teuthology.orchestra.run.smithi033.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46428.log.gz 2024-05-08T10:56:28.247 INFO:teuthology.orchestra.run.smithi033.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-05-08T10:56:28.282 INFO:teuthology.orchestra.run.smithi174.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-05-08T10:56:28.286 INFO:teuthology.orchestra.run.smithi174.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-05-08T10:56:28.290 INFO:teuthology.orchestra.run.smithi033.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-05-08T10:56:28.301 INFO:teuthology.orchestra.run.smithi174.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-05-08T10:56:28.302 INFO:teuthology.orchestra.run.smithi033.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-05-08T10:56:28.305 INFO:teuthology.orchestra.run.smithi033.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-05-08T10:56:28.309 INFO:teuthology.orchestra.run.smithi174.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-05-08T10:56:28.334 INFO:teuthology.orchestra.run.smithi174.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-05-08T10:56:28.336 INFO:teuthology.orchestra.run.smithi174.stderr: 2024-05-08T10:56:28.336 INFO:teuthology.orchestra.run.smithi174.stderr:real 0m0.183s 2024-05-08T10:56:28.336 INFO:teuthology.orchestra.run.smithi174.stderr:user 0m0.774s 2024-05-08T10:56:28.336 INFO:teuthology.orchestra.run.smithi174.stderr:sys 0m0.057s 2024-05-08T10:56:28.353 INFO:teuthology.orchestra.run.smithi033.stderr: 91.0% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-05-08T10:56:28.355 INFO:teuthology.orchestra.run.smithi033.stderr: 2024-05-08T10:56:28.355 INFO:teuthology.orchestra.run.smithi033.stderr:real 0m0.232s 2024-05-08T10:56:28.355 INFO:teuthology.orchestra.run.smithi033.stderr:user 0m0.851s 2024-05-08T10:56:28.355 INFO:teuthology.orchestra.run.smithi033.stderr:sys 0m0.144s 2024-05-08T10:56:28.355 INFO:tasks.ceph:Archiving logs... 2024-05-08T10:56:28.356 DEBUG:teuthology.misc:Transferring archived files from smithi033:/var/log/ceph to /home/teuthworker/archive/jcollin-2024-05-08_10:38:33-fs:functional-main-distro-default-smithi/7697403/remote/smithi033/log 2024-05-08T10:56:28.357 DEBUG:teuthology.orchestra.run.smithi033:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-08T10:56:28.666 DEBUG:teuthology.misc:Transferring archived files from smithi174:/var/log/ceph to /home/teuthworker/archive/jcollin-2024-05-08_10:38:33-fs:functional-main-distro-default-smithi/7697403/remote/smithi174/log 2024-05-08T10:56:28.667 DEBUG:teuthology.orchestra.run.smithi174:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-08T10:56:28.796 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-05-08T10:56:28.806 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-05-08T10:56:28.806 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-08T10:56:28.809 DEBUG:teuthology.orchestra.run.smithi174:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-08T10:56:28.910 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-05-08T10:56:28.919 INFO:teuthology.task.clock:Checking final clock skew... 2024-05-08T10:56:28.920 DEBUG:teuthology.orchestra.run.smithi033:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-08T10:56:28.922 DEBUG:teuthology.orchestra.run.smithi174:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-08T10:56:28.935 INFO:teuthology.orchestra.run.smithi033.stderr:bash: line 1: ntpq: command not found 2024-05-08T10:56:28.937 INFO:teuthology.orchestra.run.smithi174.stderr:bash: line 1: ntpq: command not found 2024-05-08T10:56:28.940 INFO:teuthology.orchestra.run.smithi033.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-08T10:56:28.940 INFO:teuthology.orchestra.run.smithi033.stdout:=============================================================================== 2024-05-08T10:56:28.940 INFO:teuthology.orchestra.run.smithi033.stdout:^+ hv01.front.sepia.ceph.com 3 6 377 9 -1397us[-1385us] +/- 69ms 2024-05-08T10:56:28.940 INFO:teuthology.orchestra.run.smithi033.stdout:^* hv02.front.sepia.ceph.com 3 6 377 8 +1098us[+1109us] +/- 57ms 2024-05-08T10:56:28.940 INFO:teuthology.orchestra.run.smithi033.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 8 +58us[ +69us] +/- 87ms 2024-05-08T10:56:28.940 INFO:teuthology.orchestra.run.smithi033.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T10:56:28.942 INFO:teuthology.orchestra.run.smithi174.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-08T10:56:28.942 INFO:teuthology.orchestra.run.smithi174.stdout:=============================================================================== 2024-05-08T10:56:28.942 INFO:teuthology.orchestra.run.smithi174.stdout:^+ hv01.front.sepia.ceph.com 3 6 377 10 -1392us[-1399us] +/- 69ms 2024-05-08T10:56:28.942 INFO:teuthology.orchestra.run.smithi174.stdout:^* hv02.front.sepia.ceph.com 3 6 377 9 +1093us[+1086us] +/- 57ms 2024-05-08T10:56:28.942 INFO:teuthology.orchestra.run.smithi174.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 9 +70us[ +70us] +/- 87ms 2024-05-08T10:56:28.942 INFO:teuthology.orchestra.run.smithi174.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T10:56:28.942 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-05-08T10:56:28.951 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-05-08T10:56:28.952 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-05-08T10:56:28.965 DEBUG:teuthology.orchestra.run.smithi033:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-08T10:56:29.049 DEBUG:teuthology.orchestra.run.smithi174:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-08T10:56:29.111 DEBUG:teuthology.orchestra.run.smithi033:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-08T10:56:29.140 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T10:56:29.141 DEBUG:teuthology.orchestra.run.smithi174:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-08T10:56:29.168 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T10:56:29.168 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-05-08T10:56:29.178 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-05-08T10:56:29.211 INFO:teuthology.task.internal:Duration was 524.555382 seconds 2024-05-08T10:56:29.212 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-05-08T10:56:29.221 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-05-08T10:56:29.221 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-08T10:56:29.224 DEBUG:teuthology.orchestra.run.smithi174:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-08T10:56:29.262 INFO:teuthology.orchestra.run.smithi033.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-08T10:56:29.262 INFO:teuthology.orchestra.run.smithi174.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-08T10:56:29.627 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-05-08T10:56:29.627 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi033.front.sepia.ceph.com 2024-05-08T10:56:29.627 DEBUG:teuthology.orchestra.run.smithi033:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-08T10:56:29.691 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi174.front.sepia.ceph.com 2024-05-08T10:56:29.692 DEBUG:teuthology.orchestra.run.smithi174:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-08T10:56:29.723 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-05-08T10:56:29.723 DEBUG:teuthology.orchestra.run.smithi033:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-08T10:56:29.734 DEBUG:teuthology.orchestra.run.smithi174:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-08T10:56:29.789 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-05-08T10:56:29.790 DEBUG:teuthology.orchestra.run.smithi033:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-08T10:56:29.801 DEBUG:teuthology.orchestra.run.smithi174:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-08T10:56:29.928 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-05-08T10:56:29.939 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-05-08T10:56:29.939 DEBUG:teuthology.orchestra.run.smithi033:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-08T10:56:29.965 DEBUG:teuthology.orchestra.run.smithi174:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-08T10:56:29.991 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-05-08T10:56:30.002 DEBUG:teuthology.orchestra.run.smithi033:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-08T10:56:30.009 DEBUG:teuthology.orchestra.run.smithi174:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-08T10:56:30.030 INFO:teuthology.orchestra.run.smithi033.stdout:kernel.core_pattern = core 2024-05-08T10:56:30.054 INFO:teuthology.orchestra.run.smithi174.stdout:kernel.core_pattern = core 2024-05-08T10:56:30.068 DEBUG:teuthology.orchestra.run.smithi033:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-08T10:56:30.099 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T10:56:30.100 DEBUG:teuthology.orchestra.run.smithi174:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-08T10:56:30.123 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T10:56:30.123 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-05-08T10:56:30.134 INFO:teuthology.task.internal:Transferring archived files... 2024-05-08T10:56:30.135 DEBUG:teuthology.misc:Transferring archived files from smithi033:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/jcollin-2024-05-08_10:38:33-fs:functional-main-distro-default-smithi/7697403/remote/smithi033 2024-05-08T10:56:30.135 DEBUG:teuthology.orchestra.run.smithi033:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-08T10:56:30.175 DEBUG:teuthology.misc:Transferring archived files from smithi174:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/jcollin-2024-05-08_10:38:33-fs:functional-main-distro-default-smithi/7697403/remote/smithi174 2024-05-08T10:56:30.176 DEBUG:teuthology.orchestra.run.smithi174:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-08T10:56:30.209 INFO:teuthology.task.internal:Removing archive directory... 2024-05-08T10:56:30.209 DEBUG:teuthology.orchestra.run.smithi033:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-08T10:56:30.212 DEBUG:teuthology.orchestra.run.smithi174:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-08T10:56:30.260 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-05-08T10:56:30.271 INFO:teuthology.task.internal:Not uploading archives. 2024-05-08T10:56:30.272 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-05-08T10:56:30.321 INFO:teuthology.task.internal:Tidying up after the test... 2024-05-08T10:56:30.322 DEBUG:teuthology.orchestra.run.smithi033:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-08T10:56:30.324 DEBUG:teuthology.orchestra.run.smithi174:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-08T10:56:30.338 INFO:teuthology.orchestra.run.smithi033.stdout: 265296 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 8 10:56 /home/ubuntu/cephtest 2024-05-08T10:56:30.339 INFO:teuthology.orchestra.run.smithi174.stdout: 265295 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 8 10:56 /home/ubuntu/cephtest 2024-05-08T10:56:30.340 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-05-08T10:56:30.352 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-05-08T10:56:30.377 INFO:teuthology.run:Summary data: description: fs:functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/mds-flush} duration: 524.5553817749023 flavor: default owner: scheduled_jcollin@teuthology success: true 2024-05-08T10:56:30.378 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-08T10:56:30.457 INFO:teuthology.run:pass